Bit allocating, audio encoding and decoding.
Abstract
A bit allocating method is provided that includes determining the allocated number of bits in decimal point units based on each frequency band so that a Signal-to-Noise Ratio (SNR) of a spectrum existing in a predetermined frequency band is maximized within a range of the allowable number of bits for a given frame; and adjusting the allocated number of bits based on each frequency band.

Term
5.6 yearsleft in the term
Expires 14 May 2032.
- Priority
- Filed
- Granted
- Today
- Expires
17 claims: 7 independent, 10 dependent
- 1CLAIMS REIVINDICACIONES Habiéndose descrito la invención como antecede, se reclama como propiedad lo contenido en las siguientes Having described the invention as above, the content of the following is claimed as property 5 claims:5 reivindicaciones: 1. Un método de asignación de bits, caracterizado porque comprende: one. A bit allocation method, characterized in that it comprises: receive an audio signal;recibir una señal de audio;10 generate an audio spectrum by transforming the audio signal from a time domain to a frequency domain;10 generar un espectro de audio al transformar la señal de audio de un dominio de tiempo a un dominio de frecuencia;estimar fraccionalmente, mediante el uso de un procesador, los bits que van a ser asignados a una sub-banda fractionally estimate, using a processor, the bits to be assigned to a subband 15 en un marco de un espectro de audio, en consideración de los bits permisibles para el marco, en donde los bits estimados se establecen a cero cuando los bits estimados son menores que cero;fifteen in a frame of an audio spectrum, in consideration of the permissible bits for the frame, where the estimated bits are set to zero when the estimated bits are less than zero;cuando los bits estimados de la sub-banda son bits when the estimated bits of the subband are bits 20 diferentes de cero, redistribuir los bits estimados a la subbanda con bits que no son cero, para asignar los bits a la sub-banda;twenty non-zero, redistribute the estimated bits to the subband with non-zero bits, to assign the bits to the subband;cuantificar datos espectrales de la sub-banda utilizando los bits asignados;y transmitir una corriente de bits generada en base quantize spectral data of the subband using the allocated bits;and transmit a generated bit stream based INSTITUTO MEXICANO en los datos espectrales cuantificados. ----- MEXICAN INSTITUTE in the quantified spectral data. -----
- 7A bit allocation apparatus, characterized in that it comprises:7. Un aparato de asignación de bits, caracterizado porque comprende: a processor configured to: un procesador configurado para: receive an audio signal;recibir una señal de audio;generar un espectro de audio al transformar la señal de audio de un dominio de tiempo a un dominio de frecuencia;generate an audio spectrum by transforming the audio signal from a time domain to a frequency domain;estimar fraccionalmente bits para ser asignados a una sub-banda en un marco del espectro de audio, en consideración de los bits permisibles para el marco, en donde los bits estimados se establecen en cero cuando los bits estimados de la sub-banda son menos de cero, y cuando los bits estimados de la sub-banda son bits que no son cero, asignar los bits a la sub-banda al redistribuir los bits estimados a la sub-banda con bits que no son cero;fractionally estimate bits to be assigned to a subband in a frame of the audio spectrum, in consideration of the permissible bits for the frame, where the estimated bits are set to zero when the estimated bits of the subband are less than zero, and when the estimated bits of the subband are non-zero bits, allocate the bits to the subband by redistributing the estimated bits to the subband with non-zero bits;cuantificar los datos espectrales de la sub-banda utilizando los bits asignados;y transmitir una corriente de bits generada en base quantify the subband spectral data using the allocated bits;and transmit a generated bit stream based INSTITUTO MEXICANO Dé LA PROPIEDAD INDUSTRIAL en los datos espectrales cuantificados. MEXICAN INSTITUTE Give INDUSTRIAL PROPERTY in the quantified spectral data.
- 8An audio encoding apparatus, characterized in that it comprises:8. Un aparato codificador de audio, caracterizado porque comprende: a transformation unit configured to generate an audio spectrum by transforming an audio signal from a time domain to a frequency domain;una unidad de transformación configurada para generar un espectro de audio al transformar una señal de audio de un dominio de tiempo a un dominio de frecuencia;a bit allocation unit configured to fractionally estimate bits to be assigned to a subband in a frame of the audio spectrum, in consideration of the allowable bits for the frame, where the estimated bits are set to zero when the estimated bits of the subband are less than zero and when the estimated bits of the subband are non-zero bits, assign the bits to the subband by redistributing the estimated bits to the subband with non-zero bits;and a coding unit configured to encode the frame by quantizing spectral data based on the bits allocated for the subband and to transmit a generated bit stream based on the quantized spectral data. una unidad de asignación de bits configurada para estimar fraccionalmente bits para ser asignados a una subbanda en un marco del espectro de audio, en consideración a los bits permisibles para el marco, en donde los bits estimados se establecen en cero cuando los bits estimados de la sub-banda son menores que cero y cuando los bits estimados de la sub-banda son bits que no son cero, asignar los bits a la sub-banda al redistribuir los bits estimados a la subbanda con bits que no son cero;y una unidad de codificación configurada para codificar el marco al cuantificar datos espectrales en base en los bits asignados para la sub-banda y para transmitir una corriente de bits generada en base en los datos espectrales cuantificados.
- 9An audio decoding apparatus, characterized in that it comprises:9. Un aparato de decodificación de audio, caracterizado porque comprende: a bit allocation unit configured to fractionally estimate bits to be assigned to a subband in a frame of a bit stream, in consideration of the allowable bits for the frame, where the estimated bits are set to zero when the estimated bits of the subband is less than zero and when the estimated bits of the subband are non-zero bits, to assign the bits to the subband by redistributing the estimated bits to the subband with non-zero bits ;and a decoding unit configured to decode the frame by dequantizing the frame based on the bits allocated for the subband;una unidad de asignación de bits configurada para estimar fraccionalmente bits para ser asignados a una subbanda en un marco de una corriente de bits, en consideración a los bits permisibles para el marco, en donde los bits estimados se establecen en cero cuando los bits estimados de la sub-banda son menos que cero y cuando los bits estimados de la sub-banda son bits que no son cero, para asignar los bits a la sub-banda al redistribuir los bits estimados a la sub-banda con bits que no son cero;y una unidad de decodificación configurada para decodificar el marco al descuantificar el marco en base en los bits asignados para la sub-banda;a reverse transform unit configured to generate a reconstructed audio signal by transforming the dequantized frame into a time domain. una unidad de transformada inversa configurada para generar una señal de audio reconstruida al transformar el marco descuantificado en un dominio de tiempo.
- 1114. Claim 8, apparatus according to characterized in that the bit allocation unit is configured to set the bits assigned to predetermined minimum bits set for the subband when the allocated bits are less than the predetermined minimum bits 10. 14. El reivindicación 8, aparato de conformidad con la caracterizado porque la unidad de asignación de bits está configurada para establecer los bits asignados a bits mínimos predeterminados establecidos para la sub-banda cuando los bits asignados son menos que los bits 10 mínimos predeterminados.
- 1417. The apparatus in accordance with 17. El aparato de conformidad con la 20 reivindicación 9, caracterizado porque la unidad de asignación de bits está configurada para limitar los bits asignados, en base en el conjunto de bits mínimo predeterminado para la sub-banda. twenty Claim 9 characterized in that the bit allocation unit is configured to limit the allocated bits, based on the predetermined minimum bit set for the subband.
- 1518. The apparatus in accordance with 18. El aparato de conformidad con la 25 vindication 25 reivindicación 9, caracterizado porque la unidad de 9, characterized in that the unit of IMPI IMPI INSTITUTO MEXICANO DE LA Í-BOPIEDAD INDUSTRIAL asignación de bits está configurada para establecer los bits asignados a cero cuando los bits asignados son menos que el conjunto de bits mínimo predeterminado para la sub-banda. INSTITUTO MEXICANO DE LA-BOPIEDAD INDUSTRIAL Bit Allocation is configured to set the assigned bits to zero when the allocated bits are less than the default minimum bit set for the subband.
Independent claims7
569 paragraphs in 81 sections, as filed
(54) Title: BITS ASSIGNMENT, CODING AND DECODING OF AUDIO. (54) Title: BIT ALLOCATING, AUDIO ENCODING AND DECODING.
(57) Summary
A bit allocation method is provided that includes determining the assigned number of bits in decimal point units based on each frequency band, so that the Signal-to-Noise Ratio (SNR) of an existing spectrum in a band Default frequency is maximized within a range of the allowable number of bits for a given frame; and adjust the assigned number of bits according to each frequency band.
(57) Abstract
A bit allocating method is provided that ineludes determining the allocated number of bits in decimal point units based on each frequeney band so that a Signal-to-Noise Ratio (SNR) of a spectrum existing in a predetermined frequeney band is maximized within a range of the allowable number of bits for a given frame; and adjusting the allocated number of bits based on each frequeney band.
I KNOW
MXíUTAlUA ΡΪ UjOXÓMÍA de la
Institute
Mexican
Property
Industrial
<img file="MX337772B_D0001.tif" />
PATENT TITLE NO. 337772
Owner (s): SAMSUNG ELECTRONICS CO „LTD.
.; . <sup>:</sup> Άν. <sup>:</sup>
Address: 129, Samsung-ro, Yeongtong-gu, Suwon-si, Gyeonggi-do, 443-742, REPUBLIC
FROM KOREA
Name: BITS ASSIGNMENT, CODING AND DECODING OF AUDIO Classification: lnt.CI.8: G10L19 / 002; G10L19 / 028
Inventor (s): MI-YOUNG KIM; ANTON POROV; EUN-MI OH
No. <
MX / a / 2015.O05615
Divi ****
Coot for filing May 2012 Patent Number: 329813
PRIORITY
<td> 1 <sup>Country:</sup> 1 </td><td>Date:</td><td></td><td>Number:</td>
<td>1 US 1</td><td>May 13, 2011</td><td></td><td> 61/485,741</td>
<td>1 US 1 i</td><td>; June 9, 2011</td><td></td><td> 61/495,014</td>
<td>Clairvoyance: Twenty a / fcs</td><td>IW </td><td>what</td><td></td>
Expiration D ate: May 14, 2032
The reference patent is granted with fudjjamento in 1 °, 2 ° fraction V, 6 ° fraction III, and 59 of the Law of the In ^ jstrial Property.
Of informidad cor. article gS3 of the L | and of the Prop.edaítjf. counted from the date of presentation # 6n of the soUcitúm deráBtos. raise%
Quldi subscribes to the present document, he did so on the basis of _
Industrial Proabdad (Diario Cecial de lafederadón (DOF)
26 / (1/2004, 06/16/2005, 25/012006, 06/1) / 2009.06 / 01/2010, 06/18/1 inda a). 4th and 12th fracdonesfl and III of the Regulations of the Instituto Mexicaí
This patent has a validity of twenty non-extensible years, it will be subject to the payment of the fee to maintain validity of the
<img file="MX337772B_D0002.tif" />
»OWeWí« »ff and 7 ° bis 2 of the ly | and of the 1996, 12/26/1997, 17 ^ 5/1999, 1/2012); Articles 1, 3 f Section V idustrial (DOF 14/12/1999, rejjnado el rganico 1, 3
<img file="MX337772B_D0003.tif" />
Pity Inaust nai (uu r. Zmznass, rerormaao eriu / iu / zuuz, 2y / u / r2UU4704 / U8f2UtWYT3i and 5th paragraph a) of the Agreement that delegates powers to the Deputy Directors General, Coordinator, Divisional Directors, Regional Office Holders , Divisional Deputy Directors, Departmental Coordinators and other subordinates of the Mexican Institute of Industrial Property. (DOF 12/15/1999, amended on 02/04/2000, 07/29/2004, 08/04/2004 and 09/13/2007)
<img file="MX337772B_D0004.tif" />
Issue Date: March 18, 2016
THE DIVISIONAL DIRECTOR OF PATENTS
<img file="MX337772B_D0005.tif" />
NAHANNY CANAL REYES
Arenal No. 550, Floor 1,
Coi. Sania MariaTepepan village. Xochimílco, CP 16020.
Mexico City
Tel (55) 53 34 07 00 wwwlmpi.gob ηιχ
<img file="MX337772B_D0006.tif" />
MX / 2016/22381
<img file="MX337772B_D0007.tif" />
a¿> / y5yzsASIGNACION
OF BITS, CODING AND DECODING OF AUDIO
Field of the Invention apparatus, devices
IMPIOS
INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL articles consistent with this description are
Audio encoding and decoding, v of
The manufactures refer in a more particular way, they refer to a method and apparatus for the distribution or allocation, efficiently, of the bits to a perceptually important frequency area depending on the subbands, they also refer to a method and audio encoding apparatus, an audio decoding method and apparatus, a recording medium, and a multimedia device employing the same.
Background of the Invention
When an audio signal is encoded or decoded, you are required to efficiently use a limited number of bits to restore the audio signal that has the best sound quality in a range of the limited number of bits. In particular, at a low speed
<td>bit is</td><td colspan="2">required</td><td>a coding technique and</td>
<td>decoding</td><td>of</td><td>a</td><td>audio signal to distribute</td>
<td>evenly</td><td>the</td><td>bits</td><td>to the spectral components</td>
perceptually important rather than concentrating the bits in a specific frequency area.
In particular, at a low bit rate, when
Ref: 256547
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX337772B_D0008.tif" />
the coding is carried out with the bits assigned to each frequency band, such as a sub-band, a spectral hole could be generated due to a frequency component, which is not coded due to the insufficient number of bits, with which, it is causes a decrease in sound quality.
Brief Description of the Invention
Technical problem
One aspect is the provision of a method and apparatus for efficiently allocating bits to a perceptually important frequency area based on subbands, an audio encoding method and apparatus, a method and apparatus of audio decoding, a recording medium and a multimedia device used by them.
One aspect is the provision of a method and apparatus for efficiently allocating bits to a perceptually important frequency area with low complexity as a function of subbands, an audio encoding method and apparatus, a audio decoding method and apparatus, a recording medium and a multimedia device employing the same.
Solution to the problem
In accordance with one aspect of one or more [example modes] a bit allocation method is provided.
<img file="MX337772B_D0009.tif" />
<img file="MX337772B_D0010.tif" />
INSTITUTO MEXICANO DI LA PROPIEDAD INDUSTRIAL comprising: determining the assigned number of bits in decimal point units based on each frequency band, so that the Signal-to-Noise Ratio (SNR) of an existing spectrum in a predetermined band frequency is maximized within a range of the allowable number of bits for a given frame; and adjust the assigned number of bits according to each frequency band.
In accordance with another aspect of one or more [exemplary embodiments] a bit allocation apparatus is provided comprising: a transform unit that transforms an audio signal in the time domain for an audio spectrum in a frequency domain ; and a bit allocation unit that estimates the allowable number of bits in decimal point units using a masking threshold based on the frequency bands included in a given frame in the audio spectrum, furthermore, estimates the assigned number of bits in decimal point units using spectral energy, and adjusts the assigned number
<td>bit for</td><td>than</td><td>do not exceed</td><td colspan="3">the allowable number of</td><td>bits.</td><td></td>
<td>Of</td><td colspan="2">agree with</td><td colspan="2">other aspect</td><td colspan="2">one or</td><td>plus</td>
<td>[modalities</td><td>of</td><td>example]</td><td>I know</td><td>provides</td><td>a</td><td>apparatus</td><td>of</td>
<td>coding</td><td>of</td><td>Audio</td><td>than</td><td>understands:</td><td>a</td><td>Unit</td><td>of</td>
<td>transformed</td><td>than</td><td colspan="2">transform a</td><td colspan="2">audio signal on</td><td colspan="2">The Dominion</td>
<td colspan="2">of time to</td><td colspan="2">a spectrum</td><td>audio in</td><td>a</td><td>domain</td><td>of</td>
frequency; a bit allocation unit that determines the
IMPI
INSTITUTO MEXICANO DELA PROPIEDAD INDUSTRIAL assigned number of bits in units of decimal point in
<img file="MX337772B_D0011.tif" />
function of each frequency band, so that the Signal-to-Noise Ratio (SNR) of an existing spectrum in a predetermined frequency band is maximized within a range of the allowable number of bits for a frame given of the audio spectrum and adjusts the assigned number of bits determined according to each frequency band; and a coding unit that encodes the audio spectrum using the adjusted number of bits depending on each frequency band and the spectral energy.
<td>Of</td><td>agree with</td><td>other</td><td>appearance</td><td>of</td><td>one or</td><td>plus</td>
<td>[modalities</td><td>example],</td><td>I know</td><td>provides</td><td>a</td><td>apparatus</td><td>of</td>
<td colspan="2">audio decoding</td><td>than</td><td>understands:</td><td>a</td><td>Unit</td><td>of</td>
<td>transformed</td><td>what transforms</td><td>a</td><td colspan="4">audio signal in the domain</td>
of time for an audio spectrum in a frequency domain; a bit allocation unit that determines the assigned number of bits in decimal point units based on each frequency band, so that the Signal-to-Noise Ratio (SNR) of an existing spectrum in a predetermined frequency band it is maximized within a range of the permissible number of bits for a given frame of the audio spectrum and adjusts the assigned number of bits determined according to each frequency band; and an encoding unit that encodes the audio spectrum using the adjusted number of bits based on each
<img file="MX337772B_D0012.tif" />
frequency band and spectral energy.
<td>In accordance with</td><td>other</td><td>appearance</td><td>of</td><td>one or</td><td>plus</td>
<td>[example modalities],</td><td>I know</td><td>provides</td><td>a</td><td>apparatus</td><td>of</td>
<td>audio decoding</td><td>than</td><td>understands:</td><td>a</td><td>Unit</td><td>of</td>
Bit mapping that estimates the allowable number of bits in decimal point units using a masking threshold based on the frequency bands included in a given table, estimates the assigned number of bits in decimal point units using the spectral energy, and adjusts the assigned number of bits so that it does not exceed the allowable number of bits; a decoding unit that decodes an audio spectrum included in a bit stream using the adjusted number of bits depending on each frequency band and the spectral energy; and a reverse transform unit that transforms the decoded audio spectrum into an audio signal in the time domain.
Brief Description of the Figures
The foregoing and other aspects will be more apparent through the detailed description of the example modalities thereof with reference to the attached figures, in which:
Figure 1 is a block diagram of an audio coding apparatus according to an exemplary embodiment;
Figure 2 is a block diagram of a unit
<img file="MX337772B_D0013.tif" />
JL JL <J4_ JL JL MFXlCANO INDUSTRIAL PROPERTY INSTITUTE of bit allocation in the audio encoding apparatus of Figure 1, according to an example embodiment;
Figure 3 is a block diagram of a bit allocation unit in the audio coding apparatus of Figure 1, according to another example embodiment;
Figure 4 is a block diagram of a bit allocation unit in the audio encoding apparatus of Figure 1, according to another example embodiment;
Figure 5 is a block diagram of a coding unit in the audio coding apparatus of Figure 1, according to an example embodiment;
Figure 6 is a block diagram of an audio coding apparatus according to another exemplary embodiment;
Figure 7 is a block diagram of an audio decoding apparatus according to an example embodiment;
FIG. 8 is a block diagram of a bit allocation unit in the audio decoding apparatus of FIG. 7, in accordance with an exemplary embodiment;
Figure 9 is a block diagram of a decoding unit in the audio decoding apparatus of Figure 7, according to an example embodiment;
Figure 10 is a block diagram of a unit
VI ri
MEXICAN INSTITUTE - · - “- / 1
OF THE LRONEDAD
INDUSTRIAL decoding in the audio decoding apparatus of Figure 7, according to another example embodiment;
Figure 11 is a block diagram of a decoding unit in the audio decoding apparatus of Figure 7, according to another example embodiment;
Figure 12 is a block diagram of an audio decoding apparatus according to another example embodiment;
Figure 13 is a block diagram of an audio decoding apparatus according to another example embodiment;
Figure 14 is a flowchart illustrating a bit allocation method according to another example embodiment;
Figure 15 is a flow chart illustrating a bit allocation method according to another example embodiment;
Figure 16 is a flowchart illustrating a bit allocation method according to another example embodiment;
Figure 17 is a flowchart illustrating a bit allocation method according to another exemplary embodiment;
Figure 18 is a block diagram of a multimedia device that includes a coding module,
ΙΜΡΙ
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX337772B_D0014.tif" />
according to an example embodiment;
Figure 19 is a block diagram of a module a multimedia device including decoding, according to an example embodiment; and Figure 20 is a block diagram of a multimedia device including an encoding module and a decoding module, according to an example embodiment.
Detailed description of the invention
The present inventive concept could allow various types of changes or modifications and various changes in the form and the specific exemplary modalities will be illustrated in the figures and will be described in detail in the specification. However, it should be understood that the specific exemplary embodiments do not limit the present inventive concept to the specific form described but rather include each form modified, equivalent or replaced within the spirit and technical scope of the present inventive concept. In the following description, the well-known functions or constructions are not described in detail because they could obscure the invention in unnecessary detail.
Although terms such as 'first' and 'second' can be used to describe various elements, the elements cannot be limited by
IM r 1
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY terms. Terms can be used to classify a certain element from another element.
The terminology used in The application is only used to describe the specific example modalities and is not intended to limit the present inventive concept. Although the general terms that are currently used as widely as possible are selected as the terms used in the present inventive concept while taking into account the functions in the present inventive concept, they may vary according to the intention of those persons of ordinary experience in the art, judicial precedents, or the appearance of a new technology. In addition, in specific cases, terms intentionally selected by the applicant could be used, and in this case, the meaning of the terms will be described in the corresponding description of the invention. Consequently, the terms used in the present inventive concept do not have to be defined by the simple names of the terms but by the meaning of the terms and the content with respect to the present inventive concept.
A singular expression includes a plural expression unless they are clearly different from each other in context. In the application, it should be understood that terms such as 'include' and 'have' are used to indicate the
<img file="MX337772B_D0015.tif" />
<img file="MX337772B_D0016.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX337772B_D0017.tif" />
existence of a configuration, number, stage, operation, element, implemented part or a combination of them without excluding in advance the possibility of existence or addition of one or more of other configurations, numbers, stages, operations, elements, parts or combinations of they.
Hereinafter, the present inventive concept will be more fully described with reference to the accompanying figures, in which the example modalities are shown. The same reference numbers in the figures denote the same elements, and thus, their repetitive description will be omitted.
As used herein, expressions such as at least one of, when preceding an item list, modify the entire item list and do not modify the individual items in the list.
FIG. 1 is a block diagram of an audio encoding apparatus 100 in accordance with an exemplary embodiment.
The audio encoding apparatus 100 of the Figure could include a transform unit 130, a bit allocation unit 150, an encoding unit 170 and a multiplexing unit 190. The components of the audio encoding apparatus 100 could be integrated at least in one module and could be implemented by at least one processor (for example, a central processing unit
MEXICAN INSTITUTE OF LA rROPIEDAll
INDUSTRIAL
<img file="MX337772B_D0018.tif" />
(CPU)). Here, the audio could indicate an audio signal, a voice signal, or a signal obtained through its synthesis, although from now on, the audio indicates, in a way
<td>general a</td><td>signal</td><td>of</td><td>Audio</td><td>for the convenience of</td><td>the</td>
<td>description.</td><td></td><td></td><td></td><td></td><td></td>
<td colspan="3">With reference</td><td>to</td><td>Figure 1, the unit</td><td>of</td>
<td colspan="3">transformed 130 could</td><td>generate</td><td>an audio spectrum</td><td>to the</td>
<td>transform a</td><td>signal</td><td>of</td><td>audio in</td><td>time domain in</td><td>a</td>
<td>audio signal</td><td>in a</td><td colspan="2">domain of</td><td colspan="2">frequency. The transformed</td>
<td>domain of</td><td>weather</td><td>to</td><td>domain</td><td>frequency could</td><td>to be</td>
carried out using several well-known methods, such as the Discrete Cosine Transform (DCT).
Bit allocation unit 150 could determine a masking threshold that is obtained using the spectral energy or a psycho-acoustic model with respect to the audio spectrum and the number of bits assigned depending on each sub-band using the spectral energy. Here, a subband is a sample grouping unit of the audio spectrum and could have a uniform or non-uniform length when reflecting a threshold band. When the subbands have non-uniform lengths, the subbands could be determined, so that the number of samples from a starting sample to a last sample included in each subband is generally increased by
<img file="MX337772B_D0019.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX337772B_D0020.tif" />
picture. Here, the number of sub-bands or the number of samples included in each sub-box could be previously determined. Alternately, once a frame is divided into a predetermined number of subbands that have a uniform length, the uniform length could be adjusted according to a distribution of the spectral coefficients. The assignment of the spectral coefficients could be determined using the spectral flatness measurement, the difference between a maximum value and the minimum value, or the differential value of the maximum value.
According to an example embodiment, the bit allocation unit 150 could estimate a permissible number of bits using a Norm value obtained as a function of each subband, that is, the average spectral energy, it could also assign the bits in based on the average spectral energy, and could limit the assigned number of bits so as not to exceed the allowable number of bits.
According to an example embodiment, the bit allocation unit 150 could estimate a permissible number of bits using a psycho-acoustic model based on each subband, it could also assign the bits based on the average spectral energy, and You could limit the assigned number of bits so as not to exceed the allowable number of bits.
Coding unit 170 could generate the
<img file="MX337772B_D0021.tif" />
OF INDUSTRIAL PROPERTY
<img file="MX337772B_D0022.tif" />
information regarding an encoded spectrum by quantizing and losslessly encoding the audio spectrum as a function of the assigned number of bits finally determined as a function of each subband.
Multiplexing unit 190 generates a bit stream by multiplexing the Standard encoded value provided from the bit allocation unit 150 and the information regarding the encoded spectrum that is provided from the encoding unit 170.
The Audio Coding Apparatus
100 it could generate a noise level for an optional subband and it could provide the noise level to an audio decoding apparatus (700 in Figure 7, 1200 in Figure 12, or 1300 in Figure 13).
FIG. 2 is a block diagram of a bit allocation unit 200 corresponding to the bit allocation unit 150 in the audio encoding apparatus.
100 of Figure 1, according to an example embodiment.
The bit allocation unit 200 of Figure 2 could include a Standard 210 estimator, a
Standard 230 and a estimator and bitmapper 250. The components of the bitmapper unit 200 could be integrated into at least one module and could be implemented by at least one processor.
With reference to Figure 2, the Norma estimator
<img file="MX337772B_D0023.tif" />
MEXICAN INSTITUTE D £ THE PROPERTY
INDUSTRIAL
<img file="MX337772B_D0024.tif" />
210 could obtain a value of Norm that average spectral energy based on example, the value of Norm could be Equation 1 applied in ITU-T G.719 although the same.
corresponds to the each subband. By calculated by is not limited by [Equation 1]
<img file="MX337772B_D0025.tif" />
, pl
In Equation 1, when the P subbands or subsectors exist in a table, N (p) denotes a Norma value of one p-nth subband or sub-sector, L<sub>p</sub> denotes the length of the p-nth subband or sub-sector, that is, the number of samples or spectral coefficients, s<sub>p</sub> ye<sub>p</sub> denote a starting sample and a last sample of the p-nth subband, respectively, and y (k) denotes the sample size or the spectral coefficient (i.e., energy).
The Norm value obtained as a function of each subband could be provided to the coding unit (170 in Figure 1).
The Norma 230 encoder could losslessly quantize and encode the obtained Norma value based on each subband. The norm value quantified according to each sub-band or the norm value that is obtained by quantifying the norm quantized value
IMP
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX337772B_D0026.tif" />
could be provided to the estimator and you assigned * —4e — bit or »· The loss-quantized and encoded Standard value as a function of each subband could be provided to the multiplexing unit (190 in Figure 1).
Bit estimator and allocator 250 could estimate and distribute a required number of bits using the Standard value. Preferably, the dequantized value of Norma could be used, so that an encoding part and a decoding part can use the same estimation and bit distribution process. In this case, an adjusted Standard value could be used to take into account the masking effect. For example, the Norm value could be adjusted using the psycho-acoustic weighting applied in ITU-T G.719 as in Equation 2 although I do not know how to limit it.
[Equation 2]
I n (p) <sup>=</sup> I n (p) <sup>+</sup> WSpe (p ~)
In Equation 2,
Cp) denotes an index of a quantized norm value of the p-nth subband,
I l (p ~) denotes an index of an adjusted norm value of the
<img file="MX337772B_D0027.tif" />
D £ INDUSTRIAL PROPERTY
<img file="MX337772B_D0028.tif" />
p-nth subband, and
WSpe (p) denotes a spectrum of change for the Norma value adjustment.
Bit estimator and allocator 250 could calculate a masking threshold using the Norm value as a function of each subband and could estimate a perceptually required number of bits using the masking threshold. To do this, the Norm value obtained as a function of each subband could also be represented as the spectral energy in units of dB as shown in Equation 3.
[Equation 3]
<img file="MX337772B_D0029.tif" />
As a method of obtaining the masking threshold using spectral energy, several well known methods could be used. That is, the masking threshold is a value that corresponds to the Fair Perceptible Distortion (JND), and when a quantization noise is less than the masking threshold, perceptual noise cannot be perceived. In this way, a minimum number of bits required to not perceive the current Persian noise could be calculated.
JL JLtfjL /: - ·? > · Ϊ 'Tvi
'κ. <·. > —Λ J · 'Jjr
MEXICAN INSTITUTE OF MDUSTRIAL PROPERTY using the masking threshold. For example, the
Signal-to-Masking Ratio (SMR) could be calculated using the ratio of the Standard value to the masking threshold as a function of each subband, and the number of bits that satisfy the masking threshold could be estimated using the ratio of 6.025 dB = 1 bit with respect to the calculated SMR. Although the estimated number of bits is the minimum number of bits required to not perceive perceptual noise, because there is no need to use more than the estimated number of bits in terms of compression, the estimated number of bits could be considered as a number maximum allowable bits based on each subband (hereafter, the allowable number of bits). The allowable number of bits for each subband could be represented in decimal point units.
Bit estimator and allocator 250 could perform the bit allocation in decimal point units using the Norm value based on each subband. In this case, the bits are sequentially allocated from a subband that has a larger Standard value than the others, and it could be adjusted that more bits are assigned to a perceptually important subband by weighting according to the importance of perception of each sub-band with respect to the norm value as a function of each sub-band. The
<img file="MX337772B_D0030.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX337772B_D0031.tif" />
importance of perception could be determined, for example, through psycho-acoustic weighting as in
ITU-T G.719.
Bit estimator and allocator 250 could sequentially allocate bits to samples in a subband that has a larger Standard value than the others. In other words, first, the bits per sample are assigned for a subband that has the maximum value of Norma, and the priority of the subband that has the maximum value of Norma is changed by decreasing the value of Norma of the subband in predetermined units, so that the bits are assigned to another subband. This process is performed, repeatedly, until the total number B of the allowable bits in the given frame is clearly assigned.
The estimator and bit allocator 250 could finally determine the assigned number of bits by limiting the assigned number of bits so as not to exceed the estimated number of bits, that is, the allowable number of bits, for each subband. For all subbands, the assigned number of bits is compared to the estimated number of bits, and if the assigned number of bits is greater than the estimated number of bits, the assigned number of bits is limited to the estimated number of bits . If the assigned number of bits of all subbands in the given box, which is obtained as a result
ΙΜ
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL bit number limitation, mpnnr gnp is the total number B of the allowable bits in the given box, the number of bits corresponding to the difference could be uniformly assigned to all sub-bands or not uniformly assigned according with the importance of perception.
Because the number of bits assigned to each subband can be determined in decimal point units and is limited to the allowable number of bits, the total number of bits in a given frame could be allocated efficiently.
According to an example embodiment, the detailed method of estimating and distributing the number of bits required for each subband is as follows. According to this method, because the number of bits assigned to each subband can be determined on one occasion without multiple repetition times, the complexity could be decreased.
For example, a solution, which could optimize the quantization distortion and the number of bits assigned to each subband, could be obtained by applying the LaGrange function represented by Equation 4.
[Equation 4]
L = D + λ (Σ NtLi, - B)
In Equation 4, L denotes the LaGrange function, D
<img file="MX337772B_D0032.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX337772B_D0033.tif" />
denotes the quantization distortion, B denotes the total number of allowable bits in the given frame, N<sub>b</sub> denotes the number of samples in a b-nth subband, and L<sub>b</sub> denotes the number of bits assigned to the b-nth subband. I mean, N<sub>b</sub>L<sub>b</sub> denotes the number of bits assigned to the b-nth subband.
λ denotes the LaGrange multiplier which is an optimization coefficient.
Using Equation 4, L<sub>b</sub> which minimizes the difference between the total number of bits assigned to the subbands included in the given frame and the allowable number of bits for the given frame could be determined while considering the quantization distortion.
The quantization distortion D could be defined by Equation 5.
[Equation 5]
DV "<sup>1</sup> 2
2aXj i
In Equation 5
<img file="MX337772B_D0034.tif" />
denotes an input spectrum, and
<img file="MX337772B_D0035.tif" />
a decoded spectrum.
I mean, the
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX337772B_D0036.tif" />
D quantization distortion could be defined as a Half Square Error (MSE) with respect to the input spectrum and the encoding spectrum ¿V and arbitrary ouadro.
<td>The denominator</td><td>in</td><td>The equation</td><td> 5</td><td>is a</td><td colspan="2">value</td>
<td>constant determined by</td><td>a</td><td>given spectrum</td><td>of</td><td>entry,</td><td>and</td><td>in</td>
<td>consequence, because</td><td>the</td><td>denominator in</td><td>the</td><td>Equation</td><td> 5</td><td>not</td>
affects optimization, Equation 7 could be · simplified by Equation 6.
[Equation 6]
L - Σ (v * / <sup>+ λ</sup> (Σλ ^ -, Β) i
A value of Norma,
8b which is the average spectral energy of the b-nth subband with respect to the input spectrum, r * b could be defined by Equation 7, a Norm value quantified by a logarithmic scale could be defined by Equation 8, and a dequantized value of
Rule
<img file="MX337772B_D0037.tif" />
<img file="MX337772B_D0038.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX337772B_D0039.tif" />
Sb could be defined by Equation 9. [Equation 7]
Sb -
<img file="MX337772B_D0040.tif" />
<sup>i = s</sup>b
N<sub>b</sub> [Equation 8] n<sub>b</sub> - L 2log<sub>2</sub> g<sub>b</sub> + 0.5 J [Equation 9]
0.5«,
Sb
In Equation 7, s<sub>b</sub> ye<sub>b</sub> denote a start sample and a last sample of the b-nth sub-band, respectively.
A normalized spectrum and is generated by dividing the input spectrum by the dequantized value of Norma
Sb as in Equation 10, and a decoded spectrum is generated by multiplying a restored normalized spectrum yi by the dequantized value of Norma
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX337772B_D0041.tif" />
Sb as in Equation 11, [Equation 11]
X<sub>?</sub>yi -:
'V
Sb '' V '' V.
¡- yi gb '
The term quantization distortion could be placed by Equation 12 using equations 9 to 11.
[Equation 12]
Σ (ν -η)<sup>2</sup> = Eg ¿Σ (ll)<sup>2</sup> = Σ 2 '(y¡- y¡)<sup>2</sup> ib iEb b
In common form, from the relation between the quantization distortion and the assigned number of bits, it is defined that the Signal-to-Noise Ratio (SNR) increases by 6.02 dB each time 1 bit per sample is added, and by using this, the quantization distortion of the normalized spectrum could be defined by Equation 13.
[Equation 13)
V<sup>1</sup> x 2 iEb iEb <sub>= 2</sub>-2I,
Σ, λ<sup>2</sup> V / V (yrJ /) 2L (y¿- y,)
Σ /
N,
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX337772B_D0042.tif" />
In the case of the current audio encoding, Equation 14 could be defined by applying a dB C scale value, which could vary according to the signal characteristics, without setting the ratio of 1 bit / sample = 6.025 dB.
[Equation 14]
Cl,
Vr Cvr and¡)<sup>2</sup> = 2 'N, iEb
In Equation 14, when C is 2.1 bit / sample corresponds to 6.02 dB, and when C is 3.1 bit / sample corresponds to 9.03 dB.
In this way, the Equation could be represented by Equation 15 of Equations 12 and 14. [Equation 15]
L = Σ 2<sup>M</sup>‘ 2<sup>CL></sup> N<sub>b</sub>+ λ (Σ Nt¡L<sub>b</sub> - B) bb
To get L<sub>b</sub> and Λ optimal from Equation 15, a partial differential is made for L<sub>b</sub> and Λ as in
Equation 16.
[Equation 16]
L », -ci<sub>b</sub> «= -C2 'Λ \ 1η2 + λΜ, = 0 dL
<img file="MX337772B_D0043.tif" />
- | γ = ΣλΓ ^ -Β = Ο
When Equation 16 is placed, L<sub>b</sub> could be represented by Equation 17.
[Equation 17]
L<sub>b</sub> = b Σ N<sub>b</sub>n<sub>b</sub>-CB \
ΣΊξ b
Using Equation 17, the assigned number of bits L<sub>b </sub>per sample of each subband, which could maximize the SNR of the input spectrum, could be estimated in an interval of the total number B of the permissible bits in the given table.
The assigned number of bits as a function of each subband, which is determined by the estimator and bit allocator 250, could be provided to the encoding unit (170 in Figure 1).
FIG. 3 is a block diagram of a bit allocation unit 300 corresponding to the bit allocation unit 150 in the audio encoding apparatus 100 of FIG. 1, in accordance with another exemplary embodiment.
The bit allocation unit 300 in Figure 3 could include a psycho-acoustic model 310, a bit estimator and 330 allocator, a scale factor 350 estimator and the Mexican institute Oí LA l'ROPIEDA »
INDUSTRIAL
<img file="MX337772B_D0044.tif" />
a scale factor encoder 370. The components of the bit allocation unit 300 could be integrated into at least one module and could be implemented by at least one processor.
Referring to Figure 3, the psychoacoustic model 310 could obtain a masking threshold for each subband by receiving an audio spectrum from the transform unit (130 in Figure 1).
Bit estimator and allocator 330 could estimate a perceptually required number of bits using a masking threshold as a function of each subband. That is, the SMR could be calculated based on each subband, and the number of bits that satisfy the masking threshold could be estimated using the ratio of 6.025 dB = 1 bit with respect to the calculated SMR. Although the estimated number of bits is the minimum number of bits required to not perceive perceptual noise, because there is no need to use more than the estimated number of bits in terms of compression, the estimated number of bits could be considered as the number maximum allowable bits based on each subband (hereafter, the allowable number of bits). The allowable number of bits for each subband could be represented in decimal point units.
The estimator and bitmapper 330 could perform
<img file="MX337772B_D0045.tif" />
The MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY allocates bits in decimal point units using spectral energy depending on each subband. In this case, for example, the bit allocation method using Equations 7 to 20 could be used.
The estimator and bitmapper 330 compares the assigned number of bits with the estimated number of bits for all subbands, if the assigned number of bits is greater than the estimated number of bits, the assigned number of bits is limited to estimated number of bits. If the assigned number of bits of all subbands in a given frame, which is obtained as a result of the number of bits limitation, is less than the total number B of the permissible bits in the given frame, the number of bits corresponding to the difference could be uniformly assigned to all subbands or non-uniformly assigned according to importance of perception.
The scale factor estimator 350 could estimate a scale factor using the finally determined assigned number of bits based on each subband. The scale factor estimated as a function of each subband could be given to the coding unit (170 in Figure
Quantizing scale factor encoder 370 and losslessly encoding the estimated scale factor depending on each subband. The scale factor
<img file="MX337772B_D0046.tif" />
MEXICAN INSTITUTE ΠΕ PROPERTY coded according to each subband could be provided to the multiplexing unit (190 in Figure 1).
FIG. 4 is a block diagram of a bit allocation unit 400 corresponding to the bit allocation unit 150 in the audio encoding apparatus 100 of FIG. 1, in accordance with another exemplary embodiment.
The bit allocation unit 400 in Figure 4 could include a Standard 410 estimator, a 430 bit estimator and allocator, a 450 scale factor estimator, and a 470 scale factor encoder. The allocation unit components Bit 400 could be integrated into at least one module and could be implemented by at least one processor.
Referring to Figure 4, the Norma 410 estimator could obtain the Norma value that corresponds to the average spectral energy as a function of each subband.
The estimator and bit allocator 430 could obtain a masking threshold using the spectral energy as a function of each subband and could estimate the perceptually required number of bits, i.e. the allowable number of bits, using the masking threshold.
Bit estimator and allocator 430 could perform bit allocation in decimal point units using spectral energy as a function of each subband. In this case, for example, the method of
<img file="MX337772B_D0047.tif" />
MEXICAN INSTITUTE. I heard THE PROPERTY
INDUSTRIAL
<img file="MX337772B_D0048.tif" />
bit allocation using Equations 7 to 20.
The estimator and bitmapper 430 compares the assigned number of bits with the estimated number of bits for all subbands, if the assigned number of bits is greater than the estimated number of bits, the assigned number of bits is limited to estimated number of bits. If the assigned number of bits of all subbands in a given frame, which is ^ obtained as a result of the number of bits limitation, is less than the total number B of the allowable bits in the given frame, the number of bits corresponding to the difference could be uniformly assigned to all subbands or not uniformly assigned according to importance of perception.
The scale factor estimator 450 could estimate a scale factor using the finally determined assigned number of bits based on each subband. The scale factor estimated as a function of each subband could be given to the coding unit (170 in Figure
1) ·
The scale factor encoder 470 could losslessly quantify and encode the estimated scale factor based on each subband. The scale factor coded as a function of each subband could be provided to the multiplexing unit (190 in Figure 1).
Figure 5 is a block diagram of a unit
IMPI
MEXICAN INSTITUTE OF AN INDUSTRIAL PROPERTY encoding 500 corresponding to encoding unit 170 in audio encoding apparatus 100 of Figure 1, according to an example embodiment.
The encoding unit 500 of Figure 5 could include a spectrum normalization unit 510 and a spectrum encoder 530. The components of the encoding unit 500 could be integrated into at least one module and could be implemented by at least one processor. .
Referring to Figure 5, the spectrum normalization unit 510 could normalize a spectrum using the Standard value provided from the bit allocation unit (150 of Figure 1).
Spectrum encoder 530 could quantize the normalized spectrum using the assigned number of bits in each subband and could losslessly encode the quantization result. For example, factor pulse encoding could be used for spectrum encoding but is not limited to it. According to the factorial pulse encoding, the information, such as the pulse position, the pulse magnitude, and the pulse sign, could be represented in a factorial way within a range of the assigned number of bits.
Information regarding the spectrum encoded by the spectrum encoder 530 could be provided to the multiplexing unit (190 in Figure 1).
<img file="MX337772B_D0049.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX337772B_D0050.tif" />
FIG. 6 is a block diagram of an audio encoding apparatus 600 in accordance with another embodiment of example.
The audio encoding apparatus 600 of FIG. 6 could include a transient detection unit 610, a transform unit 630, a bit allocation unit 650, an encoding unit 670, and a multiplex unit 690. The components of the Audio coding apparatus 600 could be integrated into at least one module and could be implemented by at least one processor. Because there is a difference in that the audio encoding apparatus 600 of FIG. 6 further includes the transient detection unit 610 when the audio encoding apparatus 600 of FIG. 6 is compared to the audio encoding apparatus 100 From Figure 1, the detailed description of the common components is omitted herein.
Referring to Figure 6, the transient detection unit 610 could detect an interval indicating a transient characteristic by analyzing an audio signal. Several well known methods could be used for the detection of a transient interval. The transient signaling information provided from the transient detection unit 610 could be included in a bit stream through the transient unit.
<img file="MX337772B_D0051.tif" />
MEXICAN INSTITUTE D £ THE PROPERTY
INDUSTRIAL
<img file="MX337772B_D0052.tif" />
multiplexing 690.
The transform unit 630 could determine the window size used for the transform according to the result of the detection of the transient interval and could perform the transformation from time domain to frequency domain depending on the determined window size. For example, a short window could be applied to a subband from which a transient interval is detected, and a long window could be applied to a subband from which a transient interval is not detected. .
Bit allocation unit 650 could be implemented by one of the bit allocation units 200, 300, and 400 of Figures 2, 3, and 4, respectively.
The encoding unit 670 could determine the window size used for encoding according to the result of the detection of the transient interval.
Audio encoding apparatus 600 could generate a noise level for an optional subband and could provide the noise level to an audio decoding apparatus (700 in Figure 7, 1200 of
Figure 12, or 1300 of Figure 13).
FIG. 7 is a block diagram of an audio decoding apparatus 700 according to one embodiment, / Ι
Λ.
INST1TUTO MFX1CANO <sup>U i</sup> DELAPaO ^ DAD lixDUw * EVIL
<img file="MX337772B_D0053.tif" />
example. _
The audio decoding apparatus 7 00 of FIG. 7 could include a demultiplexing unit 710, a bit allocation unit 7 30, a decoding unit 750 and a reverse transform unit 770. The components of the audio decoding apparatus they could be integrated into at least one module and could be implemented by at least one processor.
Referring to Figure 7, the demultiplexing unit 710 could demultiplex a bitstream to extract a lossless encoded and quantized Standard value and information regarding an encoded spectrum.
The bit allocation unit 730 could obtain a dequantized value of Norma from the quantized and lossless encoded value of Norm as a function of each subband and could determine the assigned number of bits using the dequantized value of Norma. Bit allocation unit 730 could operate substantially the same as bit allocation unit 150 or 650 of audio encoding apparatus 100 or 600. When the Norma value is adjusted by the psycho-acoustic weighting on the audio encoding apparatus 100 or 600, the dequantized value of Norma could be adjusted by the audio decoding apparatus 700 in the same way.
i mr a
MEXICAN INSTITUTE \
OF PROPERTY (V ¿gf
INDUSTRIAL Xfc,> C * and 750 decoding could
The lossless dequantize and decode the encoded spectrum using the information regarding the encoded spectrum provided from the demultiplexing unit 710. For example, pulse decoding could be used for spectrum decoding.
The reverse transform unit 770 could generate a restored audio signal by transforming the encoding spectrum in the time domain.
FIG. 8 is a block diagram of a bit allocation unit 800 in the audio decoding apparatus 7 00 of FIG. 7, in accordance with an exemplary embodiment.
The bit allocation unit 800 of Figure 8 could include a Standard 810 decoder and an estimator and
<td>allocator</td><td>of</td><td>bits</td><td>830. The</td><td>components of</td><td>unit</td><td>of</td>
<td>assignment</td><td>of</td><td>bits</td><td>800 could</td><td>be integrated</td><td>at least in</td><td>a</td>
<td>module and</td><td colspan="2">could</td><td colspan="2">be implemented by</td><td>less for</td><td>a</td>
<td>processor</td><td> •</td><td></td><td></td><td></td><td></td><td></td>
<td colspan="2">With</td><td colspan="2">reference to</td><td colspan="2">Figure 8, the decoder</td><td>of</td>
Norma 810 could obtain a dequantized value of Norma from the lossless quantized and encoded value of Norma that is provided from the demultiplexing unit (710 of Figure 7).
<img file="MX337772B_D0054.tif" />
MEXICAN INSTITUTE Dt THE PROPERTY
INDUSTRIAL
<img file="MX337772B_D0055.tif" />
The estimator and bit allocator 830 could determine the assigned number of bits using the dequantized value of Norma. In detail, the estimator and bit allocator 830 could obtain a masking threshold using the spectral energy, that is, the value of Norm, as a function of each subband and could estimate the perceptually required number of bits, that is, the allowable number of bits, using the masking threshold.
The estimator and bit allocator 830 could perform the bit allocation in decimal point units using the spectral energy, ie, the value of Norm, depending on each subband. In this case it could be used, for
<td>example the</td><td>method of</td><td>assignment</td><td>of</td><td>bits</td><td>using</td><td>the</td>
<td>Equations 7</td><td>to 20.</td><td></td><td></td><td></td><td></td><td></td>
<td>The</td><td>estimator and</td><td>allocator</td><td>of</td><td>bits</td><td>830 compare</td><td>the</td>
<td colspan="2">assigned number of bits</td><td colspan="2">with the number</td><td colspan="3">bit estimate for</td>
all subbands, if the assigned number of bits is greater than the estimated number of bits, the assigned number of bits is limited to the estimated number of bits. If the assigned number of bits of all subbands in a given frame, which is obtained as a result of the number of bits limitation, is less than the total number B of the permissible bits in the given frame, the number of bits corresponding to the difference could be uniformly assigned to all sub36
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX337772B_D0056.tif" />
banded or not uniformly assigned according to importance of perception.
FIG. 9 is a block diagram of a decoding unit 900 corresponding to the decoding unit 750 in the audio decoding apparatus 700 of FIG. 7, in accordance with an exemplary embodiment.
The decoding unit 900 of Figure 9 could include a spectrum decoder 910 and an envelope shaping unit 930. The components of the decoding unit 900 could be integrated into at least one module and could be implemented by at least one processor. .
Referring to Figure 9, the spectrum decoder 910 could losslessly quantize and decode the encoded spectrum using the information regarding the encoded spectrum provided from the demultiplexing unit (710 of Figure 7) and the assigned number of bits provided from the bit allocation unit (730 in Figure 7). The encoding spectrum of spectrum decoder 910 is a standard spectrum.
Envelope shaping unit 930 could restore a spectrum before normalization by performing envelope shaping on the normalized spectrum provided from spectrum decoder 910 using the dequantized value of Standard provided at
<img file="MX337772B_D0057.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX337772B_D0058.tif" />
from the bit allocation unit (730 in Figure
7) .
FIG. 10 is a block diagram of a decoding unit 1000 corresponding to the decoding unit 750 in the audio decoding apparatus 700 of FIG. 7, in accordance with an exemplary embodiment.
The decoding unit 1000 of Figure 9 could include a spectrum decoder 1010, an envelope shaping unit 1030, and a spectrum filling unit 1050. The components of the decoding unit 1000 could be integrated into at least one module and They could be implemented by at least one processor.
Referring to Figure 10, the spectrum decoder 1010 could losslessly quantize and decode the encoded spectrum using the information regarding the encoded spectrum provided from the demultiplexing unit (710 of Figure 7) and the assigned number of bits provided from the bit allocation unit (730 in Figure 7). The encoding spectrum of spectrum decoder 1010 is a standard spectrum.
Envelope shaping unit 1030 could restore a spectrum before normalization by performing envelope shaping on the normalized spectrum provided from spectrum decoder 1010 using the dequantized value of Standard provided at
IMP! Íí3>
INSTITUTO MSUCANO VT'íí DE LA! -SO?! £ OAD V
INDUSTRIAL from the bit allocation unit (730 in Figure
7) .
When there is a subband, which includes a dequantized part at 0, in the spectrum provided from the envelope forming unit 1030, the spectrum filling unit 1050 could fill a noise component in the dequantized part at 0 in the subband. According to an example embodiment, the noise component could be generated randomly or could be generated by copying a spectrum from a dequantized subband to a value other than 0, which is adjacent to the subband that includes the part dequantized at 0, or a spectrum of a dequantized subband at a value other than 0. According to another example embodiment, the energy of the noise component could be adjusted by generating a noise component for the subband that includes the dequantized part at 0 and using the energy ratio of the noise component with the dequantized value of Standard provided from the bit allocation unit (730 in Figure 7), that is, the spectral energy. According to another example embodiment, a noise component could be generated for the subband that includes the dequantized part at 0, and the average energy of the noise component could be adjusted to be 1.
Figure 11 is a block diagram of a 'virio?
MEXICAN INSTITUTE
OF INDUSTRIAL PROPERTY
<img file="MX337772B_D0059.tif" />
decoding device 1100 corresponding to the decoding unit 750 in the audio decoding apparatus 700 of FIG. 7, according to another exemplary embodiment.
The decoding unit 1100 of Figure 11 could include a spectrum decoder 1110, a spectrum filling unit 1130, and an envelope shaping unit 1150. The components of the decoding unit 1100 could be integrated into at least one module could be implemented by at least one processor. Because there is a difference that an arrangement of the spectrum filling unit 1130 and the envelope shaping unit 1150 is different when the decoding unit 1100 of Figure 11 is compared to the decoding unit 1000 of Figure 10, the detailed description of the common components is omitted herein.
Referring to Figure 11, when there is a subband, which includes a dequantized part at 0, in the normalized spectrum provided from the spectrum decoder 1110, the spectrum filling unit 1130 could fill a noise component in the part dequantized at 0 in the subband. In this case, various noise fill methods applied to the 1050 spectrum fill unit of Figure 10 could be used. Preferably, for the subband that includes the part
IMPI
MEXICAN INSTITUTE
OF THE PROPERTY
INDUSTRIAL _ dequantized at 0, the noise component could be generated, and the average energy of the noise component could be adjusted to be 1.
The envelope shaping unit 1150 could restore a spectrum before normalization for the spectrum that includes the subband in which the noise component is filled using the dequantized value of Norma provided from the bit allocation unit ( 730 of Figure 7).
FIG. 12 is a block diagram of an audio decoding apparatus 1200 according to another example embodiment.
The audio decoding apparatus 1200 of FIG. 12 could include a demultiplexing unit 1210, a scale factor decoder 1230, a spectrum decoder 1250, and a reverse transform unit 1270. The components of the audio decoding apparatus 1200 could be integrated into at least one module and could be implemented by at least one processor.
Referring to Figure 12, demultiplexing unit 1210 could demultiplex a bitstream to extract a lossless encoded and quantized scale factor and information regarding an encoded spectrum.
The 1230 scale factor decoder could
1M
PI
MEXICAN INSTITUTE
OF O, FKOPIEOAD INDUSTRIAL
<img file="MX337772B_D0060.tif" />
dequantize quantized and band.
and decode without lossless scale factor encoding ” <sup>1</sup> '«« «N un, - - .h-η, * -τζκ ·» · loss depending on each subE1 spectrum decoder 1250 could losslessly quantize and decode the encoded spectrum using the information regarding the encoded spectrum and the factor scale dequantization provided from demultiplexing unit 1210. Spectrum decoding unit 1250 could include the same components as decoding unit 1000 of Figure 10.
The reverse transform unit 1270 could generate a restored audio signal by transforming the spectrum decoded by the spectrum decoder 1250 in the time domain.
FIG. 13 is a block diagram of an audio decoding apparatus 1300 according to another example embodiment.
The audio decoding apparatus 1300 of Figure 13 could include a demultiplexing unit 1310, a bit allocation unit 1330, a decoding unit 1350, and a reverse transform unit 1370. Components of the audio decoding apparatus 1300 could be integrated into at least one module and could be implemented by at least one processor.
<img file="MX337772B_D0061.tif" />
Because there is a difference in that the transient signaling information is provided to the decoding unit 1350 and the reverse transform unit 1370 when the audio decoding apparatus 1300 of Figure 13 is compared to the decoding apparatus of Audio 700 of Figure 7, the detailed description of the common components is omitted herein.
Referring to Figure 13, the decoding unit 1350 could decode a spectrum using the information regarding an encoded spectrum provided from the demultiplexing unit 1310. In this case, the window size could vary according to the information of the transitory signaling.
The reverse transform unit 1370 could generate a restored audio signal by transforming the encoded spectrum in the time domain. In this case, the window size could vary according to the information of the transient signaling.
Figure 14 is a flowchart illustrating a bit allocation method according to another example embodiment.
Referring to Figure 14, in step 1410, the spectral energy of each subband is acquired. The spectral energy could be of a Norm value.
IMPI
<img file="MX337772B_D0062.tif" />
In step 1420, a masking threshold is acquired using the spectral energy as a function of each subband.
In step 1430, the allowable number of bits is estimated in decimal point units using the masking threshold as a function of each subband.
In step 1440, the bits are allocated in decimal point units based on the spectral energy based on each subband.
In step 1450, the allowable number of bits is compared to the assigned number of bits based on each subband.
In step 1460, if the assigned number of bits is greater than the allowable number of bits for a given subband as a result of the comparison in step 1450, the assigned number of bits is limited to the allowable number of bits.
In step 1470, if the assigned number of bits is greater than or equal to the allowable number of bits for a given subband as a result of the comparison in step 1450, the assigned number of bits is used as is, or the final assigned number of bits is determined for each subband using the allowable number of bits limited in step 1460.
Although not shown, if the sum of the numbers
IMPI
<img file="MX337772B_D0063.tif" />
allocated bits determined in operation 1470 for all subbands in a given frame is less than or greater than the total number of allowable bits in the given frame, the number of bits corresponding to the difference could be
<td>uniformly assigned</td><td>to</td><td>all</td><td>the</td><td>sub-bands or</td><td>not</td>
<td>uniformly assigned</td><td>of</td><td>agreement</td><td>with</td><td>The importance</td><td>of</td>
<td>perception.</td><td></td><td></td><td></td><td></td><td></td>
<td>Figure 15 is</td><td>a</td><td>diagram</td><td>of</td><td>illustrating flow</td><td>a</td>
bit allocation method according to another example embodiment.
Referring to Figure 15, at step 1500, a dequantized value of Standard for each subband is acquired.
In step 1510, a masking threshold is acquired using the dequantized value of Norma as a function of each subband.
In step 1520, an SMR is acquired using the masking threshold as a function of each subband.
In step 1530, the allowable number of bits is estimated in decimal point units when using the SMR based on each subband.
In step 1540, the bits are assigned in decimal point units based on the spectral energy (or the standard dequantized value) based on each sub45 band.
<img file="MX337772B_D0064.tif" />
MEXICAN INSTITUTE CE PROPERTY
INDUSTRIAL
<img file="MX337772B_D0065.tif" />
In step 1550, the allowable number of bits is compared to the assigned number of bits based on each subband.
In step 1560, if the assigned number of bits is greater than the allowable number of bits for a given subband as a result of the comparison in step 1550, the assigned number of bits is limited to the allowable number of bits.
In step 1570, if the assigned number of bits is greater than or equal to the allowable number of bits for a given subband as a result of the comparison in step 1550, the assigned number of bits is used as is, or the final assigned number of bits is determined for each subband using the allowable number of bits limited in step 1560.
Although not shown, if the sum of the assigned number of bits determined in step 1570 for all subbands in a given frame is less than or greater than the total number of allowable bits in the given frame, the number
<td>of bits that</td><td>corresponds</td><td>with the</td><td colspan="2">difference could</td><td>to be</td>
<td>evenly</td><td>Assigned to</td><td>all</td><td>the</td><td>sub-bands or</td><td>not</td>
<td>evenly</td><td>assigned from</td><td>agreement</td><td>with</td><td>The importance</td><td>of</td>
perception.
Figure 16 is a flow chart illustrating a
IMPI
<img file="MX337772B_D0066.tif" />
bit allocation method according to another embodiment example.
Referring to Figure 16, in step 1610 initialization is performed. As an example of initialization, when the assigned number of bits for each subband is estimated using Equation 20, the total complexity could be reduced by calculating a constant value
<img file="MX337772B_D0067.tif" />
for all sub-bands.
In step 1620, the assigned number of bits for each subband is estimated in decimal point units using Equation 17. The assigned number of bits for each subband could be obtained by multiplying the assigned number L<sub>b</sub> bits per sample times the number of samples per subband. When the assigned number L<sub>b</sub> bits per sample for each subband is calculated using Equation 17, L<sub>b</sub> could have a value less than 0. In this case, 0 is assigned to L<sub>b</sub> which has a value less than 0 as in
Equation 18.
rEquation ήη Ί 81
L<sub>b</sub><sup>=</sup> max í í
<img file="MX337772B_D0068.tif" />
b
<img file="MX337772B_D0069.tif" />
<img file="MX337772B_D0070.tif" />
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
As a result, the sum of the estimated numbers of _ ________ bits for all the subbands included in a given frame could be larger than the number B of the allowable bits in the given frame.
In step 1630, the sum of the estimated assigned bit numbers for all subbands included in the given frame is compared to the number B of the allowable bits in the given frame.
In step 1640, the bits are reassigned for each subband using Equation 19 until the sum of the estimated number of assigned bits for all the subbands included in the given frame is the same as the number
B of the allowable bits in the given frame.
[Equation 19] max
0, L
Jt-l b
¿E [z4 ''> 0]
In ± a Equation iy, k-1 b denotes the number of bits determined by one (ΚΙ) nth repetition, and
<img file="MX337772B_D0071.tif" />
denotes the number of bits determined by a k-nth repetition. The number of bits determined by each repetition does not have to be less than 0, and consequently, the
IMPI
<img file="MX337772B_D0072.tif" />
Operation 1640 is performed for subbands that have the number of bits greater than 0.
In step 1650, if the sum of the estimated number of assigned bits for all subbands included in the given frame is the same as the number B of the allowable bits in the given frame as a result of the comparison in step 1630 , the assigned number of bits for each sub-band is used as is, or the final assigned number of bits is determined for each sub-band using the assigned number of bits for each sub-band, which is obtained as a result of the redistribution in operation 1640.
Figure 17 is a flowchart illustrating a bit allocation method according to another example embodiment.
Referring to Figure 17, in the same way as step 1610 in Figure 16, initialization is performed in step 1710. In the same way as step 1620 in Figure 16, in step 1720, the assigned number of bits for each subband it is estimated in decimal point units, and when the assigned number Lb of bits per sample of each subband is less than 0, the number 0 is assigned to Lb which has a value less than 0 as in the
Equation 18.
In operation 1730, the minimum number of bits
<img file="MX337772B_D0073.tif" />
<img file="MX337772B_D0074.tif" />
INDUSTRIAL PROPERTY required for each subband is defined in terms of the SNR, and the assigned number of bits in operation 1720 greater than 0 and less than the minimum number of bits is adjusted by limiting the assigned number of bits to the number minimum bits. As such, by limiting the assigned number of bits in each subband to the minimum number of bits, the possibility of decreased sound quality could be reduced. For example, the minimum number of bits required for each subband is defined as the minimum number of bits required for pulse encoding in factorial pulse encoding. Factorial pulse encoding represents a signal by using all combinations of a pulse position other than 0, a pulse magnitude, and a pulse signal. In this case, an occasional number N of all the combinations, which can represent an impulse, could be represented by the
Equation 20.
[Eucation 20]
TV = Σ 2'F («, /) £) (/», /)
In Equation 20, 2<sup>1</sup> denotes an occasional number of signs that can be represented by +/- for signals at positions other than zero i.
In Equation 20, F (n, i) could be defined by Equation 21, which indicates an occasional number for the
<img file="MX337772B_D0075.tif" />
selection of nonzero positions i for the n samples given, that is, the positions.
[Equation 21] ll '.
In Equation 20, D (m, i) could be represented by Equation 22, which indicates an occasional number representing the selected signals at positions other than zero i through the m magnitudes.
[Equation 22] (»<-iy
The number M of bits required to represent the N combinations could be represented by Equation 23.
[Equation 23]
M = [log<sub>2</sub> JV]
As a result, the minimum number
<img file="MX337772B_D0076.tif" />
of bits required to encode a minimum of 1 pulse for N<sub>b</sub> Samples in a given b-nth subband could be represented by Equation 24.
<td colspan="3">Equation 241</td>
<td>L<sub>b</sub> =</td><td> 1 +</td><td>log<sub>2</sub>TO/</td>
<td>never</td><td></td><td></td>
<td>In this</td><td>case,</td><td>the number of bits used to</td>
ΐΜΡία
MEXICAN INSTITUTE, 7 ^ ..
DB PROPERTY
INDUSTRIAL ^ bT * »transmitting a gain value required for quantization could be added to the minimum number of bits required in the factor pulse encoding and could vary according to the bit rate. The minimum number of bits required as a function of each subband could be determined by a larger value of between the minimum number of bits required in the factor pulse encoding and the number Nb of samples of a given subband as in
Equation 25. For example, the minimum number of bits required depending on each subband could be set as 1 bit per sample.
[Equation 25]
L<sub>b</sub>^ <sup>=</sup> max (7V¿ ,, l + log<sub>2</sub>jV<sub>and</sub> +
When the bits to be used are not sufficient in operation 1730 because the target bit rate is small, for a subband for which the assigned number of bits is greater than 0 and less than the minimum number of bits , the assigned number of bits is extracted and set to 0. In addition, for a sub-band for which the assigned number of bits is smaller than those in Equation 24, the assigned number of bits could be extracted, and for a sub-band for which the assigned number of bits is larger than those in Equation 24 and smaller than the minimum number of bits in Equation 25, the minimum number of bits could be assigned.
<img file="MX337772B_D0077.tif" />
<img file="MX337772B_D0078.tif" />
In step 1740, the sum of the estimated assigned bit numbers for all subbands in a given frame is compared to the allowable number of bits in the given frame.
In step 1750, the bits are reassigned for a subband in which more than a minimum number of bits is allocated until the sum of the estimated assigned number of bits for all the subbands in the given frame is the same than the allowable number of bits in the given box.
At step 1760, it is determined whether the assigned number of bits in each subband is changed between a previous repeat and a current repeat for bit redistribution. If the assigned number of bits for each subband is not changed between the previous repeat and the current repeat for bit redistribution, or until the sum of the estimated assigned bit numbers for all subbands in the given table is the same as the allowable number of bits in the given frame, operations 1740 to 1760 are performed.
In operation 1770, if the assigned number of bits in each subband is not changed between the previous repeat and the current repeat for the redistribution of bits as a result of the determination in operation 1760, the bits are extracted, sequentially , from the upper subband to the lower subband, and operations 1740 to 17 60 are
<img file="MX337772B_D0079.tif" />
<td>made</td><td>until</td><td>than</td><td>be</td><td>satisfied on</td><td>number</td><td>of</td><td>bits</td>
<td>permissible</td><td>at</td><td>picture</td><td>dice</td><td> •</td><td></td><td></td><td></td>
<td>Is</td><td>say</td><td>, for</td><td>a</td><td>subband for</td><td>which</td><td>the</td><td>number</td>
assigned bits is greater than the minimum number of bits in Equation 25, the adjustment operation is performed while reducing the assigned number of bits, until the permissible number of bits in the given frame is satisfied. In addition, if the assigned number of bits is equal to or smaller than the minimum number of bits in Equation 25 for all subbands and the sum of the assigned number of bits is greater than the allowable number of bits in the table given, the assigned number of bits could be drawn from a high frequency band to a low frequency band.
In accordance with the bit allocation methods of Figures 16 and 17, to distribute or assign the bits to each subband, after the initial bits are assigned to each subband in an order of spectral energy or energy weighted spectral, the number of bits required for each subband could be estimated at the same time without repeating the search operation for the spectral energy or the spectral energy is weighted several times. In addition, by redistributing bits to each subband until the sum of the estimated assigned number of bits for all subbands in a given frame is the same as the allowable number of bits in the given frame, allocation is possible
<img file="MX337772B_D0080.tif" />
IMPI
BIT EFFICIENT MEXICAN INSTITUTE OF PROPERTY INDU5TMAL. In addition, by guaranteeing the minimum number of bits towards an arbitrary sub-band, the generation of a spectral hole that occurs due to the sufficient number of the spectral samples or impulses cannot be encoded because the assignment of a number could be avoided. small bit.
The methods of Figures 14 to 17 could be programmed and could be performed at least by means of a processing device, for example, a central processing unit (CPU).
Figure 18 is a block diagram of a multimedia device including a coding module, according to an example embodiment.
Referring to Figure 18, the multimedia device 1800 could include a communication unit 1810 and an encoding module 1830. In addition, the multimedia device 1800 could further include a storage unit 1850 for storing an audio bitstream. obtained as a result of encoding according to the use of the audio bitstream. Furthermore, the multimedia device 1800 could further include an 1870 microphone. That is, the 1850 storage unit and 1870 microphone could be optionally included. The multimedia device 1800 could further include an arbitrary decoding module (not shown), for example
<img file="MX337772B_D0081.tif" />
ΙλίΡΙ fNSTnUTO MEXICANO CE LA PROPIEDAD INDUSTRIAL example, a decoding module for performing a general decoding function or a decoding module according to an example embodiment. Coding module 1830 could be implemented by at least one processor, for example, a central processing unit (not shown) by being integrated with other components (not shown) included in multimedia device 1800 as a body.
Communication unit 1810 could receive at least one of an audio signal or an encoded bitstream provided from the outside or it could transmit at least one of a restored audio signal or an encoded bitstream obtained as a result of encoding by 1830 encoding module medium.
Communication unit 1810 is configured to transmit and receive data to and from an external multimedia device over a wireless network, such as the wireless Internet, the wireless intranet, a wireless telephone network, a wireless Local Area Network ( LAN), a Wi-Fi network, Wi-Fi Direct (WFD), a third-generation network (3G), a fourth-generation network (4G), Bluetooth, an Infrared Data Association network (IrDA), Radio Frequency Identification (RFID), Ultra Broadband (UWB), 'Zigbee', or the Communication of
'MEXICAN INSTITUTE OF PROPERTY <sub>Λ Λ</sub> ,. , INDUSTRIAL -wl
Near Field (NFC), or a rewired, such as a wired telephone network or the * "
Wired Internet.
According to an example embodiment, the encoding module 1830 could generate a bit stream by transforming an audio signal in the time domain, which is provided through the communication unit 1810 or the microphone 1870, to a spectrum audio in the frequency domain additionally You could determine the assigned number of bits in decimal point units based on the frequency bands so that an SNR of a spectrum existing in a predetermined frequency band is maximized within a range of the permissible number of bits in a given table of the audio spectrum, adjust the assigned number of bits determined according to the frequency bands, And it could also encode the audio spectrum using the adjusted number of bits based on the frequency bands and spectral energy.
According to another example embodiment, the encoding module 1830 could generate a bit stream by transforming an audio signal in the time domain, which is provided through the communication unit 1810 or the microphone 1870, into a spectrum. audio in the frequency domain, estimate the allowable number of bits in decimal point units using a masking threshold
<img file="MX337772B_D0082.tif" />
<img file="MX337772B_D0083.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL based on the frequency bands included in a given frame of the audio spectrum, furthermore, it could estimate the assigned number of bits in decimal point units using the spectral energy, adjust the assigned number of bits so as not to exceed the allowable number of bits , and could also encode the audio spectrum using the adjusted number of bits based on frequency bands and spectral energy.
The storage unit 1850 could store the encoded bit stream generated by the encoding module 1830. In addition, the storage unit
1850 It could store various programs required to operate the 1800 multimedia device.
The 1870 microphone could provide an audio signal from a user or outside to the 1830 encoding module.
Figure 19 is a block diagram of a multimedia device that includes a decoding module, according to an example embodiment.
The multimedia device 1900 of Figure 19 could include a communication unit 1910 and a decoding module 1930. In addition, in accordance with the use of a restored audio signal obtained as a result of decoding, the multimedia device 1900 of the Figure 19 could also include a 1950 storage unit
<img file="MX337772B_D0084.tif" />
<img file="MX337772B_D0085.tif" />
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY for the storage of restored audio signal. In addition, the multimedia device 1900 of Figure 19 could further include a speaker 1970. That is, the storage unit 1950 and the speaker 1970 are optional. The multimedia device 1900 of Figure 19 could further include an encoding module (not shown), for example, an encoding module for performing a general encoding function, or an encoding module
<td>in accordance with</td><td>a</td><td colspan="2">example mode. The</td><td>module</td>
<td>decoding</td><td> 1930</td><td>could</td><td>be integrated</td><td>with others</td>
<td>components (no</td><td>I know</td><td>shows)</td><td>included in the</td><td>device</td>
<td>multimedia 1900</td><td colspan="2">and it could be</td><td colspan="2">implemented by at least one</td>
processor, for example, a central processing unit (CPU).
Referring to Figure 19, the communication unit 1910 could receive at least one of an externally supplied bitstream or audio signal, or it could transmit at least one of a restored audio signal obtained as a result of decoding. of the decoding module 1930 or an audio bitstream obtained as a result of the encoding.
The communication unit 1910 could be implemented in a manner substantially similar to the communication unit
1810 from Figure 18.
According to an example modality, the module
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX337772B_D0086.tif" />
Decoding 1930 could generate a restored audio signal by receiving a bit stream provided through communication unit 1910, determining the assigned number of bits in decimal point units based on frequency bands such that an SNR of a spectrum existing in each frequency band is maximized within a range of the allowable number of bits in a given frame, adjusting the determined assigned number of bits based on the frequency bands, furthermore, you could decode an audio spectrum included in the bitstream using the adjusted number of bits depending on the frequency bands and spectral energy, and could also transform the decoded audio spectrum into an audio signal in the time domain.
In accordance with another example embodiment, the decoding module 1930 could generate a bit stream by receiving a bit stream provided through the communication unit 1910, furthermore, it could estimate the allowable number of bits in decimal point units using a masking threshold based on the frequency bands included in a given table, estimating the assigned number of bits in decimal point units using the spectral energy, adjust the assigned number of bits not to exceed the permissible number of bits, decode an audio spectrum included in the bit stream using the number of • INSTITUTO MEXICANO DE LA PROPIEDAD
INDUSTRIAL
<img file="MX337772B_D0087.tif" />
bits adjusted according to spectral energy, and also decoded audio at one time.
the bands Hp frprnpnr'ia Y - 1?
could transform the audio signal spectrum into the domain of
The storage unit 1950 could store the restored audio signal generated by the decoding module 1930. In addition, the storage unit
1950 It could store various programs required to operate the 1900 multimedia device.
The 1970 speaker could output the restored audio signal generated by the decoding module
1930 outward.
Figure 20 is a block diagram of a multimedia device including an encoding module and a decoding module, according to an example embodiment.
The multimedia device 2000 shown in Figure 20 could include a communication unit 2010, a coding module 2020 and a decoding module 2030. In addition, the multimedia device 2000 could further include a storage unit 204 0 for storing an audio bitstream obtained as a result of encoding or a restored audio signal obtained as a result of decoding in accordance with the use of the audio bitstream or restored audio signal. In
<img file="MX337772B_D0088.tif" />
IMPI
MEXICAN INSTITUTE
DB PROPERTY
INDUSTRIAL addition, the multimedia device 2000 could further include a 2050 microphone and / or a 2060 speaker. The 2020 encoding module and the 2030 decoding module could be implemented by at least one processor, eg a central processing unit (CPU ) (not shown) by being integrated with other components (not shown) included in the multimedia device 2000 as a body.
Because the components of the multimedia device 2000 shown in Figure 20 correspond to the components of the multimedia device 1800 shown in Figure 18 or the components of the multimedia device 1900 shown in Figure 19, the detailed description thereof is omitted.
Each of the 1800, 1900, and 2000 multimedia devices shown in Figures 18, 19, and 20 could include a voice communication-only terminal, such as a telephone or mobile phone, a broadcasting device, or only music, such such as a TV or MP3 player, or a hybrid terminal device of, but not limited to, a voice communication-only terminal and a broadcasting or music-only device. In addition, each of the 1800, 1900, and 2000 multimedia devices could be used as a client, server, or transducer moved between a client and a server.
When the 1800, 1900 or 2000 multimedia device
<img file="MX337772B_D0089.tif" />
IMPI
IMSTTTVTC MEXICANO
OF THE PROPERTY
INDUSTRIAL is, for example, a mobile phone, although not shown, the multimedia device 1800, 1900 or 2000 could further include a user input unit, such as a keyboard, a display unit for displaying the information processed by a user interface or mobile phone, and a processor to control the functions of the mobile phone. In addition, the mobile phone could further include a camera unit having an image capture function and at least one component to perform a function required by the mobile phone.
When the 1800, 1900, or 2000 multimedia device is, for example, a TV, although not shown, the 1800, 1900, or 2000 multimedia device could further include a user input unit, such as a keyboard, a display unit for the display of the information received from broadcasting, and a processor that controls all the functions of the TV. In addition, the TV could further include at least one component for performing a TV function.
The methods according to the example modalities can be written as computer programs and can be implemented in general-purpose digital computers that execute the programs using a recording medium capable of being read by a computer. In addition, data structures, program commands, or files
<img file="MX337772B_D0090.tif" />
Data that can be used in the example modalities could be recorded on a recording medium capable of being read by the computer in various modes. The recording medium capable of being read by a computer is any data storage device that can store data, which can later be read by a computer system. Examples of computer-readable recording media include magnetic media, such as hard drives, floppy discs, and magnetic tapes, optical media, such as CD-ROMs and DVDs, and magnetic-optical media, such as optical discs, and Hardware devices such as ROMs, RAMs, and 'flash' type memories, particularly configured to store and execute program commands. In addition, the recording medium capable of being read by the computer could be a transmission medium for the transmission of a signal in which the program command and the data structure are designated. Program commands could include compiler-edited machine language codes and high-level language codes that can be executed by a computer using an interpreter.
While the present inventive concept has been particularly shown and described with reference to the example modalities thereof, it will be understood by those of ordinary experience in the art that
<img file="MX337772B_D0091.tif" />
IMPI
MEXICAN INSTITUTE
OF THE PROPERTY
INDUSTRIAL various changes in form and details could be made therein without departing from the spirit and scope of the present inventive concept as defined by the following claims.
It is noted that in relation to this date, the best method known by the applicant to put the aforementioned invention into practice is the one that is clear from the present description of the invention.
<img file="MX337772B_D0092.tif" />
- 65 65
Contents81
103 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46 Sheet 47 Sheet 48 Sheet 49 Sheet 50 Sheet 51 Sheet 52 Sheet 53 Sheet 54 Sheet 55 Sheet 56 Sheet 57 Sheet 58 Sheet 59 Sheet 60 Sheet 61 Sheet 62 Sheet 63 Sheet 64 Sheet 65 Sheet 66 Sheet 67 Sheet 68 Sheet 69 Sheet 70 Sheet 71 Sheet 72 Sheet 73 Sheet 74 Sheet 75 Sheet 76 Sheet 77 Sheet 78 Sheet 79 Sheet 80 Sheet 81 Sheet 82 Sheet 83 Sheet 84 Sheet 85 Sheet 86 Sheet 87 Sheet 88 Sheet 89 Sheet 90 Sheet 91 Sheet 92 Sheet 93 Sheet 94 Sheet 95 Sheet 96 Sheet 97 Sheet 98 Sheet 99 Sheet 100 Sheet 101 Sheet 102 Sheet 103
99 members in 15 offices
Priority claims14
| Document | Office | Kind | Date |
|---|---|---|---|
| 201161485741 | United States of America | P | |
| 201161485741 | United States of America | P | |
| 61485741 | United States of America | – | |
| 201161495014 | United States of America | P | |
| 201161495014 | United States of America | P | |
| 61495014 | United States of America | – | |
| 2012003777 | Republic of Korea | W | |
| 2012003777 | Republic of Korea | W | |
| 61485741 | – | – | – |
| 61495014 | – | – | – |
| KR1203777 | – | – | – |
| US201161485741P | – | – | – |
| US201161495014P | – | – | – |
| WO2012KR03777 | – | – | – |
Members99
| Document | Office | Kind | |
|---|---|---|---|
| US2009281565A1 | United States of America | A1 | |
| CA2723107A1 | Canada | A1 | |
| WO2009151824A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2010280541A1 | United States of America | A1 | |
| EP2288297A1 | European Patent Office (EPO) | A1 | |
| CN102076272A | China | A | |
| JP2011528569A | Japan | A | |
| US2012288117A1 | United States of America | A1 | |
| US2012290307A1 | United States of America | A1 | |
| KR20120127334A | Republic of Korea | A | |
| KR20120127335A | Republic of Korea | A | |
| CA2836122A1 | Canada | A1 | |
| WO2012157931A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2012157932A2 | World Intellectual Property Organization (WIPO) | A2 | |
| TW201250672A | Taiwan Province of China | A | |
| TW201301264A | Taiwan Province of China | A | |
| US8353927B2 | United States of America | B2 | |
| WO2012157931A3 | World Intellectual Property Organization (WIPO) | A3 | |
| WO2012157932A3 | World Intellectual Property Organization (WIPO) | A3 | |
| US2013123836A1 | United States of America | A1 | |
| SG194945A1 | Singapore | A1 | |
| AU2012256550A1 | Australia | A1 | |
| US2014018845A1 | United States of America | A1 | |
| MX2013013261A | Mexico | A | |
| US8657850B2 | United States of America | B2 | |
| CN103650038A | China | A | |
| EP2707874A2 | European Patent Office (EPO) | A2 | |
| EP2707875A2 | European Patent Office (EPO) | A2 | |
| JP5520932B2 | Japan | B2 | |
| JP2014514617A | Japan | A | |
| EP2288297A4 | European Patent Office (EPO) | A4 | |
| US8845680B2 | United States of America | B2 | |
| EP2707874A4 | European Patent Office (EPO) | A4 | |
| EP2707875A4 | European Patent Office (EPO) | A4 | |
| RU2013155482A | Russian Federation | A | |
| BRPI0912379A2 | Brazil | A2 | |
| US9159331B2 | United States of America | B2 | |
| US9236057B2 | United States of America | B2 | |
| US2016035354A1 | United States of America | A1 | |
| MX337772BThis record | Mexico | B | |
| US2016099004A1 | United States of America | A1 | |
| CN103650038B | China | B | |
| CN105825858A | China | A | |
| CN105825859A | China | A | |
| AU2012256550B2 | Australia | B2 | |
| US9489960B2 | United States of America | B2 | |
| TWI562132B | Taiwan Province of China | B | |
| TWI562133B | Taiwan Province of China | B | |
| AU2016262702A1 | Australia | A1 | |
| TW201705123A | Taiwan Province of China | A | |
| TW201705124A | Taiwan Province of China | A | |
| BR112013029347A2 | Brazil | A2 | |
| MX345963B | Mexico | B | |
| US2017061971A1 | United States of America | A1 | |
| TWI576829B | Taiwan Province of China | B | |
| TW201715512A | Taiwan Province of China | A | |
| CA2723107C | Canada | C | |
| US9711155B2 | United States of America | B2 | |
| US9743934B2 | United States of America | B2 | |
| JP6189831B2 | Japan | B2 | |
| US9773502B2 | United States of America | B2 | |
| AU2016262702B2 | Australia | B2 | |
| JP2017194690A | Japan | A | |
| TWI604437B | Taiwan Province of China | B | |
| US2017316785A1 | United States of America | A1 | |
| TWI606441B | Taiwan Province of China | B | |
| MY164164A | Malaysia | A | |
| US2018012605A1 | United States of America | A1 | |
| AU2018200360A1 | Australia | A1 | |
| RU2648595C2 | Russian Federation | C2 | |
| EP3346465A1 | European Patent Office (EPO) | A1 | |
| EP3385949A1 | European Patent Office (EPO) | A1 | |
| US10109283B2 | United States of America | B2 | |
| RU2018108586A | Russian Federation | A | |
| AU2018200360B2 | Australia | B2 | |
| RU2018108586A3 | Russian Federation | A3 | |
| US10276171B2 | United States of America | B2 | |
| JP2019168699A | Japan | A | |
| RU2705052C2 | Russian Federation | C2 | |
| KR102053899B1 | Republic of Korea | B1 | |
| KR102053900B1 | Republic of Korea | B1 | |
| KR20190138767A | Republic of Korea | A | |
| KR20190139172A | Republic of Korea | A | |
| CN105825858B | China | B | |
| CN105825859B | China | B | |
| CA2836122C | Canada | C | |
| JP6726785B2 | Japan | B2 | |
| KR102193621B1 | Republic of Korea | B1 | |
| KR20200143332A | Republic of Korea | A | |
| KR102209073B1 | Republic of Korea | B1 | |
| KR20210011482A | Republic of Korea | A | |
| BR112013029347B1 | Brazil | B1 | |
| ZA201309406B | South Africa | B | |
| KR102284106B1 | Republic of Korea | B1 | |
| MY186720A | Malaysia | A | |
| KR20220004778A | Republic of Korea | A | |
| EP3937168A1 | European Patent Office (EPO) | A1 | |
| KR102409305B1 | Republic of Korea | B1 | |
| KR102491547B1 | Republic of Korea | B1 |
Numbers
- Publication
- 337772
- Publication, DOCDB
- 337772
- Publication, EPODOC
- MX337772
- Application
- 2015005615
- Application, DOCDB
- 2015005615
- Application, EPODOC
- MX20150005615
Titles
- Spanish
- ASIGNACION DE BITS, CODIFICACION Y DECODIFICACION DE AUDIO.
Classification
- CPC, 7
- G10L19/028
- G10L19/032
- G10L19/26
- G10L19/002
- G10L19/0204
- G10L19/167
- G10L21/0232
- IPC, 2
- G10L19 002
- G10L19 028