Audio coding method and apparatus.
Abstract
Coder and method therein for coding of an audio signal, where a frequency spectrum of the audio signal is divided into a first and a second region, where at least the second region comprises a number of bands. Further, spectral peaks in the first region are encoded by a first coding method. The method provided herein comprises: for a segment of the audio signal: determining a relation between an energy of a band in the second region and an energy estimate of the first region. The method further comprises determining a relation between the energy of the band in the second region and an energy of neighboring bands in the second region. The method further comprises determining whether an available number of bits is sufficient for encoding at least one non-peak segment of the first region and the band in the second region. Further, when the relations fulfill a respective predetermined criterion and the number of bits is sufficient, the band in the second region and the at least one segment of the first region are encoded using a second coding method. Otherwise, the band in the second region is instead subjected to BWE or noise fill.

Term
8.5 yearsleft in the term
Expires 13 March 2035.
- Priority
- Filed
- Granted
- Today
- Expires
18 claims: 4 independent, 14 dependent
- 1REIVINDICACIONES 1. Un método para codificar una señal de audioun espectro de frecuencia de la señal de audio se divide en al menos una primera y una segunda región, en donde al menos la segunda región comprende un número de bandas, y en donde picos espectrales en la primera región se codifican por un primer método de codificación, el método que comprende:para un segmento de la señal de audio: determinar una relación entre una energía de una banda en la segunda región y un cálculo de energía de la primera región;determinar una relación entre la energía de la banda en la segunda región y una energía de bandas vecinas en la segunda región;determinar si un número de bits disponible es suficiente para codificar al menos un segmento que no es pico de la primera región y la banda en la segunda región;y cuando las relaciones cumplan un criterio respectivo predeterminado y el número de bits sea suficiente: codificar la banda en la segunda región y el al menos un segmento que no es pico de la primera región utilizando un segundo método de codificación que es diferente del primer método de codificación, y de otra manera: someter la banda en la segunda región a Extensión de Ancho de Banda, BWE, o relleno de ruido.
- 2El método de conformidad con la reivindicación 1, en donde el primer método de codificación es un método de codificación basado en pico. tNSTITUT'*'-MEXICANO ··. ♦ i· INDUSTRIAL -
- 3El método de conformidad con la en donde el cálculo de energía de la primera región se basa en las energías de los picos espectrales en la primera región.
- 4El método de conformidad con la reivindicación 1, en donde la determinación de si el número de bits disponible es suficiente aplica una prioridad para codificar la región perceptualmente más relevante.
- 5El método de conformidad con la reivindicación 1, en donde la determinación de si el número de bits es suficiente para codificar la banda en la segunda región considera el número de bits mínimo requerido para codificar al menos un coeficiente de la banda en la segunda región.
- 6El método de conformidad con la reivindicación 1, en donde la primera región es una parte más baja del espectro de frecuencia que la segunda región.
- 7El método de conformidad con la reivindicación 1, en donde el segundo método de codificación comprende cuantificación vectorial o cuantificación vectorial de pirámide.
- 8Un medio de almacenamiento no D¿LA PROPIEDAD por computadora que hace que una computadora realice el método de conformidad con la reivindicación 1.
- 9El método de conformidad con la reivindicación 1, en donde el primer método de codificación es un método de codificación basado en pico que comprende codificación de una posición de pico, una amplitud y signo de la posición de pico, y un vector de forma representando contenedores de Transformada de Coseno Discreta Modificada (MDCT) vecinos.
- 10Un codificador para codificar una señal de audio, en donde un espectro de frecuencia de la señal de audio se divide en al menos una primera y una segunda región, en donde al menos la segunda región comprende un número de bandas, el codificador que se configura para codificar picos espectrales en la primera región utilizando un primer método de codificación, y el codificador estando adicionalmente configurado para realizar operaciones que comprenden:para un segmento de la señal de audio: determinar una relación entre una energía de una banda en la segunda región y un cálculo de energía de la primera región;determinar una relación entre la energía de la banda en la segunda región y una energía de bandas vecinas en la segunda región;determinar si un número de bits disponible es suficiente para codificar al menos un segmento que no es pico de la primera región y la banda en la segunda región;y para msrrrvro mexicano ' ‘ <.-.j.· DíLAttOWt»*» cumplen un criterio respectivo predeterminado y eFftWerocrerEits es suficiente: codificar la banda menos un segmento que no es pico de la primera región utilizando un segundo método de codificación que es diferente del primer método de codificación;y de otra manera: someter la banda en la segunda región a Extensión de Ancho de Banda, BWE, o relleno de ruido.
- 11El codificador de conformidad con la reivindicación 10, en donde el primer método de codificación es un método de codificación basado en pico.
- 12El codificador de conformidad con la reivindicación 10, en donde el cálculo de energía de la primera región se basa en las energías de los picos espectrales en la primera región.
- 13El codificador de conformidad con la reivindicación 10, en donde la determinación de si el número de bits es suficiente aplica una prioridad para codificar la región perceptualmente más relevante.
- 14El codificador de conformidad con la reivindicación 10, en donde la determinación de si el número de bits es suficiente· para codificar la banda en la segunda región considera el número f de bits mínimo requerido para codificar al ΐΝ’ίΤπντο mexicano de la banda en la segunda región.
- 15El codificador de conformidad con la reivindicación 10, en donde la primera región es una parte más baja del espectro de frecuencia que la segunda región.
- 16El codificador de conformidad con la reivindicación 10, en donde el segundo método de codificación comprende cuantif icación vectorial o cuantif icación vectorial de pirámide.
- 17Un dispositivo de comunicación que comprende un codificador de conformidad con la reivindicación 10.
- 18El codificador de conformidad con la reivindicación 10, en donde el primer método de codificación es un método de codificación basado en pico que comprende codificación de una posición de pico, una amplitud y signo de la posición de pico, y un vector de forma representando contenedores de Transformada de Coseno Discreta Modificada (MDCT) vecinos.
Independent claims18
287 paragraphs in 38 sections, as filed
(54) Title: AUDIO CODING METHOD AND DEVICE.
(54) Title: AUDIO CODING METHOD AND APPARATUS.
(57) Summary
Encoder and method thereof for encoding an audio signal, where a frequency spectrum of the audio signal is divided into a first and a second region, where at least the second region comprises a number of bands. Furthermore, the spectral peaks in the first region are encoded by a first encoding method. The method provided herein comprises: for a segment of the audio signal: determining a relationship between an energy of a band in the second region and an energy calculation of the first region. The method further comprises determining a relationship between the energy of the band in the second region and an energy of neighboring bands in the second region. The method further comprises determining whether an available number of bits is sufficient to encode at least one non-peak segment of the first region and the band in the second region. Furthermore, when the relationships meet a respective predetermined criterion and the number of bits is sufficient, the band in the second region and at least one segment of the first region are encoded using a second encoding method. Rather, the band in the second region is in fact subjected to BWE or noise filler.
(57) Abstract
Coder and method therein for coding of an audio signal, where a frequency spectrum of the audio signal is divided into a first and a second region, where at least the second region comprises a number of bands. Further, spectral peaks in the first region are encoded by a first coding method. The method provided herein comprises: for a segment of the audio signal: determining a relation between an energy of a band in the second region and an energy estimate of the first region. The method further comprising determining a relation between the energy of the band in the second region and an energy of neighboring bands in the second region. The method further comprising determining whether an available number of bits ¡s sufficient for encoding at least one non-peak segment of the first region and the band in the second region. Further, when the relations fulfill a respective predetermined criterion and the number of bits is sufficient, the band in the second region and the at least one segment of the first region are encoded using a second coding method. Otherwise, the band in the second region is instead subjected to BWE or noise f¡II.
<img file="MX353200B_D0001.tif" />
PATENT TITLE No. 353200
<td>Title (s):</td><td>TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)</td>
<td>Home:</td><td>SE-164 83, Stockholm, SWEDEN</td>
<td>Denomination:</td><td>AUDIO CODING METHOD AND DEVICE.</td>
Classification: CIP: G10L25 / 51; G10L19 / 00; G10L19 / 002; G10L19 / 02; G10L19 / 18; G10L19 / 028;
G10L19ZQ38; Grl OÍ25M8; Q16125 / 24
CPC: G01119 / 0023, C ^ 4OL19 / 0O2, G1 (J_10 / OO8, G10L19 / 028; G10L19 / 038;
G10L19 / 0204; G10L25 / 21; G10L25 / 51? GltjU9 / 02; G10L19 / 18; G10L25 / 06
ERIK HORVELL; VOLODYA
Inventor (s):
<img file="MX353200B_D0002.tif" />
w
W
Number:
MX / a / 2016/011328
International:
Miner:
61/963,331
- - · f iVigencia: Twenty years «
Vehicle Date March 13, 20 ^ 5 *
Issue Date: ertefb d ^ 2018> _
The reference patent with fun dame ^ tQ ^ en ^ tos ^ tí ^ ulos I<sup>0</sup>, ^ ftejMe laPc0gíe ^ 6g3. Industrial.
In accordance with article 23artB, the LeyMgja fi (ppiec ^ ftn ^ Bfcjlta ^^ Éhte [®e ^^ ffi ^^ a> vig ^ 'de veintp áñM'Mfc extendable, counted from the date of presentgy ^ fe ^ solicitu'd intepKKáoi ^ y est ^ á subject | lp | ig> J ^ á% irifa ^ Mwffift have valid rights.
Who subscribes to this title lq, h (Official Gazette of the Federation
25/01/2006, 06/05/2009,06/01/2010,
Regulations of the Mexican Institute of articles 1, 3<sup>or</sup>, 4<sup>or</sup>, 5 fraction V subsection a), WTra
12/27/1999, amended on 10/10/2002, 07/29
Deputy Generals, Coordinator, Directors Di
Departmental and other subordinates of the Mexi Institute 08/04/2004 and 09/13/2007).
e * faccioHR ni
10RMS 12/26 /:
<img file="MX353200B_D0003.tif" />
2. »2.Je the Industrial Property Law>; 'lW05 / 1999, 01/26/2004, 06/16/2005.
ÍÓJwfo a), 4 “and 12 ° sections I and III of JSTO7 / 2004, 07/28/2004 and 09/07/2007); of Industrial Property (DOF rdo that delegates powers to the Divisional Deputy Directors, Coordinators 12/15/1999, amended on 02/04/2000, 07/29/2004,
This letter is signed with an advanced electronic signature (FIEL), based on articles 7 BIS 2 of the Industrial Property Law; 3rd of its Regulations, and 1 fraction III, 2 fraction V, 26 BIS and 26 TER of the Agreement establishing the guidelines for the use of the Electronic Payment and Services Portal (PASE) of the Mexican Institute of Industrial Property, in the procedures indicated
THE DIVISIONAL DIRECTOR OF PATENTS
NAHANNY CANAL REYES
<img file="MX353200B_D0004.tif" />
Original string:
NAHANNY MARISOL CANAL REYES | 00001000000403252793 | Administration Service
Tax | 1695 || MX / 2018/2503 | MX / a / 2016/011328 | PCT patent title | 1223 | GAGV | Page (s) | ORSFZFCCQVIy6mnfdhGr8Smeyzw =
Digital stamp:
vUPEzCPVcrSC9m7tc4s8DxzfJDmA7HyWp3Xk9CI + f0s9yb73wBf891H4W / 7FUSdxDyiSFocKceB0ayj9GLEcr5lwhr dyq72¡PZ5IK0e + mYqjlvHQeN / IC9Dk3ci1N1IU8nPIWCSREh3fsWH + zdm / 1FgD2CLTXIW2i1oQrbgXFpltNQRGD564 nMd4f / HXpZV3pcXSBPGUeeasFLPYp8nznEz4 + PTJpAJWOmgyOjEMoioR7fOAfSIOY8VntBGRFvBphvml03LOA9Rc6Q
Ro9d8oRguGjdEmmq6EfsjO + 7Q7hf8 / rQG1 YgWoWs3cyJSyTuoj + z + amWpzjHNOy06 / 7mUSUA ==
Arenal No. 550, Floor 1, Pueblo Santa María Tepepan, Xochimilco, 16020, Mexico City, (55153340700 vwAv.gob.mx/impi
<img file="MX353200B_D0005.tif" />
MX / 2018/2503
<img file="MX353200B_D0006.tif" />
IMPI ^
MEXICAN INSTITUTE OF PROPERTY ν- · ΐχ INDUSTRIAL
AUDIO CODING METHOD AND DEVICE
TECHNICAL FIELD
The proposed technology is generally related to encoders and methods for encoding audio.
The embodiments herein are generally related to audio encoding where parts of the spectrum cannot be encoded due to bit rate restrictions. In particular, they relate to bandwidth extension technologies where a perceptually less important band is reconstructed using, for example, a parametric representation and approximations from a perceptually more important coded band.
BACKGROUND
Most of the existing telecommunication systems operate in a limited audio bandwidth. Derived from the limitations of landline telephone systems, most voice services are limited to only transmitting the lower end of the spectrum. Although limited audio bandwidth is sufficient for most conversations, there is a desire to increase audio bandwidth to improve intelligibility and a sense of presence. Although the capacity in telecommunication networks increases continuously, it is still of great interest to limit the
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX353200B_D0007.tif" />
communication channel. In networks with lower transmission for each energy in both the bandwidth required by mobile devices, the called bandwidths produce lower mobile consumption as the base station. This translates into energy and cost savings for the mobile operator, while the end user will experience long battery life and increased talk time. Furthermore, with less bandwidth consumed per user, the mobile network can serve a larger number of users in parallel.
A property of the human auditory system is that perception depends on frequency. In particular, our hearing is less accurate for high frequencies. This inspired so-called bandwidth extension techniques (BWE), where a high-frequency band is reconstructed from a low-frequency band by using a low number of transmitted parameters.
Conventional BWE uses a parametric representation of the high-band signal, such as a spectral envelope and a time envelope, and reproduces the fine structure of the signal spectrum by using generated noise or a modified version of the low-band signal. If the high band envelope is represented by a filter, the fine structure signal is usually called the drive signal. An accurate representation of the high band envelope is perceptually more important than the fine structure. Consequently it is common for resources
PREVENT.
MEXICAN INSTITUTE OF PflOFiEDAD 'η. .INDUSTRIAL available in Bit Terms to be spent in the representation of the envoTvélité flllénVra's that the fine structure is reconstructed from the encoded lowband signal without additional supplemental information.
BWE technology has been applied in a variety of audio encoding systems. For example, the 3GPP AMR-WB + uses a time domain BWE based on a low-band encoder that toggles between Code Excited Linear Predictor (CELP) voice encoding and Transform-encoded residual encoding (TCX). . Another example is the 3GPP eAAC transform based audio codec that performs the BWE transform domain variant called Spectral Band Replication (SBR).
Although splitting into a low band and a high band is usually perceptually motivated, it may be less suitable for certain types of signals. As an example, if the high band of a particular signal is perceptually more important than the smaller band, most of the bits spent in the smaller band will be wasted while the larger band will be rendered with poor precision. In general, if a portion of the spectrum is set to be encoded while other parts are not encoded, there can always be signals that do not fit the assumption a priori. The worst case scenario may be that all the signal power is contained in the uncoded part which can lead to very poor performance.
SUMMARY OF THE INVENTION
OF INDUSTRIAL PROPERTY
One object is to provide more flexible audio coding schemes. This and other objects are fulfilled by the modalities of the proposed technology.
The proposed technology is related to adding decision logic to include a band or bands, which is a priori assumed not to be important, in the fine structure coding. Decision logic is designed to maintain conventional behavior for signals where the a priori assumption for the boundaries of encoded and BWE regions is valid, by including parts of the BWE region that are assumed a priori to be unimportant in the region encoded for signals outside this group.
An advantage of the proposed technology is to maintain the beneficial structure of a partially encoded band based on a priori knowledge by extending it to handle specific signal cases.
Other advantages will be appreciated when reading the detailed description.
According to a first aspect, a method is provided for encoding an audio signal, where a frequency spectrum of the audio signal is divided into at least a first and a second region, where at least the second region comprises a number of bands. Furthermore, the spectral peaks in the first region are encoded by a first encoding method. The
IMPI
MEXICAN INSTITUTE SEES THE PROPERTY
L.'L'.Λ ίΕνηκγγ * method provided herein comprises: part ^ a segment of the audio signal: determining a relacie of a band in the second region and an energy calculation of the first region. The method further comprises determining a relationship between the energy of the band in the second region and an energy of neighboring bands in the second region. The method further comprises determining whether an available number of bits is sufficient to encode at least one non-peak segment of the first region and the band in the second region. Furthermore, when the relationships meet a respective predetermined criterion and the number of bits is sufficient, the band in the second region and at least one segment of the first region are encoded using a second encoding method. Rather, the band in the second region is in fact subjected to BWE or noise filler.
According to a second aspect, an encoder is provided to encode an audio signal, where a frequency spectrum of the audio signal is divided into at least a first and a second region, where at least the second region comprises a number of bands. The encoder is configured to encode spectral peaks in the first region using a first encoding method. The encoder is further configured so that: a segment of the audio signal: determines a relationship between an energy of a band in the second region and an energy calculation of the first region; to determine a relationship between the energy of
<img file="MX353200B_D0008.tif" />
from neighboring bands in the second region;
<img file="MX353200B_D0009.tif" />
number of bits available is sufficient to encode at least one non-peak segment of the first region and the band in the second region. The encoder is further configured for: when the relationships meet a respective predetermined criterion and the number of bits is sufficient: encode the band in the second region and at least one segment of the first region using a second encoding method and conversely, subject the band in the second region to BWE Extension or noise fill.
According to a third aspect, a communication device is provided, comprising an encoder according to the second aspect.
In accordance with a fourth aspect, a computer program is provided, comprising instructions which, when executed in at least one processor, cause the method according to the first and / or second aspect to be carried out by at least one processor.
According to a fifth aspect, a carrier is provided, which contains the computer program of the fourth aspect.
BRIEF DESCRIPTION OF THE DRAWINGS
The foregoing and other objects, features and advantages of the technology described herein will be apparent from the following more particular description as illustrated in the accompanying drawings.
necessarily found at scale, in their
JL XtX JL JL '**
MEXICAN INSTITUTE '010 ”-. J '\ DE LA CHOPIFÍ.AD Λ. -. >
INDUSTRIAL modalities
The drawings are not place emphasis has been placed on illustrating the principles of technology described herein.
Figure 1 is an example of harmonic spectrum driven by the coding concept presented. For comparison, the figure below illustrates the audio spectrum with slow variation spectral envelope;
Figure 2a is a structural view of the four different types of coding regions of the spectrum of
MDCT;
Figure 2b is an example of the LF encoded region that models the space between spectral peaks;
Figure 3 is a flow chart illustrating a method according to an exemplary embodiment.
Figure 4 illustrates an introduction of a coded band in the BWE region;
Figures 5a-c illustrate implementations of an encoder according to exemplary modalities.
Figure 6 illustrates one embodiment of an encoder;
Figure 7 illustrates one embodiment of a computer implementation of an encoder;
Figure 8 is a schematic block diagram illustrating one embodiment of an encoder comprising a group
<img file="MX353200B_D0010.tif" />
MEXICAN INSTITUTE OF TNL'USTXEAL PROPERTY
<img file="MX353200B_D0011.tif" />
of function modules; and
Figure 9 illustrates one embodiment of a coding method;
DETAILED DESCRIPTION
The proposed technology is intended to be implemented in a codee, that is, an encoder and a corresponding decoder (usually abbreviated as a codeo). An audio signal is received and encoded by the encoder. The resulting encoded signal is typically produced and transmitted to a receiver, where it is decoded by a corresponding decoder. In some cases, the encoded signal is actually stored in memory for later retrieval.
The proposed technology can be applied in an encoder and / or decoder, for example, in a user terminal or user equipment, which can be a wired or wireless device. All of the alternative devices and nodes described herein are summarized in the term communication device, where the solution described herein could be applied.
As used herein, the non-limiting terms User Equipment and wireless device may refer to a mobile phone, a cell phone, a Personal Digital Assistant, PDA, equipped with radio communication capabilities, a smartphone, a computer
IMPI
JK MEXICAN INSTITUTE
OF THE PROPERTY
INDUSTRIAL laptop or personal computer, PC, internal or external mobile broadband, equipped with a tablet PC modem with radio communication capabilities, a target device, device-to-device UE, a machine-type UE, or a UE with machine-to-machine communication capability, iPAD, local client equipment, CPE, built-in laptop equipment, LEE, laptop mounted equipment, LME, a USB adapter, a portable electronic radio communication device, a sensor device equipped with radio communication capabilities or the like. In particular, the term UE and the term wireless device should be interpreted as non-limiting terms that comprise any type of wireless device that communicates with a radio network node in a cellular or mobile communication system or any device equipped with radio circuitry. for wireless communication in accordance with any relevant standard for communication within a cellular or mobile communication system.
As used herein, the term wired device can refer to any device configured or prepared for wired connection to a network, in particular, the wired device can at least be any of the above devices, with or without radio communication capability , when configured for wired connection.
The proposed technology can also be applied to an encoder and / or decoder of a radio network node. As used herein
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX353200B_D0012.tif" />
The term non-limiting radio network node can refer to base stations, network control nodes such as network controllers, radio network controllers, base station controllers, and the like. In particular, the term base station may encompass different types of radio base stations including standardized base stations such as Node B, or Evolved Node B, the eNBs and also macro / micro / peak radio base stations, local base stations, also known as femto base stations, relay nodes, repeaters, radio access points, base transceiver stations, BTS, and even radio control nodes that control one or more Remote Radio Units, RRUs, or the like.
Regarding the terminology regarding the frequency spectrum of the audio signal to be encoded, here it is a question of explaining some of the terms used. As described above, audio frequencies are usually divided into a so-called low band, (LB), or low frequency band, (LF); and a so-called high band, (HB), or high frequency band (HF). Typically, the high band is not encoded in the same way as the low band, but rather is subjected to BWE. The BWE may comprise the encoding of a spectral envelope and a temporal envelope, as described above. However, a high bandwidth spread band may still be referred to as unencoded herein.
In other words, a
<img file="MX353200B_D0013.tif" />
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX353200B_D0014.tif" />
Uncoded highband may still be associated with some encoding of the example envelopes, but it may be assumed that this encoding is associated with far fewer bits than the encoding in the encoded regions.
Herein, the terminology a first region and a second region will be used, referring to parts of the audio spectrum. In a preferred embodiment, the first region may be assumed to be the low band, and the second region may be assumed to be the high band, as in conventional audio encoding using BWE. However, they can have more than two regions, and the regions can be configured differently.
The proposed technology is incorporated in the context of an audio codec that targets signals with strong harmonic content. An illustration of the audio signals is presented in Figure 1. The upper audio spectrum in Figure 1 is an example of a harmonic spectrum, ie an example of a spectrum of an audio signal with strong harmonic content. For comparison, the lower spectrum in Figure 1 illustrates an audio spectrum with a slowly varying spectral envelope.
In an exemplary mode, encoding and decoding is performed in the frequency domain using the Transform transform of
Discreet Cosine
Modified (MDCT). The harmonic structure is modeled using a specific peak encoding method in the so-called ¿guc * r: r
IMPI ηΡ :: - ;. MEXICAN INSTITUTE '
Dt rKUW.DAD Ί * λ U; „. * INDUSTRIAL 'Az.-lJÜ-Ia * low band, which is complemented by a vector quantizer« A.
(VQ) which directs the important low coefficients of the MDCT spectrum and a higher region frequencies are generated from the low. A general description of this BWE frequency- (LF) ”system where the band syntheses are represented in Figure 2a and 2b.
Figure 2a shows a structural view of the four different types of coding regions of an MDCT spectrum. In the low band, spectral peaks are encoded using a peak-based encoding method, in the high band, BWE (dotted lines) is applied, which may involve encoding, i.e. some parametric representation of related information with the spectral envelope and the temporal envelope. The LF labeled region encoded in Figure 2a (double line) is encoded using a gain shape encoding method, ie it is not the same encoding method as that used for the peaks. The LF region c modified is dynamic in that it depends on the remaining number of bits, outside of a bit calculation, that are available for encoding when the peaks have been encoded. In Figure 2b, the same regions can be seen as in Figure 2a, but here it can also be seen that the encoded LF region extends between the encoded peaks. In other words, the parts of the low band spectrum located between the peaks can also be modeled by the same method of
<img file="MX353200B_D0015.tif" />
INSTITUTO MEXICANO DF LA PROPIEDAD INDUSTRIAL
<img file="MX353200B_D0016.tif" />
gain shape encoding, depending on the peak positions of the object spectrum and the number of bits available. The parts of the spectrum comprising the encoded peaks are excluded from the gain shape encoding of the lowest frequency region, i.e. the encoded LF region. The parts of the low band that remain unencoded when the available bits are spent in the peak encoding and the LF encoding are subjected to noise padding (dashed line in Figure 1).
Assuming the above structure, i.e. a first region where the peaks and parts / coefficients that are not important peaks are coded and a second region, also the possibly indicated BWE region, of which there is an a priori assumption that it does not Comprising as perceptually relevant information as the first region, a novel technique is proposed to add encoding of spectral components in the BWE region. The idea is to introduce a coded band in the BWE region (see figure 3) if certain requirements are met. More than one encoded band could also be entered when appropriate.
Because an object is to maintain a structure of an encoded region, such as a low-frequency part of the spectrum, and a second region, such as a high-frequency part of the spectrum, that is, the extended bandwidth for most the signals, a band encoded in the second
IMPIÍ ^ v
INSTITUTO MEXICANO · -DE LA MONEDAD INDUSTRIAL Vfci region should only be entered in one modality if certain conditions are met with respect to the band. The conditions or criteria, for a candidate band, in a second region, evaluated by coding, can be formulated as follows:
The energy in the candidate band, for example a frequency band in a high-frequency part of the spectrum, should be relatively high compared to an energy calculation of a peak encoded region, for example in the lower part of the spectrum of frequency. This energy ratio indicates an audible and thus perceptually relevant band in the second region.
2. The candidate band must have a relatively high energy compared to neighboring bands in the second region. This indicates a peak structure in the second region that cannot be modeled well with the BWE technique.
3. The resources, ie bits, to encode the candidate band must not compete with larger components (see LF encoded in Figure 2a and 2b) in encoding parts of the encoded region.
Exemplary modalities
Next, exemplary embodiments related to a method for encoding an audio signal will be described with reference to FIG. 3. The frequency spectrum of the audio signal is divided into at least a first and second region, in
IMPI'SÉS
MEXICAN INSTITUTE tz '·. .
THE INDUSTRIAL fKONEOAD —-i— where at least the second region comprises a number of bands and where the spectral peaks in the first<sup>_</sup>region are encoded by a first encoding method. The method will be performed by an encoder with a corresponding method in the decoder. The encoder and decoder can be configured to be compatible with one or more audio encoding and decoding standards. The method comprises, for a segment of the audio signal:
- determining 301 a relationship between an energy of a band in the second region and an energy calculation of the first region;
- determining 302 a relationship between the energy of the band in the second region and an energy of neighboring bands in the second region;
- determining 303, 305 if an available number of bits is sufficient to encode at least one non-peak segment of the first region and the band in the second region; and, when the relations meet 304 a respective predetermined criterion and the number of bits are sufficient 305:
encoding 306 the band in the second region and at least one segment of the first region using a second encoding method; and in another way:
-someter 307 the band in the second region to BWE or noise fill.
The first region can typically be a minor part
IMPI institute> .; i: x¡cano PE iA? ROHEDAD Nt USTRIAL of the frequency spectrum than the second region. The region may, as mentioned above, be the so-called low band and the second region may be the so-called high band. The regions do not overlap and can be adjacent. Additional regions are also possible, which can, for example, separate the first and second regions.
At least a segment of the first region, see part of LF Encoded in Figures 2a and 2b and the candidate band selected for encoding in the second region are encoded using the same second encoding method. This second encoding method may comprise vector quantization or pyramid vector quantization. Because the energy envelope or the gains of the bands in the second region are already encoded to aid BWE technology, it is beneficial to supplement this encoding with a shape quantizer applied to the fine structure of the selected candidate band. In this way, a gain shape encoding of the selected candidate band is achieved. In some preferred embodiments, the spectral peaks in the first region are encoded by a first encoding method, as mentioned above. The first preferred encoding method is a peak-based encoding method, as described, for example, in TS 26.445 of 3GPP, section 5.3.4.2.5. A second encoding method is exemplified in the same document in section 5.3.4.2.7.
Figure 4
IMPI
MEXICAN INSTITUTE --xl 'L'
OF THE PROPERTY , . ...,,. INDUSTRIAL illustrates a possible result for applying a modality of the method described in an Uer 1 ü 1. Eή Γΰ ”ΤΤψττa
4, one band, B<sub>HB</sub>r θη the second region is encoded instead of being subjected to BWE (as in Figures 2a and 2b), which might have been the case if one method modality was not applied. Band B<sub>H</sub>b is encoded using the same encoding method as that used for the LF labeled parts encoded in Figure 4. However, peaks in the first region, marked encoded peak, are encoded using another encoding method, which of preference is based on peak. Note that since the content of the second region is not strictly populated when using BWE or another spectral padding technique, the a priori assumption of an encoded band and an unencoded band is no longer true. For this reason, it may be more appropriate to call the fill strategy a noise fill. The term noise fill is generally used more for spectral fill in regions that can appear anywhere in the spectrum and / or between coded parts of the spectrum.
The determination of relationships between energies and the sufficient amount of a number of bits available for encoding corresponds to the three conditions, numbered 1-3, described above. Examples of how the determination can be made will be described below. The evaluation is described for a candidate band in the second region.
IMPI Mexican Institute
FROM: TO PROPERTY ND> 'STRIAL
<img file="MX353200B_D0017.tif" />
Condition assessment 1
The first condition is related to that the energy in the candidate band must have a certain relation with an energy calculation of a peak encoded region. This relationship is described herein as the candidate band energy should be relatively high compared to the energy calculation of the first region.
Assuming, as an example, that the coding is performed in the frequency transform domain using the Modified Discrete Cosine Transform, where the MDCT coefficients are calculated as:
where x {n) indicates a frame of input audio samples with frame index i. Here, n is an index of time domain samples and k is the index of the frequency domain coefficients. For simplicity of notation, frame index i will be omitted when all calculations are performed within the same frame. In general, it should be understood that all calculations that are derived from the input audio frame x (n) will be performed on a frame basis and all of the following variables could be indicated with an index i.
IMPIOUS*
MEXICAN INSTITUTE * 5 «W
<img file="MX353200B_D0018.tif" />
MEXICAN INSTITUTE OC LA PRORUOAD INDUSTRIAL
The logarithmic energies of band E (j) of the second region, for example, high band region, can be defined as:
where bj is the first coefficient in band j and N. refers to the number of MDCT coefficients in the band. A typical number for a high frequency region is 24-64 coefficients per band. It should be noted that 2 log2 (·) is only an example that was found suitable in the directed audio coding system and that other logarithmic bases and scale factors can be used. The use of other logarithmic bases and scale factors may provide different absolute logarithmic energy values, but in other respects the method may be to remain the same.
As previously described, the spectral peaks in the first preferred region are encoded using a peak-based encoding method. The coded peaks of the first region, eg lower frequency region, in this example is modeled using the peak position p (m), an amplitude, including the sign, G (m) that is set for the container MDCT coincides at the determined position Y (p (m)) and a vector of form V (m) that represents the neighboring peaks, for example, the four neighboring MDCT containers, where m = l..Npi<sub>COS</sub> and Peaks is the number of peaks used in the
<td></td><td>IMPIAS MEXICAN INSTITUTE f. '., -' ·<sup>3</sup>, DSIA PROPERTY i,</td>
<td>representation of the first region.</td><td>industrial</td>
To assess compliance with condition 1 above, you want to perform an energy calculation in the first region, compare the candidate band energy. Assuming that most of the energy in the first region is contained within the modeled peaks, a calculation of the energy in the first region, E<sub>P</sub>i<sub>CO</sub> (i), from plot i can be derived as:
Condition 1 can now be evaluated by adjusting a threshold for the energy envelope E (j) of candidate band j, such as:
where T<sub>2</sub> is a logarithmic threshold energy to pass, that is, meet, condition 1. Due to the computational complexity of the logarithmic function, the following mathematically equivalent alternative can be used:
The threshold value should be set to correspond to the perceptual importance of the band. The value
<img file="MX353200B_D0019.tif" />
MEXICAN INSTITUTE OF LA FVÜPIEDA & INDUSTRIAL
<img file="MX353200B_D0020.tif" />
actual may depend on band structure. In a nmi ininiL mm nmin.n.Biiiiniwi Μ ~ ιτ wri · jtji wmt_ — i 'modality
Ti / 2 <sup>—</sup>5 exemplary, a suitable value for 2 was found to be 10.
Condition Assessment 2
The second condition is related to that the energy in the candidate band must have a certain relation with an energy of neighboring bands in the second region. Herein this relationship is expressed as that the candidate band must have a relatively high energy compared to neighboring bands in the second region.
An example of how to assess compliance with condition 2 is to compare the logarithmic energy of the candidate band with the average logarithmic energy of the entire second region, eg high band. First, the average logarithmic energy of the second region can be defined as:
Then an expression for condition 2 can be formulated as:
where
T<sub>2</sub> indicates the logarithmic energy threshold for passing condition 2. Equivalently, as for condition 1, this can be formulated in the energy domain in
ΙΜΡΙ<sup>Λ</sup>
INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL instead of the logarithmic domain, see equation (6), if this is beneficial from an aspect of computational complexity. In an exemplary embodiment, a suitable value for y was found to be 3. As an alternative to using the average logarithmic energy of the entire second region, only parts of the second region can be used, for example, a number of bands surrounding the candidate band.
Condition Assessment 3
The third condition relates to the condition if an available number of bits is sufficient to encode at least one non-peak segment of the first region and the band in the second region. Otherwise the band in the second region should not be encoded. Condition 3 relates to a directed encoding method, indicated as the second encoding method above, which is a gain-form encoding. The general directed VQ for the Encoded LF region, i.e. the non-peak parts of the first region, according to one embodiment, is configured to also cover selected bands in the second region, eg high frequency region . However, because the first region, typically a low-frequency region, is sensitive to encoding the MDCT domain, you must ensure that some resources, bits, are allocated to encode at least part of this range of frequency. Because the
IMPI é
INSTITUTO MEXICANO Y, ΟΪ The noetSOAD sncustrial pyramid vector quantizer (PVQ) is intended for the encoding of non-peak parts of the first region (see LF Encoded in Figures 2a and 2b) operates on an object spectrum divided into bands, This requirement is met by ensuring that at least one band is assigned for the first region, that is:
Nhancla ^ 1 (10) where N<sub>band</sub> indicates the number of bands in the target signal for the LF Coded portion. These bands are not the same type of band as the bands in the second region. Here, band N<sub>banba </sub>it is a band with a width determined by the encoder and the band comprises a part of the first region that is not encoded by a peak encoding method.
In case there are enough bits available to encode at least a non-peak part of the first region and a selected band, which meets the conditions 1-2 above, the selected band can be encoded together with at least a part that is not peak of the first region when using the second encoding method (shape gain). Another useful condition to avoid wasting resources is to make sure that the bit rate for the selected band is high enough to represent the band with acceptable quality. If not, the bits spent to encode the selected band will be wasted and may be better
<td></td><td><sup>24</sup>MEXICAN INSTITUTE F * Λ ''<sup>1</sup>»/! OF PROPERTY C -i * INDUSTRIAL</td>
<td>spend them to</td><td>further encode the low frequency part of the</td>
<td>first region</td><td>(see LF plus Codified in figure 2a) In a</td>
In exemplary mode, the encoding of a non-peak portion of the first region is handled using PVQ, which has an explicit relationship between the number of pulses, vector length, and the required bit rate defined by the pulses function of
<td>2bits (Wj, P<sub>min</sub>) ,</td><td>where Wj indicates the bandwidth of the band</td>
selected and P<sub>m</sub>i<sub>n</sub> is the minimum number of pulses to be represented. Assume Bútima indicates the number of bits assigned for the last band in the object vector for the PVQ encoder, so the condition to avoid wasting resources can be written as:
Búitima> 2-bit pulses (Wj, P<sub>min</sub>) (11)
The minimum number of pulses P<sub>m</sub>i<sub>n</sub> it is a fit parameter, but it must be at least P ~ i-M. Equations (10) and (11) together satisfy condition 3 in an exemplary mode.
A novel part of the modalities described herein is a decision logic for evaluating whether to band encode in a BWE region or not. Here, the BWE region means a region, defined, for example, in frequency, in which an encoder without the functionality suggested herein may have undergone BWE. For example, the BWE region could be frequencies over 5, 6 kHz, or over 8 kHz.
The exemplary modalities described above
MEXICAN INSTITUTE '
MEXICAN INSTITUTE OF INDUSTRIAL ΜΙΟΝΕΟΑΟ
<img file="MX353200B_D0021.tif" />
they suggest a structure where the so-called low band is encoded and the so-called high band extends from the low band. The terms low band and high band refer to parts of a frequency spectrum that is divided into a certain frequency. That is, a frequency spectrum divided into a lower part, a low band and an upper part, a high band at a certain frequency, for example, 5, 6 or 8 kHz. However, the solution described herein is not limited to such frequency division, but can also be applied to other coded and uncoded, i.e. calculated region distributions, where the coded and calculated regions or parts are decided, for example , based on a priori knowledge about the source and a perceptual importance of the signal at hand.
An exemplary embodiment of a method for encoding an audio signal comprises receiving an audio signal and further analyzing at least a portion of the audio signal. The method further comprises determining, based on the analysis, whether to encode a high band region of a frequency spectrum of the audio signal together with a low band region of the frequency spectrum. The exemplary method further comprises encoding the audio signal for transmission over a link in a communication network based on determining the decision to encode the high band region.
The analysis described above can also be performed on the encoders.
Replace them with
IMPIOUS
MEXICAN INSTITOT oe LA nCHKQAD
INDVSTNAL
<img file="MX353200B_D0022.tif" />
quantized and reconstructed parameters in the logarithmic energies E (j) in this case their quantized counterparts É (j) in the and the peak gains G (m) can be replaced with
Using the quantized parameters allows the method described above to be implemented in the same way in the encoder and the corresponding decoder, since the quantized parameters are available to both. That is, the method described above is also performed on the decoder, in order to determine how to decode and reconstruct the audio signal. The benefit of this configuration is that no additional information needs to be carried from the encoder to the decoder, indicating whether or not a band in the second region was encoded. A solution where the information is carried, indicating whether a band in the second region is encoded or not, is also possible.
A method for decoding an audio signal corresponding to the method for encoding an audio signal described above will be described below. As in the above, a frequency spectrum of the audio signal is divided into at least a first and second region, where at least the second region comprises a number of bands and where the spectral peaks in the first region are decoded at use a first encoding method. The method, which will be performed by
IMPIOS
MEXICAN INSTITUTE
DS LA RPOritUAP j.
INDUSTRIAL —a decoder comprises, for a segment of the audio signal: determining a relationship between an energy of a band in the second region and an energy calculation of the first region; determining a relationship between the energy of the band in the second region and an energy of neighboring bands in the second region; determine if an available number of bits is sufficient to encode at least one non-peak segment of the first region and the band in the second region. The method further comprises: when the relations meet a respective predetermined criterion (304) and the number of bits is sufficient:
decoding a band in the second region and at least one segment of the first region using a second encoding method; and in another way
-reconstruct the band in the second region based on the BWE or noise fill.
Implementations
The method and techniques described above can be implemented in encoders and / or decoders, which can be part of, for example, communication devices.
Encoder, Figures 5a-5c
An exemplary embodiment of an encoder is illustrated generally in Figure 5a. By encoder it refers to an encoder configured for encoding audio signals.
<img file="MX353200B_D0023.tif" />
The encoder could also possibly — phthata encode other types of signals. Encoder 500 is configured to perform at least one of the method modalities described above with reference to, for example, Figure 3. Encoder 500 is associated with the same features, objects, and technical advantages as method modalities previously described. The encoder can be configured to be compatible with one or more audio encoding standards. The encoder will be described shortly in order to avoid unnecessary repetition.
The encoder can be implemented and / or described as follows:
Encoder 500 is configured to encode an audio signal, where a frequency spectrum of the audio signal is divided into at least a first and a second region, where at least the second region comprises a number of bands and where the Spectral peaks in the first region are encoded by a first encoding method. Encoder 500 comprises processing circuitry, or processing means 501 and a communication interface 502. Processing circuitry 501 is configured to cause encoder 500, for a segment of the audio signal: to determine a relationship between an energy of a band in the second region and an energy calculation of the first region. The processing circuitry 501 is further configured to cause the
<img file="MX353200B_D0024.tif" />
INSTITUTO MEXICAN-: DE LA PROntOAt »INDUSTRIAL
<img file="MX353200B_D0025.tif" />
encoder determine a relationship between the band energy
- * ^ · Ί · ΜΒΜΤ in the second region and an energy of neighboring bands in the second region. The processing circuitry 501 is further configured to cause the encoder to determine if an available number of bits is sufficient to encode at least one non-peak segment of the first region and the band in the second region. The processing circuitry 501 is further configured to cause the encoder, when the relationships meet a respective predetermined criterion and the number of bits is sufficient, to encode the band in the second region and at least one segment of the first region using a second method. coding. Conversely, when at least one of the relationships does not meet the predetermined criterion and / or when the number of bits is not sufficient, the band in the second region is subjected to BWE or noise stuffing. The communication interface 502, which may also be indicated as, for example, the Input / Output (I / O) interface, includes an interface for sending data to and receiving data from other entities or modules.
Processing circuitry 501 could, as illustrated in FIG. 5b, comprise processing means, such as a processor 503, for example, a CPU and memory 504 for storing or maintaining instructions. The memory may then comprise instructions, for example, in the form of a computer program 505, which when executed by the processing means 503 causes the encoder 500 to perform the
IMPI
ΙΝ.νΤΠΆιΤΌ MEXICANO DE LA W.OFíMUD jndustual actions described above.
An alternative implementation of the processing circuitry 501 is shown in Figure 5c. Here, the processing circuitry comprises a first determination unit 506, configured to cause encoder 500: to determine a relationship between an energy of a band in the second region and an energy calculation of the first region. The processing circuitry further comprises a second unit.
507 of determination configured to cause the encoder to determine a relationship between the energy of the band in the second region and an energy of neighboring bands in the second region. The processing circuitry further comprises a third unit.
508 Determination, configured to cause the encoder to determine if an available number of bits is sufficient to encode at least one non-peak segment of the first region and the band in the second region. The processing circuitry 501 further comprises an encoding unit, configured to cause the encoder, when the relationships meet a respective predetermined criterion and the number of bits is sufficient, to encode the band in the second region and at least a segment of the first region when using a second encoding method. The processing circuitry 501 could comprise more units, such as a decision unit configured to cause the encoder to decide whether the determined relationships meet the criteria or not. This
<img file="MX353200B_D0026.tif" />
task could be done
<img file="MX353200B_D0027.tif" />
Mexican iwrmrrü LA PROMEÍMD • 'NDUSTUAL alternatively by one o
<img file="MX353200B_D0028.tif" />
more than the other units.
<img file="MX353200B_D0029.tif" />
The encoders, or codees, described above could be configured for the different modalities of the method described herein, such as using different gain shape encoding methods as the second encoding method; different peak encoding methods to encode the peaks in the first region, operate in different transform domains, etc.
It can be assumed that encoder 500 comprises additional functionality to perform regular encoder functions.
Figure 6 illustrates one embodiment of an encoder.
An audio signal is received and the bands from a first region, typically the low frequency region, are encoded. Also, at least one band from a second region, typically, the high frequency region, unique to the first region, is encoded. Depending on the conditions discussed further above, it can be decided whether the encoding of the band in the second region is included in the final encoded signal or not. The final encoded signal is typically provided to a receiving part, where the encoded signal is decoded into an audio signal. The UE or network node may also include radio circuitry for communication with one or more nodes, including transmitting and / or receiving information.
<td></td><td>IMPI MEXICAN INSTITUTE f -, - * · '· - DE LA FROrtEDAD</td>
<td>In the following, it will be described</td><td>INDUSTRIAL an example of a</td>
computer implementation with reference to figure 7. The encoder comprises processing circuitry such as one or more processors and a memory. In this particular example, in at least some of the stages, the functions, procedures, modules, and / or blocks described herein are implemented in a computer program, which is loaded into memory to be executed by the processing circuitry. The processing circuitry and memory interconnect with each other to allow normal software execution. An optional input / output device can also be interfaced with the processing circuitry and / or memory to allow input and / or output of relevant data such as input parameters and / or resulting output parameters. Alternatively, an encoder could be implemented using function modules, as illustrated in Figure 8.
An exemplary embodiment of an encoder for encoding an audio signal could be described as follows:
The encoder comprises a processor; and a memory for storing instructions that, when executed by the processor, cause the encoder to: receive an audio signal; analyze at least a portion of the audio signal; y: Based on the analysis, determine whether to encode a high band region of an audio signal frequency spectrum along with
<td></td><td>IMPI ^ MEXICAN INSTITUTE V ,. -U-'i FROM THE PFOflEDAL) V. INDUSTRIAL</td>
<td>a</td><td>low band region of the frequency spectrum; plus:</td>
Based on the decision whether to encode the highband region, encode the audio signal for transmission over a link in a communication network.
The encoder could be understood in a user equipment for operation in a wireless communication network.
The term computer should be interpreted in a general sense as any system or device capable of executing program code or computer program instructions to perform a particular computation, determination or processing task.
In a particular embodiment, the computer program comprises instructions, which when executed by at least one processor, cause the processor to encode the bands of a first frequency region, to encode at least one band of a second region and, depending on the specific conditions, deciding whether the band encoding in the second region will be included in the final encoded signal or not.
It will be appreciated that the methods and devices described herein can be combined and rearranged in a variety of ways. For example, the modalities may be implemented in hardware, or in software to be executed by suitable processing circuitry, or a combination thereof.
The stages, functions, procedures, modules and / or blocks described herein can be implemented in hardware
<img file="MX353200B_D0030.tif" />
MEXICAN INSTITUTE OF THE PF.OMEQAD 'NDUSTNAL
<img file="MX353200B_D0031.tif" />
using any discrete circuit technology or conventional technology<sub>r</sub> such as integrated circuitry, including both general-purpose electronic circuitry and application-specific circuitry.
Particular examples include one or more suitably configured digital signal processors and other known electronic circuits, eg, discrete logic gates interconnected to perform a specialized function, or Application Specific Integrated Circuits (ASICs).
Alternatively, at least some of the steps, functions, procedures, modules, and / or blocks described herein may be implemented in software such as a computer program to be executed by suitable processing circuitry such as one or more processors or processing units.
The flow diagram or diagrams presented herein, therefore, can be considered as a computer flow diagram or diagrams, when performed by one or more processors. A corresponding apparatus can be defined as a group of function modules, where each step performed by the processor corresponds to a function module. In this case, the function modules are implemented as a computer program that runs on the processor.
It should also be noted that in some
<td></td><td></td>
INSTITUTE ΜΕΧΧΑΝΟ Ϋ <- <sub>Λ</sub> Z; FROM THE PROPERTY 'j * ιΑ <Κ<sup>Γ</sup> alternative implementations, functions / adTO?<sup>R</sup>^ hení * terrraaos in blocks may occur outside the eiiden indicaelO<sup>l</sup>errt<sup>:</sup>TO · * flow charts. For example, two blocks displayed in succession may, in fact, run substantially concurrently, or the blocks may sometimes run in reverse order, depending on the functionality / acts involved. Furthermore, the functionality of a given block of flowcharts and / or block diagrams can be separated into multiple blocks and / or the functionality of two or more blocks of flowcharts and / or block diagrams can at least be partially integrate. Finally, other blocks can be added / inserted between the blocks shown and / or the blocks / operations can be omitted without departing from the scope of the inventive concepts.
It should be understood that the choice of interaction units, as well as the name of the units within this description are for exemplary purposes only, and exemplary nodes for executing any of the methods described above can be configured in a plurality of alternative ways. in order for them to be able to perform the suggested procedural actions.
It should also be noted that the units described in this description should be considered as logical entities and not necessarily as separate physical entities.
Examples of the processing circuitry include, but are not limited to,
IMPI
INSTITUTO MEXICANO UE LA PPOMIDAt »! N» liSTWAL
<img file="MX353200B_D0032.tif" />
one or more microprocessors, one or more Digital Signal Processors, DSP; one or more Units
Processing Centers, CPUs, video acceleration hardware and / or any suitable programmable logic circuitry such as one or more FPGA Field Programmable Gate Arrangements, or one or more Programmable Logic Controllers, PLCs.
It should also be understood that it may be possible to reuse the general processing capabilities of any conventional device or unit in which the proposed technology is implemented. It may also be possible to reuse existing software, for example, by reprogramming existing software or by adding new software components.
The proposed technology provides a useful encoder in a UE or a network node configured to encode audio signals, where the encoder is configured to perform the necessary functions.
In a particular example, the encoder comprises a processor and a memory, the memory comprises instructions executable by the processor, whereby the apparatus / processor is operative to perform the encoding and decision steps.
The proposed technology also provides a carrier comprising the computer program, wherein the carrier is one of an electronic signal, an optical signal, an electromagnetic signal, a magnetic signal, a signal
IMPIf r / STTTtJTO MEXICANO rR LA FROflEDAÚ electrical, a radio signal, a microwave signal ^^ 'a
<img file="MX353200B_D0033.tif" />
computer readable storage.
In this way, the computer software or program can be made as a computer program product, which is normally carried or stored on a computer readable medium. The computer-readable medium may include one or more removable or non-removable memory devices that include, but are not limited to: a Read Only Memory, ROM, a Random Access Memory, RAM, a Compact Disc, CD, a Disc Versatile Digital, DVD, Blueray disk, Universal Serial Bus, USB, memory, Hard Disk Drive, HDD Storage Device, flash memory, magnetic tape or any other conventional memory device. In this way, the computer program can be loaded into the operating memory of a computer or equivalent processing device for execution by the processing circuitry thereof. That is, the software could be carried by a carrier, such as an electronic signal, an optical signal, a radio signal, or a computer-readable storage medium before and / or during the use of the computer program at network nodes. .
For example, the memory-stored computer program includes program instructions executable by the processing circuitry, whereby the processing circuitry is capable or operative to execute the steps,
<img file="MX353200B_D0034.tif" />
MEXICAN INSTITUTE
DELA P1C-HEDAP INDUSTRIAL the functions, procedures and / or blocks described above. In this way, the encoder is configured to perform, when executed by the computer program, well-defined processing tasks such as those described herein. The computer or processing circuitry need not only be dedicated to executing the steps, functions, procedures and / or blocks described above, but may also perform other tasks.
As indicated herein, the encoder may alternatively be defined as a group of function modules, where the function modules are implemented as a computer program running on at least one processor. Figure 8 is a schematic block diagram illustrating an example of an encoder comprising a processor and associated memory. In this way, the memory-resident computer program can be organized as appropriate function modules configured to perform, when executed by the processor, at least part of the steps and / or tasks described herein. An example of such function modules is illustrated in Figure 6.
Figure 8 is a schematic block diagram illustrating an example of an encoder comprising a group of function modules.
The modalities described in the above are
IMPI
INSTITUTC MEXICANO ΠΕ VA rtCFI t.DAD INDUSTRIAL are provided as examples only and it should be understood that the 'proposed technology is not limited thereto. It will be understood by those skilled in the art that various modifications, combinations, and changes can be made to modalities 5 without departing from the present scope as defined by the appended claims, in particular, different partial solutions in the different modalities may be combined in other configurations, when technically possible.
<img file="MX353200B_D0035.tif" />
<img file="MX353200B_D0036.tif" />
<img file="MX353200B_D0037.tif" />
IMPI ^
MEXICAN INSTITUTE / pe ia moruoAO
SNPUSTIUAl. * · '----- 40
Contents38
46 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46
47 members in 12 offices
Priority claims9
| Document | Office | Kind | Date |
|---|---|---|---|
| 201461953331 | United States of America | P | |
| 201461953331 | United States of America | P | |
| 61953331 | United States of America | – | |
| 2015055306 | European Patent Office (EPO) | W | |
| 2015055306 | European Patent Office (EPO) | W | |
| 61953331 | – | – | – |
| PCTEP2015055306 | – | – | – |
| US201461953331P | – | – | – |
| WO2015EP55306 | – | – | – |
Members47
| Document | Office | Kind | |
|---|---|---|---|
| WO2015136078A1 | World Intellectual Property Organization (WIPO) | A1 | |
| AR099761A1 | Argentina | A1 | |
| US2016254004A1 | United States of America | A1 | |
| IL247337A0 | Israel | A0 | |
| IL247337D0 | Israel | D0 | |
| MX2016011328A | Mexico | A | |
| CN106104685A | China | A | |
| EP3117432A1 | European Patent Office (EPO) | A1 | |
| BR112016020988A2 | Brazil | A2 | |
| US9741349B2 | United States of America | B2 | |
| US2017316788A1 | United States of America | A1 | |
| MX353200BThis record | Mexico | B | |
| US10147435B2 | United States of America | B2 | |
| US2019057707A1 | United States of America | A1 | |
| AR110293A2 | Argentina | A2 | |
| EP3117432B1 | European Patent Office (EPO) | B1 | |
| IL265424A | Israel | A | |
| TR2019007596T4 | Türkiye | T4 | |
| TR201907596T4 | Türkiye | T4 | |
| EP3518237A1 | European Patent Office (EPO) | A1 | |
| IL265424B | Israel | B | |
| IL268543A | Israel | A | |
| PL3117432T3 | Poland | T3 | |
| MX369614B | Mexico | B | |
| CN106104685B | China | B | |
| CN110619884A | China | A | |
| MX2019012777A | Mexico | A | |
| US10553227B2 | United States of America | B2 | |
| ES2741506T3 | Spain | T3 | |
| CN110808056A | China | A | |
| IL268543B | Israel | B | |
| US2020126573A1 | United States of America | A1 | |
| BR112016020988A8 | Brazil | A8 | |
| BR112016020988B1 | Brazil | B1 | |
| EP3518237B1 | European Patent Office (EPO) | B1 | |
| DK3518237T3 | Denmark | T3 | |
| ES2930366T3 | Spain | T3 | |
| EP4109445A1 | European Patent Office (EPO) | A1 | |
| CN110619884B | China | B | |
| CN110808056B | China | B | |
| EP4109445B1 | European Patent Office (EPO) | B1 | |
| EP4109445C0 | European Patent Office (EPO) | C0 | |
| EP4465296A2 | European Patent Office (EPO) | A2 | |
| EP4465296A3 | European Patent Office (EPO) | A3 | |
| ES2995635T3 | Spain | T3 | |
| US12236967B2 | United States of America | B2 | |
| US2025201254A1 | United States of America | A1 |
1 legal event, as the office reported them to INPADOC
Events
| Event | Code | |
|---|---|---|
| Grant or registrationFG | FG |
Numbers
- Publication
- 353200
- Publication, DOCDB
- 353200
- Publication, EPODOC
- MX353200
- Application
- 2016011328
- Application, DOCDB
- 2016011328
- Application, EPODOC
- MX20160011328
Titles2
- Spanish
- MÉTODO Y APARATO DE CODIFICACIÓN DE AUDIO.
- English
- AUDIO CODING METHOD AND APPARATUS.
Classification
- CPC, 11
- G10L19/0204
- G10L19/028
- G10L25/51
- G10L19/002
- G10L19/18
- G10L25/21
- G10L19/02
- G10L19/038
- G10L25/06
- G10L25/18
- H04L2012/5632
- IPC, 9
- G10L25 51
- G10L19 00
- G10L19 002
- G10L19 02
- G10L19 18
- G10L19 028
- G10L19 038
- G10L25 06
- G10L25 21