Apparatus, method and corresponding computer program for generating an error concealment signal using an adaptive noise estimation.

(54) Title: APPARATUS AND METHOD TO GENERATE AN ERROR HIDDEN SIGNAL USING A

ADAPTIVE ESTIMATION OF NOISE.

(54) Title: APPARATUS, METHOD AND CORRESPONDING COMPUTER PROGRAM FOR GENERATING AN ERROR CONCEALMENT SIGNAL USING AN ADAPTIVE NOISE ESTIMATION.

(57) Summary

An apparatus for generating an error concealment signal comprises: an LPC representation generator (100) for generating a substitute LPC representation; an LPC synthesizer (106, 108) for filtering codebook information using the substitute LPC representation; and a noise estimator (206) to estimate a noise calculation during reception of correct audio frames, where the noise estimate is based on the correct audio frame representation generator (100) that is configured to use the estimate of noise estimated by the noise estimator (206) when generating the substitute LPC representation.

(57) Abstract

An apparatus for generating an error concealment signal, comprises: an LPC representation generator (100) for generating a replacement LPC representation; an LPC synthesizer (106,108) for filtering a codebook Information using the replacement LPC representation; and a noise estimator (206) for estimating a noise estimate during a reception of good audio trames, where the noise estimate depends on the good audio trames representation generator (100) is configured to use the noise estimate estimated by the noise estimator (206) in generating the replacement LPC representation.

' "•'"'tea·

IMPI

PATENT TITLE No. 357495

Headlines):

Home:

Denomination:

Classification:

Inventor (s):

FRAUNHOFER-GESELLSCHAFT FORSCHUNG EV

ZUR FORDERUNG DER ANGEWANDTEN

Hansastrasse 27c, 80686, Munich, GERMANY

APPARATUS AND METHOD FOR GENERATING AN ERROR HIDDEN SIGNAL USING AN ADAPTIVE NOISE ESTIMATE.

CIP:

CPC:

gioli9 / oo £; GaoLiqroe v ·

G10L19 / 005; 'G10L19 / 06; G10L19 / 0Í8 / G WL2019 / 0002; JÉRÉMfe Ü ^ COMIg RAÍPH $ PERSCHNEIDER; MANUEL₍ , 'w ^¿· * Ή.

Jí /

MICHAEL SCHNABEL JANDER

<td>Number:</td><td></td>

<td>MX / a / 2016/012004</td><td></td>

<td></td><td> *</td>

<td>Country:</td><td> ·/</td>

<td>EP</td><td> ··- *4 „</td>

<td>EP</td><td></td>

<td>EP</td><td>c 1-</td>

Validity: Twenty years

Date of VKecilhientejs 4; de ^ na¿z0 de 2035 Issue Date:

ulos'1 °

-η

<img file="MX357495B_D0001.tif" />

'4''···:':--.

Number:

EP14160774

14167003.4

14178761.4

The patent of reference «Uk¿Ster | a with fundame # 6kejtos. ^ Í¿os'1 °, 2Í jpSS detaj.eyde la propupfeá Industrial

In accordance with the article apee the Law ^ Ja Rtgpied ^ n AMq ^ HpÜÓnte pátentjJdíí} ^ as of the filing date ^ on request ¡nterinaeiopá ^ y estgjá sqjeta i pegetltílalanfa. I j hSeetófuná ^ iertto-enlo (D-íLP) '$ 7 / (¡6/1991, retel una Titgejj ^ B de vein £ añ £ »non-extendable, counted to have current JBs rights.

Who subscribes to this title (Official Gazette of the Federation 25/01/2006, 06/05 / 2009,06 / 01/2010, Regulations of the Mexican Institute of lop'á'rticul® 6 'ftaecionM III ¡pf'Airí 'To the Industrial Property Law 994, ¿/ 1 (ΛΜ% 26/12 / ^ 9 ?,' W95 / 1999, 01/26/2004, 06/16/2005, dlaíuestd.

W '*¹'-'-' - ^ rmsea el ¡B10.2p / 06fffit0, ÍW (M / y 12 γ'Ο &amp; ΟΛβΟ '^ ΙιβιΙΙΚιίβΠ⁰, 3 * fracete »* V irfpso a), 4th and 12th fractions I and III of the id Ingustfel (ÜO.W-á &lt;l¿Üttfc - '' l? Formjste-el 01fl» ME «¿&gt; ffO7 / 2OO4 , 07/28/2004 and 09/07/2007);

articles 1, 3, 4, 5, section V, subsection a), tf # fl »

12/27/1999, amended on 10/10/2002, 07/29/200 ^ (^ 4 ^ 6 ^^^^^, - ,, ^.

Deputy Generals, Coordinator, Directors Divwo ^^. JMLSJtffe.j.de'las'rQfii — _ Departmentals and other subordinates of the Instituto Mexicano de la í ^ íteijMtf ^ fcstriat 04/08/2004 and 13/09/2007) '' * 'uto Orgt) fgCJnsjfíutq ^ / lexicon of Industrial Property (DOF iojürtrel Agreement that delegates powers to the Divisional Deputy Directors Directors, Coordinators 12/15/1999, amended on 02/04/2000, 07/29/2004,

This letter is signed with an advanced electronic sig nature (FIEL), based on articles 7 BIS 2 of the Industrial Property Law; 3 of its Regulations, and 1 fraction III, 2 fraction V, 26 BIS and 26 TER of the Agreement establishing the guidelines for the use of the Electronic Payment and Services Portal (PASE) of the Mexican Institute of Industrial Property, in the procedures indicated.

<img file="MX357495B_D0002.tif" />

DIVISIONAL DIRECTOR OF PATENTS NAHANNY CANAL REYES

I Original Chain:

. · J NAHANNY MARISOL CANAL REYES | 00001000000403252793 | Tax Administration Service695 || MX / 2018/58479 | MX / a / 2016/012004, Patent title PCT | 1220 | RRGO | Page (s) | IO7ifKrE R1 BQA8KdLoz6 + UChSKg = i

Digital stamp:

cdS0¡Nzi / K4YQOw¡GRQu4q7nZloqHOk / l9riB97fv / QsvknzvlYtLP5sfs6paCIVr5 * 5Vj8rixvx1zEe2OzM1NIOix 9Rb7cUW27pRyP¡r1l1bHjBv / sFjlgTZGs5s6c3Vw5pUKQ7ILplDMjyogOJHdOo93tBzplEMPXabn7¡zUIZr4NenCAg WmSaghJE¡13Z8egrTnc + 5yAuJEqGZcr15obikGeleuUM / 0A / rijPik + mxDiFL + Wceq8F8a1NzEw1Or1qjAsXSKptAT mAa7MzlDMSaN6Pw¡OYpk8BNWPFMYYWS9PfWCaCLQ7kxAWMTm1OnubgDDXWIUgEG2ePcumoxA ==

Sand! No. 5&gt;. Floor 1. Santa María Tepepan Town. Xochimilco, 16020, Mexico City,

Í56I53340700 www gob.mx/impi

<img file="MX357495B_D0003.tif" />

W5

Po / 6/7 s&gt; oo Ϋ

IMPI

<img file="MX357495B_D0004.tif" />

MEXICAN INSTITUTE OF PROPERTY

... '_____ ~ INDUSTRIAL —a_

APPARATUS AND METHOD TO GENERATE A HIDDEN SIGNAL OF

ERROR USING AN ADAPTATIVE NOISE ESTIMATE

Descriptive memory

The present invention relates to audio encoding and, in particular, to audio encoding based on LPC-type processing in the context of codebooks.

Audio perceptual encoders often use linear predictive coding (LPC) to model the human vocal tract and to reduce the amount of redundancy, which can be modeled by LPC parameters. The residual LPC, which is obtained by filtering the input signal with the LPC filter, is itself modeled and transmitted by its representation by one, two or more codebooks (examples are: adaptive codebook, codebook pulse rate, innovative codebook, transition codebook, hybrid codebook consisting of predictive and transformation parts).

<img file="MX357495B_D0005.tif" />

i Ni ΡI

MEXICAN INSTITUTE

OF THE PROPERTY

INDUSTRIAL

In the event of a frame loss, a segment of the voice / audio data is lost (typically 10 ms or 20 ms). To make this loss as audible as possible, various concealment techniques are applied. These techniques usually consist of the extrapolation of the previous data received. These data can be: codebook gains, codebook vectors, parameters for modeling codebooks and coefficients of

LPC. In all concealment technology known in the state of the art, the LPC coefficient series, which is used for signal synthesis, is repeated (based on the last known series) or extrapolated / interpolated.

ITU G.718 [1]: LPC parameters (represented in the ISF domain) are extrapolated during concealment. The extrapolation consists of two steps. First, a long-term ISF vector is calculated. This long-term ISF vector is a weighted average (with the fixed weight factor beta) or • a vector of

ISF representing the average of the last three known ISF vectors and

IMPI • an ISF vector learned offline,

Mexican Institute of Industrial Property

<img file="MX357495B_D0006.tif" />

What does a long-term average spectral shape represent?

This target long-term ISF vector is then interpolated with the last correctly received ISF vector per frame using a variable factor in time alpha to

<td>allow a</td><td>attenuation</td><td colspan="2">crusade of</td><td colspan="2">last vector</td><td>from ISF</td>

<td>received at</td><td>vector of</td><td>ISF</td><td colspan="3">long-term</td><td>destination.</td>

<td>Then</td><td colspan="2">becomes the</td><td>vector</td><td>of</td><td>ISF well</td><td>obtained</td>

<td>back to</td><td>domain of</td><td>the</td><td>LPC, to</td><td>end</td><td colspan="2">generate steps</td>

<td>intermediate</td><td>(the ISFs</td><td>I know</td><td colspan="2">transmit</td><td>every 20</td><td>ms, the</td>

<td>interpolation</td><td>generates a</td><td>Serie</td><td colspan="3">LPCs every 5 ms).</td><td>Then it</td>

<td>use the</td><td>LPCs for</td><td colspan="2">synthesize</td><td>the</td><td>signal of</td><td>departure</td>

<td>filtering the</td><td>result of</td><td>the</td><td>sum of</td><td>the</td><td>books of</td><td>codes</td>

<td>adaptive</td><td>and fixed,</td><td>than</td><td>I know</td><td colspan="3">amplify with</td>

Corresponding codebook earnings before addition. The fixed codebook contains noise during concealment. In the event of loss of consecutive frames, the adaptive codebook is fed back without adding the fixed codebook. On the other hand, the summed signal can be fed back, as is done in AMR-WB [5].

IMPI

<img file="MX357495B_D0007.tif" />

MEXICAN INSTITUTE OF PROPERTY _ _r „. , INDUSTRIAL --- In [2], a concealment scheme is described that uses two series of LPC coefficients. A series of 3e LPC coefficients is derived on the basis of the last received correct frame, the other set of LPC parameters is derived on the basis of the first received correct frame, although it is assumed that the signal evolves in the reverse direction (towards last). The prediction is then run in two directions, one into the future and one into the past. Therefore, two representations of the missing frame are generated. Finally, both signals are weighted and averaged before playback.

Fig. 8 illustrates error concealment processing in accordance with the prior art. An adaptive codebook 800 transmits an adaptive codebook information to an amplifier 808 that applies a codebook gain g_p to the information sent by the adaptive codebook 800. The output of the amplifier 808 is connected to an input of a combiner 810. In addition, a random noise generator 804 together with a fixed codebook 802 transfers information from the codebook to another amplifier g_c. The amplifier g_c indicated in 806 applies the gain factor g_cwhich is book profit

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0008.tif" />

fixed codebook, to the information provided by the fixed codebook 802 together with the random noise generator 804. The output of the amplifier 806 is then also sent to the combiner 810. The combiner 810 adds the result of both amplified codebooks by the corresponding codebook gains to obtain a merge signal which is then sent to an LPC 814 synthesis block. The LPC 814 synthesis block is controlled by the surrogate representation that is generated in the manner described above.

This prior art procedure has certain disadvantages.

To cope with the changing characteristics of the signal so that the LPC envelope converges towards background noise type properties, the LPC is changed during concealment by extra / interpolation with other vector vectors.

LPC. There is no possibility to precisely control energy during concealment. While there is the possibility of controlling the codebook gains of the various codebooks, the LPC implicitly influences the level or the total energy (even the frequency dependent one).

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0009.tif" />

Gradual attenuation to a given energy level (eg, background noise level) could be envisioned during burst frame loss. This is not possible in the state-of-the-art technology, not even by controlling the codebook gains.

It is not possible to attenuate the noisy parts of the signal to background noise, while maintaining the ability to synthesize the tonal parts with the same spectral property as before frame loss.

An objective of the present invention is to disclose an improved concept for generating an error concealment signal.

This objective is achieved by means of an apparatus for generating an error concealment signal according to claim 1, a method for generating an error concealment signal according to claim 14 or a computer program according to claim

15.

IMPI

MEXICAN PROPERTY INSTm'TO

INDUSTRIAL

<img file="MX357495B_D0010.tif" />

In one aspect of the present invention, the apparatus for generating an error concealment signal comprises an LPC representation generator for generating a first substitute LPC representation and a different second substitute LPC representation. In addition, an LPC synthesizer is included to filter a first codebook information using the first surrogate LPC representation to obtain a first surrogate signal and to filter a different second codebook information using the second surrogate LPC representation to obtain a second surrogate signal. The outputs of the LPC synthesizer are combined by means of a substitute signal combiner combining the first substitute signal and the second substitute signal to obtain the error concealment signal.

The first codebook is preferably an adaptive codebook to produce the first codebook information and the second codebook preferably in the form of a codebook to produce the second codebook information. In other words, the first codebook represents the tonal part of the signal and the second codebook or fixed codebook ΐΜρη

MEXICAN INSTITUTE ». . ,.,,. M PROPERTY 1 represents the noisy part of the signal and by 'Í^l»STW« cannot consider a noise codebook.

The first codebook information for the adaptive codebook is generated using an average value of the last correct LPC representations, the last correct representation, and an attenuation value. Furthermore, the LPC representation for the second codebook or fixed codebook is generated using the attenuation value of the last LPC representation and a noise estimate. Depending on the implementation, the noise estimate may be a fixed value, an offline learned value, or it may be adaptively derived from a signal that precedes an error concealment situation.

Preferably, an LPC gain calculation is run to calculate the influence of a surrogate LPC representation, and then this information is used to make a compensation so that the power or loudness, or usually a measure related to amplitude, of the synthesis is similar to the corresponding synthesis signal prior to the error concealment operation.

<img file="MX357495B_D0011.tif" />

<img file="MX357495B_D0012.tif" />

IMPI

MEXICAN INSTITUTE M INDUSTRIAL PROPERTY

In a further aspect, an apparatus for generating an error concealment signal comprises an LPC representation generator for generating one or more substitute LPC representations. In addition, the profit calculator is included to calculate the profit information from the LPC representation and then a compensator is also included to compensate for the gain influence of the substitute LPC representation and this profit compensation operates using the operation of profit provided by the profit calculator. An LPC synthesizer then filters a codebook information using the substitute LPC representation to obtain the error concealment signal, where the compensator is configured to weight the codebook information prior to its synthesis by the LPC synthesizer. or to weight the LPC synthesis output signal. In this way, any perceptible gain or influence related to power or amplitude is reduced or eliminated at the beginning of an error concealment situation.

This compensation is not only useful for representations of

Individual LPCs as noted in the previous aspect,

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0013.tif" />

it is also useful in the case of using only a single substitute LPC representation with a single LPC synthesizer.

The gain values ​​are determined by calculating the impulse responses of the last correct LPC representation and a surrogate LPC representation by calculating, in particular, an rms value over the impulse response of the corresponding LPC representation over a certain period which is between 3 and 8 ms and is preferably 5 ms.

In one implementation, the actual gain value is determined by dividing a new rms value, that is, an rms value corresponding to a substitute LPC representation, by an rms value of the correct LPC representation.

Preferably, the single or multiple surrogate LPC representation is calculated using a background noise estimate which is preferably a background noise estimate derived from the signals currently decoded as opposed to a noise estimate simply predetermined by a vector learned offline.

IMPI

MEXICAN INSTITUTE Di LA MONEDAD

INDUSTRIAL

<img file="MX357495B_D0014.tif" />

In another aspect, an apparatus for generating a signal comprises an LPC representation generator for generating one or more substitute LPC representations, and an LPC synthesizer for filtering codebook information using the substitute LPC representation. In addition, a noise estimator is presented to estimate a noise calculation during reception of correct audio frames, and this noise estimate is based on correct audio frames. The representation generator is configured to use the noise estimate estimated by the noise estimator when generating the surrogate LPC representation.

The spectral representation of a previous decoded signal is the process of producing a noise spectral representation or target representation. The noise spectral representation is converted to a noise LPC representation and the noise LPC representation is preferably the same type of LPC representation as the surrogate LPC representation. ISF vectors or LSF vectors are preferable for specific procedures related to LPC processing.

IMPI

MEXICAN INSTITUTE OF LA HRORIEDAD

<img file="MX357495B_D0015.tif" />

T, · · -,,. -. , INDUSTRIAL.

The estimation is derived using a minimal statistical technique with optimal smoothing from a previous decoded signal. This spectral noise estimate is then converted to a representation in the time domain. A Levinson-Durbin recursion recursion is then run using a first number of samples from the time domain representation, where the number of samples equals one order of LPC. The LPC coefficients are then derived from the result of the Levinson-Durbin recursion, and this result is ultimately transformed into a vector. The aspect of using individual LPC representations for individual codebooks, the aspect of using one or more gain compensated LPC representations, and the aspect of using a noise estimate in generating one or more representations of LPC, estimation that is not a vector learned offline but an estimation of noise derived from the previous decoded signal are aspects that can be used individually to obtain an improvement over the prior art.

Furthermore, these individual aspects can also be combined with each other so that, therefore,

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0016.tif" />

combining the first aspect and the second aspect or the first aspect can be combined or the third aspect can be combined or the second aspect and the third aspect can be combined with each other to give an improved efficiency with respect to the prior art. Even more preferably, the three aspects can be combined with each other to obtain improvements over the prior art. Therefore, although the aspects are described with separate figures, all the aspects can be applied in mutual combination, as can be seen with reference to the attached figures and the description.

The preferred embodiments of the present invention are described below with respect to the accompanying drawings, in which:

Fig. IA illustrates an embodiment of the first aspect;

Fig. IB illustrates the use of an adaptive codebook;

IMPI

<img file="MX357495B_D0017.tif" />

Fig. 1C

Fig. ID

Fig. 1E

Fig. 2 illustrates case of

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL _ the use of a fixed codebook in a normal mode or a stealth mode;

illustrates a flow chart for calculating the first surrogate LPC representation;

illustrates a flow chart of the calculation of the second surrogate LPC representation;

illustrates an overview of a decoder with error concealment controller and noise estimator;

Fig. 3 filters

Fig. 4

Fig. 5 illustrates a detailed representation of the synthesis ones;

illustrates a preferred embodiment that combines the first aspect and the second aspect;

illustrates another embodiment that combines the first and second aspects;

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0018.tif" />

Fig. 6 illustrates the embodiment that combines the first and second aspects;

Fig. 7A illustrates an embodiment of the execution of a gain compensation.

Fig. 7B illustrates a flow chart of the gain compensation run;

Fig. 8 illustrates a prior art error concealment signal generator;

illustrates a shape with the second gain;

performance compliance aspect with compensation

Fig. 10 illustrates embodiment of Fig.

other

9;

implementation of the way

Fig. 11 illustrates an embodiment of the third aspect using the noise estimator;

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0019.tif" />

Fig. 12A illustrates an implementation of noise estimation;

preferred calculation

Fig. 12B illustrates another preferred implementation of calculating the noise estimate and

Fig. 13 illustrates the calculation of a single representation of

Substitute LPCs or representations of individual substitute LPCs for individual codebooks using a noise estimate and applying a damping operation.

The preferred embodiments of the present invention relate to level control of the output signal by means of codebook gains independent of any gain changes caused by extrapolated LPC and to control the spectral shape modeled by LPC separately for each codebook. To this end, separate LPCs are applied by each codebook and compensation means are applied to compensate for any changes in the LPC gain during concealment.

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0020.tif" />

The embodiments of the present invention, defined in the different aspects or in the combined aspects, have the advantage of granting a subjective voice / audio quality in case one or more data packets are not received correctly or are not received. not at all on the decoder side.

Furthermore, the preferred embodiments compensate for the different gains between successive LPCs during concealment, which could arise as a result of the change in the LPC coefficients over time, and thus unintended level changes are avoided.

In addition, the embodiments are advantageous in that two or more sets of LPC coefficients are used during concealment to independently influence the spectral behavior of the voice and non-voice parts and also the tonal audio parts and noise.

All aspects of the present invention confer improved subjective audio quality.

<img file="MX357495B_D0021.tif" />

ie IMPI

MEXICAN INSTITUTE OF. INDUSTRIAL PROPERTY

In accordance with one aspect of the present invention, energy is precisely controlled during interpolation. Any gain that can be entered by changing the LPC is offset.

In accordance with another aspect of the present invention, series of individual LPC coefficients are used for each of the codebook vectors. Each codebook vector is filtered by its corresponding LPC and immediately afterwards the individual filtered signals are added to obtain the synthesized output. On the contrary, the state-of-the-art technology first adds all the excitation vectors (which are generated from the different code books) and then feeds the sum to a single LPC filter.

According to another aspect, a noise estimation is not used, for example in the form of a vector learned offline, but is actually derived from the previous decoded frames so that, after a certain number of packets / frames erroneous or faulty, gradual attenuation to actual background noise is obtained instead of some predetermined noise spectrum. This results in

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0022.tif" />

In particular, to a feeling of acceptance by a user, because, even when an error situation occurs, the signal provided by the decoder after a certain number of frames is related to the preceding signal. However, the signal emitted by a decoder in the case of a certain number of missed or erroneous frames is a signal that is not related at all to the signal emitted by the decoder prior to an error situation.

Applying a gain compensation corresponding to the variable profit in the LPC time offers the following advantages:

Compensates for any profit that may be introduced by changing the LPC.

Thus, the output signal level can be controlled by the codebook gains of the various codebooks. This results in a predetermined gradual attenuation by removing any unwanted influence from the interpolated LPC.

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0023.tif" />

Using a separate set of LPC coefficients for each codebook used during stealth offers the following benefits:

It generates the possibility of influencing the spectral shape of the tonal and noise parts of the signal separately.

Provides the ability to reproduce the voice portion of the signal almost unchanged (eg convenient for vocals), while the noisy portion can be quickly converted to background noise.

Provides the ability to hide parts with voice and gradually attenuate the part with voice with an arbitrary attenuation rate (eg gradual attenuation depending on signal characteristics), while simultaneously maintaining background noise during concealment.

State-of-the-art codes generally suffer from very clean voice concealment sound.

Provides means to attenuate background noise during concealment smoothly, gradually attenuating tonal parts without changing spectral properties and

IMPI

<img file="MX357495B_D0024.tif" />

attenuating the background.

MEXICAN INSTITUTE noise parts to the surround ^ é ^ N &amp; efftact

Fig. IA illustrates an apparatus for generating an error concealment signal 111. The apparatus comprises an LPC representation generator 100 for generating a first substitute representation and further for generating a second substitute LPC representation. As outlined in Fig.

IA, the first surrogate representation is entered into a LPC 106 synthesizer to filter a first codebook information issued by a first codebook

102 such as an adaptive codebook 102 to obtain a first surrogate signal at the output of block 106. In addition, the second surrogate representation generated by the LPC rendering generator 100 is input to the LPC synthesizer to filter a second book information different codebook provided by a second codebook 104 which is, for example, a fixed codebook, to obtain a second substitute signal at the output of block 108. Then, both surrogate signals are input to a surrogate signal combiner 110 to combine the first surrogate signal and the second surrogate signal to obtain error concealment signal 111.

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0025.tif" />

Both LPC synthesizers 106, 108 can be implemented in a single LPC synthesizer block or can be implemented in the form of separate LPC synthesis filters. In other implementations, both LPC synthesis procedures can be implemented by two LPC filters that are actually implemented and operate in parallel.

However, the LPC synthesis can also be an LPC synthesis filter and some control such that the LPC synthesis filter outputs an output signal corresponding to the first codebook information and the first surrogate representation and then, after this first operation, the control transmits the second codebook information and the second surrogate representation to the synthesis filter to obtain the second surrogate signal in serial form. Other implementations corresponding to the LPC synthesizer apart from a single or multiple synthesis blocks are clear to those skilled in the art.

LPC synthesis output signals are generally time domain signals and surrogate signal combiner 110 performs a combination of output synthesis signals by executing a synchronized addition sample by

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0026.tif" />

shows. However, surrogate signal combiner 110 may also perform other combinations, such as a sample-by-sample weighted addition or a frequency domain sum or any other signal combination.

Furthermore, it is indicated that the first codebook 102 comprises an adaptive codebook, and it is indicated that the second codebook 104 comprises a fixed codebook. However, the first codebook and the second codebook can be any type of codebook such as a predictive codebook as the first codebook and a noise codebook as the second codebook. However, other code books may be glottal pulse code books, innovative code books, transition code books, hybrid code books consisting of predictive and transformation parts, code books corresponding to individual voice generators such such as men / women / children or code books corresponding to different sounds such as animal sounds, etc.

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0027.tif" />

Fig. IB illustrates a representation of an adaptive codebook. The adaptive codebook is provided with a feedback loop 120 and receives, as input, a pitch delay 118. The pitch delay may be a decoded pitch delay in the case of a received correct frame / packet. However, if an error situation is detected indicating an erroneous or missing frame / packet, then the decoder emits an error concealment tone delay which is entered in the adaptive codebook.

Adaptive codebook 102 can be implemented in memory form to store the feedback output values ​​provided through feedback line 120 and, depending on the applied pitch delay 118, the adaptive codebook outputs a certain number of values ​​of sampling.

In addition, Fig. 1C illustrates a fixed codebook.

104. In the normal mode case, the fixed codebook 104 receives a codebook index and, in response to the codebook index, the fixed codebook provides a certain annotation of the codebook 114 as information from codes. However, if a stealth mode is determined, there is no index

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0028.tif" />

from codebook. In that case, a noise generator 112 provided within fixed codebook 104 is activated, which produces a noise signal as information from codebook 116. Depending on the implementation, the noise generator may offer a random codes. However, it is preferable that a noise generator actually produces noise rather than a random codebook index. The noise generator 112 can be implemented in the form of a certain noise generator in hardware or software or it can be implemented in the form of noise tables or a certain additional annotation in the fixed codebook in the form of noise.

Furthermore, combinations of the above procedures are possible, i.e. a noise annotation in the codebook together with a certain post-processing.

Fig. ID illustrates a preferred procedure for calculating a first substitute LPC representation in case of error. Step 130 illustrates the calculation of an average value of LPC representations of two or more last correct frames. Last three correct frames are preferred. Accordingly, an average value of the last three correct frames in block 130 is calculated and sent to the block

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0029.tif" />

136. In addition, step 132 provides the information of_

LPC of the last stored correct frame and further sends it to block 136. In addition, an attenuation factor 134 is determined in block 134. Next, depending 5 on the last correct LPC information, depending on the average value of the information LPC of the last correct frame and depending on the block attenuation factor

134, the first substitute representation 138 is calculated.

For the state of the art, only one LPC applies. For the method proposed here, each excitation vector, which is generated by the adaptive or fixed codebook, is filtered by its own set of LPC coefficients. The derivation of the individual ISF vectors is as follows:

The series of coefficients A (to filter the adaptive codebook) is determined using this formula:

<img file="MX357495B_D0030.tif" />

(block 136) isf_TO¹ - alpha_TO isf ~² + (1 - alpha) · isf (block 136)

IMPI

MEXICAN INSTITUTE D € LA PRONEDAD INDUSTRIAL

<img file="MX357495B_D0031.tif" />

where alpha_TO it is an adaptive attenuation factor over time that may depend on the stability of the signal, the class of signal, etc. isf ~^x they are the ISF coefficients, where x denotes the frame number, with respect to the end of the current frame: x = -1 denotes the first lost ISF, x = 2 the last correct ISF, and thus the second last correct ISF. successively. This leads to the attenuation of the LPC that is used to filter the tonal part, from the last correctly received frame to the average LPC (averaged from three of the last 20ms correct ones).

The more frames lost, the closer the ISF used during concealment is to this average vector of

Short-term ISF (isfj. In general, note that ISF represents values ​​in an ISF domain or an LSF domain. Therefore, the same or slightly different calculations can also be performed in the LSF domain instead of the ISF domain or any other similar domain.

Fig. 1E illustrates a preferred procedure for calculating the second surrogate representation. At block 140, a noise estimate is determined. Next, at block 142, an attenuation factor is determined. Furthermore, in

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0032.tif" />

Block 144, the last correct frame is the LPC information that was previously saved. Next, at block 146, a second surrogate representation is calculated. Preferably, a second series of coefficients B (to filter the fixed codebook) is determined by the following formula:

isf_B¹ = alpha_B isf ² + (1 - beta) isf^cne (block 146) where isf^cn9 is the ISF coefficient derived from an estimate of background noise and alpha_B is the time-varying attenuation speed factor that preferably depends on the signal. The target spectral shape is derived by plotting the above decoded signal in the domain of the

FFT (power spectrum), using a minimum statistical technique with optimal smoothing, similar to [3]. This FFT estimate is then converted to the representation of

LPC by calculating the autocorrelation by carrying out the

Inverse FFT and then using the Levinson20 Durbin recursion to calculate the LPC coefficients using the first N samples of the inverse FFT, where N is the order of

LPC. Therefore, the Levinson Durbin recursion is calculated on the autocorrelated values, or the

<img file="MX357495B_D0033.tif" />

²⁹ IMPI

MEXICAN INSTITUTE

OF THE PROPERTY

INDUSTRIAL representation in the time domain on the basis of which it is calculated comprises the inverse of the spectrum of Fourier transform squared (eg FFT).

This LPC is then converted to the ISF domain to retrieve isf^cn3. On the other hand - if such a plot of the background spectral shape is not available - the target spectral shape could also be derived based on any combination of a vector learned offline and the short-term spectral mean, as shown does in G.718 regarding the common spectral shape.

Preferably, the attenuation factors A and I heard_b they are determined depending on the decoded audio signal, that is, depending on the decoded audio signal before an error occurs. The attenuation factor may depend on the stability of the signal, the class of signal, etc. Accordingly, if the signal is determined to be a fairly noisy signal, then the attenuation factor is determined such that the attenuation factor decreases, from time to time, more rapidly compared to a situation where a signal is more well tonal. In this case, the attenuation factor decreases from a time frame to

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0034.tif" />

the next time frame in a reduced amount. This ensures that the gradual attenuation of the last correct frame to the average value of the last three correct frames takes place more quickly in the case of noisy signals compared to non-noisy or tonal signals, where the gradual attenuation speed is reduced.

Similar procedures can be performed for signal classes. In the case of voice signals, gradual attenuation can be performed slower than in the case of voiceless signals or in the case of music signals, the attenuation speed can be reduced compared to other signal characteristics and corresponding attenuation factor determinations can be applied.

As noted in the context of Fig. 1E, a different attenuation factor can be calculated if_b for the second codebook information. In this way, the different codebook entries can be given a different dimming rate. Therefore, a gradual attenuation to the noise estimate can be set as f^cng differently from the attenuation rate of the ISF representation of the last correct frame to the representation is outlined in block 136 of Fig. ID.

IMPI

MEXICAN INSTITUTE OF MIDDLE PROPERTY ^l13^^neither^ SF

<img file="MX357495B_D0035.tif" />

Fig. 2 illustrates an overview of an implementation

<td>preferred</td><td>. A line</td><td>of</td><td>entry</td><td>receives,</td><td colspan="2">for example,</td><td>of a</td>

<td>Interface</td><td>input</td><td colspan="2">wireless</td><td>or one</td><td>Interface</td><td>by</td><td>cable,</td>

<td>packages</td><td>one more</td><td>of</td><td colspan="2">a sign of</td><td>Audio.</td><td>The</td><td>data</td>

transferred by input line 202 are sent to a decoder 204 and at the same time to an error concealment controller 200. The error concealment controller determines whether the received packets or frames are erroneous or missing. If this is determined, the error concealment controller enters a control message into decoder 204. In the implementation of Fig. 2, a message 1 on the CTRL control line indicates that decoder 204 must operate in stealth mode. However, if the error concealment controller does not encounter an error situation, then the control line carries a 0 message indicating a normal decoding mode as indicated in Table 210 of Fig. 2. Decoder 204 is also connects to a noise estimator

206. During normal decoding mode, noise estimator 206 receives the decoded audio signal through

IMPI

MEXICAN INSTITUTE IX THE PROPERTY

INDUSTRIAL

<img file="MX357495B_D0036.tif" />

of a feedback line 208 and determines a noise estimate from the decoded signal. However, when the error concealment controller indicates a change from normal decoding mode to concealment mode, the noise estimator 206 sends the noise estimate to decoder 204 so that decoder 204 can perform an error concealment as Describe in the previous and following figures. Thus, the noise estimator 206 is in turn controlled by the CTRL control line from the error concealment controller to switch from the normal noise estimation mode to the normal decoding mode to the estimation production operation. noise in stealth mode.

FIG. 4 illustrates a preferred embodiment of the present invention in the context of a decoder, such as decoder 204 in FIG. 2, which consists of an adaptive codebook 102 and further includes a fixed codebook. 104. In the normal decoding mode indicated by a data from control line 0 as described in the context of Table 210 in Fig. 2, the decoder operates as illustrated in Fig. 8, when the 804. Therefore, the package correctly

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0037.tif" />

received comprises a fixed codebook index to control the fixed codebook 802, a fixed codebook gain g_c to control the 806 amplifier and an adaptive codebook g_p to control amplifier 808. In addition, adaptive codebook 800 is controlled by the transmitted tone delay and switch 812 is connected such that the output of the adaptive codebook is fed back to the input of the adaptive codebook. Furthermore, the coefficients for the LPC 804 synthesis filter are derived from the transmitted data.

However, if the error concealment controller 202 of Fig. 2 detects an error concealment situation, the error concealment procedure is started in which, unlike the normal procedure, two synthesis filters 106 are included, 108. Furthermore, the tone delay corresponding to adaptive codebook 102 is generated by an error concealment device. In addition, the adaptive codebook gain g_p and the fixed codebook profit g_c they are also synthesized by an error concealment procedure in the manner known in the art to correctly control amplifiers.

402, 404.

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0038.tif" />

Also, depending on the class of signal, a controller 409 controls switch 405 to feedback a combination of the outputs of both codebooks (after applying the corresponding codebook gain) or to feedback the output of the book. of adaptive codes.

In accordance with one embodiment, the data corresponding to the LPC synthesis filter A 106 and the data corresponding to the LPC synthesis filter B 108 are generated by the LPC representation generator 100 of Fig. 1A and further is performed a gain correction by amplifiers 406, 408. For this purpose, the gain compensation factors g are calculated_TO yg_B to properly activate amplifiers 408, 406 such that any gain effects generated by the LPC rendering are stopped. Finally, the combiner 110 combines the outputs of the LPC synthesis filters A, B indicated by 106 and 108, in order to obtain the error concealment signal.

IMPI

MEXICAN INSTITUTE Say THE PROPERTY

INDUSTRIAL

<img file="MX357495B_D0039.tif" />

The following describes switching from normal mode to stealth mode on one side and from stealth mode back to normal mode.

The transition from a common LPC to several separate LPCs when switching from clean channel decoding to concealment does not cause any discontinuity, as the memory state of the last correct LPC can be used to initialize each AR or MA memory of the separate LPCs. This ensures a smooth transition from the last correct frame to the first loss.

In switching from error concealment to decoding of clean channels (recovery phase), the strategy of separate LPCs introduces the challenge of correctly updating the status of the internal memory of the single LPC filter during decoding of clean channels (usually AR (autoregressive) models are used. Only using the AR memory from an LPC or averaged AR memory would result in discontinuities at the edge of the frame between the last lost and the first correct frame. The following describes a method to overcome this challenge:

<img file="MX357495B_D0040.tif" />

iMPI Mexican Institute

OF INDUSTRIAL PROPERTY

A small portion of all excitation vectors (hint: 5ms) is added to the end of any hidden frame. This summed excitation vector can then be fed to the LPC that would be used for recovery. This is shown in Fig. 5. Depending on the implementation, it is also possible to add the excitation vectors after the LPC gain compensation.

It is advisable to start at the end of the frame minus 5ms, set the LPC AR memory to zero, derive the synthesis of

LPC using any of the individual sets of LPC coefficients and saving the memory state at the very end of the hidden frame. If the next frame is received correctly, then this memory state can be used for recovery (meaning: used to initialize the LC memory at the beginning of the frame), otherwise it is discarded. This memory must also be entered; it must be treated separately from any of the LPC AR memories used by stealth during stealth.

Another solution for recovery is the use of the LPCO method, disclosed at USAC [4].

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0041.tif" />

Fig. 5 is described in more detail below. In general, the adaptive codebook 102 can be considered a predictive codebook, as indicated in FIG. 5, or it can be replaced by a predictive codebook. Furthermore, the fixed codebook 104 can be replaced or implemented in the form of noise codebook 104. The codebook gains g_p yg_c, to correctly activate the amplifiers 402, 404 they are transmitted, in the normal way, in the input data or they can be synthesized by means of an error concealment procedure in the case of error concealment.

In addition, a third codebook 412 is used, which can be any other codebook, which further has an associated codebook gain g as indicated by the amplifier.

414. In one embodiment, at block 416, additional LPC synthesis is implemented by a separate filter controlled by a substitute LPC representation for the other codebook. Also, a gain correction g is executed_c similarly as described in the context of g_TO and gB, as described.

Furthermore, the additional recovery LPC X synthesizer indicated at 418 is illustrated which receives, as input, a sum

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0042.tif" />

of at least a small portion of all excitation vectors such as 5 ms. This excitation vector is entered into the memory state of the LPC X synthesizer.

418 of the LPC X synthesis filter.

Then, when there is a rollback from stealth mode to normal mode, the single filter for synthesis of

LPC is controlled by copying the internal memory states of the LPC X synthesis filter into this single filter of normal operation, and in addition the filter coefficients are established by the correctly transmitted LPC representation.

Fig. 3 illustrates another more detailed implementation of the LPC synthesizer with two LPC synthesis filters 106,

108. Each filter is, for example, an FIR filter or an IIR filter with filter connections 304, 306 and internal filter memories 304, 308. Filter connections 302, 306 are properly controlled by the corresponding LPC representation transmitted or the corresponding surrogate LPC representation generated by the LPC representation generator, such as 100 in Fig. IA. In addition, a 320 memory initializer is included. Memory initializer 320 receives the last

IMPI 'Mexican srnyro

THE INDUSTRIAL PROPERTY

<img file="MX357495B_D0043.tif" />

correct LPC representation, and upon switching to error hide mode, memory initializer 320 sends memory states of LPC synthesis single filter to internal filter memories 304,

308. In particular, the memory initializer receives, instead of the last correct LPC representation or in addition to the last correct LPC representation, the last correct memory states, i.e. the internal memory states of the LPC single filter in processing , and especially after the processing of the last correct frame / packet.

Furthermore, as already noted in the context of Fig. 5, memory initializer 320 may also be configured to execute the memory initialization procedure for recovery from an error concealment situation to the normal non-erroneous mode of operation. .

To do this, memory initializer 320, or a separate future LPC memory initializer, is configured to initialize a single LPC filter in the event of a recovery of a bad frame or lost by a correct frame. The LPC Memory Initializer is configured to feed at least a portion of a combination of a first book information codebook or code information and a

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0044.tif" />

second at least a portion of a combination of a first weighted codebook information or a second weighted codebook information to a separate LPC filter such as an LPC filter 418 of Fig. 5. In addition, the Initializer LPC memory is configured to save memory states obtained by processing the fed values. Then when a subsequent frame or packet is a correct frame or packet, the only filter for

LPC 814 of Fig. 8 corresponding to normal mode is initialized using the stored memory states, ie states obtained from filter 418. In addition, as suggested in Fig. 5, the filter coefficients for the filter can be the coefficient for LPC synthesis filter 106 or LPC synthesis filter 108 or LPC synthesis filter 416 or a weighted or unweighted combination of these coefficients.

Fig. 6 offset generate an illustrates a further implementation with gain. For this purpose, the error concealment signal apparatus comprises a gain calculator 600 and a compensator 406, 408, which already

<img file="MX357495B_D0045.tif" />

IMPI

MEXICAN INSTITUTE

OF THE PROPERTY

INDUSTRIAL has been described in the context of Fig. 4 (406, 408) and the

Fig. 5 (406, 408, 409). In particular, the LPC representation calculator 100 transmits the first substitute LPC representation and the second substitute LPC representation to a profit calculator 600. The profit calculator then calculates a first gain information corresponding to the first substitute LPC representation and the second profit information corresponding to the second substitute LPC representation and sends this data to compensator 406, 408, which receives, in addition to the First and second codebook information, as indicated in Fig. 4 or Fig.

5, the LPC of the last frame / packet / block correct.

The compensator then outputs the compensated signal. The input to the compensator can be an output from amplifiers 402, 404, an output from the code books

102, 104 or an output of synthesis blocks 106, 108 in the embodiment of Fig. 4.

Compensator 406, 408 partially or fully compensates for a gain effect of the first substitute LPC on the first gain information and compensates for the gain effect

<img file="MX357495B_D0046.tif" />

<img file="MX357495B_D0047.tif" />

<img file="MX357495B_D0048.tif" />

of the second representation of LPC replaced^- second gain information.

In one embodiment, the calculator 600 is configured to calculate a last correct power information related to a last correct LPC representation before the start of error concealment.

Furthermore, the gain calculator 600 calculates a first power information corresponding to the first substitute LPC representation, a second power information corresponding to the second LPC representation, where the first gain value uses the last correct power information and the first power information, and a second gain value that uses the last correct power information and the second power information. Compensation is then executed on compensator 406, 408 using the first gain value and using the second gain value. Depending on the information, however, the calculation of the last correct power information can also be performed, as illustrated in the embodiment of Fig. 6, directly by the compensator. However, since the calculation of the last correct power information

<img file="MX357495B_D0049.tif" />

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY is carried out basically in the same way as the first profit value corresponding to the first substitute representation and the second profit value corresponding to the second representation of the substitute LPC, it is preferable to execute the calculation of all the values of profit in the profit calculator 600 as exposed by entry 601.

In particular, the profit calculator 600 is configured to calculate, from the last correct LPC representation or the first and second substitute LPC representations, an impulse response and then calculate an rms (root mean) value of the response. to the impulse to obtain the corresponding power information in the gain compensation, each excitation vector is - once gained by the corresponding codebook gain - amplified again with the gains g_TO or g_B. These gains are determined by calculating the impulse response of the LPC in use at the time and then calculating the rms:

5ms

T ^ TTT-S_new t = Oms imp_resp²(tj__

IMPI

MEXICANC INSTITUTE OF LA MOHEDAL- INDUSTRIAL

<img file="MX357495B_D0050.tif" />

The result is then compared to the rms of the last correctly received LPC and the quotient is used as a gain factor to compensate for the LPC interpolation power increase / loss:

_ ^r^ - ^ previous riTlSnew

This procedure can be considered a type of standardization. Compensates for the gain, which is a product of LPC interpolation.

Next, Figs. 7A and 7B in more detail to illustrate the apparatus for generating an error concealment signal or the gain calculator 600 or compensator 406, 408 calculates the last correct power information as indicated at 7 00 in Fig. 7A. In addition, the profit calculator 600 calculates the first and second power information corresponding to the first and second substitute LPC plots, as

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0051.tif" />

indicated at 702. Next, as illustrated at 704, the profit calculator 600 calculates the first and second gain values. The codebook information or the weighted codebook information or the output of the LPC synthesis is then compensated using these gain values, as illustrated in 706.

This compensation is preferably executed by amplifiers 406, 408.

To this end, several steps are performed in a preferred embodiment illustrated in Fig. 7B. In step

710, an LPC representation is presented, such as the first or second surrogate LPC representation or the last correct LPC representation. In step 712 the codebook gains are applied to the codebook information / output, as indicated in block 402, 404. In addition, in step 716, the impulse responses are calculated taking into account the corresponding LPC representations. Next, in step 718, an rms value is calculated for each response to the tax and in block 720 the corresponding gain is calculated using a previous rms value and a new rms value and this calculation is preferably performed by dividing the value

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0052.tif" />

old rms for the new rms value. Finally, the result of block 720 is used to offset the result of step 712 to ultimately obtain the offset results, as indicated in step 714.

Another aspect is described below, that is, an implementation of an apparatus for generating an error concealment signal consisting of the LPC representation generator 100 that generates only a single substitute LPC representation, as for example by the situation illustrated in the Fig. 8. Unlike Fig. 8, however, the embodiment illustrating another aspect in Fig. 9 comprises the profit calculator 600 and the compensator 406, 408. In this way, any gain effect exerted by the substitute LPC representation generated by the LPC representation generator is offset. In particular, this gain compensation can be executed on the input side of the LPC synthesizer, as demonstrated in Fig. 9 by the compensator 406, 408n, or it can be executed at the output of the LPC synthesizer, as indicated by compensator 900 in order to ultimately obtain the error concealment signal. Accordingly, compensator 406, 408, 900 is configured

IMPI

MEXICAN INSTITUTE

PROPERTY iii ^ jW

INDUSTRIAL to weight codebook information or an LPC synthesis output spñai provided by the LPC synthesizer 106, 108.

The other procedures performed by the LPC Representation Generator, Gain Calculator, Compensator, and LPC Synthesizer can be performed in the manner described in the context of Figs. IA to 8.

As outlined in the context of Fig. 4, amplifier 402 and amplifier 406 perform two weighting operations in series, especially in the case where the sum of the output of multiplier 402, 404 is not fed back to the adaptive codes, but only the adaptive codebook output is fed back, i.e. when switch 405 is in the illustrated position or amplifier 404 and amplifier

408 They execute two weighting operations in series. In an embodiment illustrated in Fig. 10, these two weighting operations can be performed in a single operation. For this purpose, the profit calculator 600 transmits its output g_p og_c to a single 1002 value calculator. Also, a profit generator is implemented

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0053.tif" />

from codebook 1000 in order to generate "-rara-yanahóia codebook for concealment, as known in the art. Then the unique value calculator 1002 preferably calculates a product between g_p yg_TO to get the unique value. Also, for the second branch, the unique value calculator 1002 calculates a product between g_TO og_B to produce the unique value for the lower branch of Fig. 4.

Another procedure can be executed for the third branch, which presents the amplifiers 414, 409 in Fig. 5.

Below is a manipulator 1004 that collectively performs operations, for example, from amplifiers 402, 406 to codebook information from a single codebook or codebook information from two or more codebooks to ultimately obtain a tampered signal such as a codebook signal or a concealment signal, depending on whether manipulator 1004 is positioned before the LPC synthesizer of Fig. 9 or subsequent to the LPC synthesizer of Fig. 9. Fig. 11 illustrates a third aspect, which includes the LPC rendering generator 100, the LPC synthesizer 106, 108 and the additional noise estimator 206, which has already been described in the context of the

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0054.tif" />

Fig. 2. The LPC synthesizer 106, 108 recltee —info ^ maojón do codebooks and a substitute LPC representation. The LPC representation is generated by the LPC representation generator using the noise estimate obtained from the noise estimator 206, and the noise estimator 206 operates by determining the noise estimate from the last correct frames. Consequently, the noise estimation depends on the last correct audio frames and the noise estimation is performed during the reception of correct audio frames, that is to say in the normal decoding mode indicated by 0 in the control line of Fig .2 and then this noise estimate generated during the normal decoding mode is applied in the stealth mode, as indicated by the connection of blocks 206 and

204 in Fig. 2.

The noise estimator is configured to process a spectral representation of a previous decoded signal to produce a noise spectral representation and to convert the noise spectral representation to a noise LPC representation, where the noise LPC representation is the same type of LPC representation than the substitute LPC representation. Therefore, when the

IMPI

MEXICAN INSTITUTE Df. THE PROPERTY

INDUSTRIAL

<img file="MX357495B_D0055.tif" />

surrogate LPC representation is in the domain representation of the ISF or an ISF vector, then the noise LPC representation is also an ISF vector or an ISF representation.

Furthermore, the noise estimator 206 is configured to apply a minimum statistics technique with optimal smoothing to a previous decoded signal to derive the noise estimate. For this procedure, it is preferable to run the procedure illustrated in [3]. However, other noise estimation procedures may also be applied, for example, based on the suppression of tonal parts compared to non-tonal parts of a spectrum to filter and eliminate background noise or noise in a signal. audio to obtain the target spectral shape or spectral noise estimate.

Accordingly, in one embodiment, a spectral noise estimate is derived from a previous decoded signal, and then the spectral noise estimate is converted to an LPC representation and then to a domain of

ISF to obtain the final noise estimate or the target spectral shape.

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0056.tif" />

Fig. 12A illustrates a preferred embodiment step 1200, the above decoded signal is obtained, as illustrated, for example, in Fig. 2 by feedback loop 208. At step 1202, a spectral representation is calculated, such as a Fast Fourier transform (FFT) representation. Next, in step 1204, a target spectral shape is derived such as the minimum statistics strategy with optimal smoothing or by any other noise estimation processing. Next, the target spectral shape is converted to an LPC representation, as indicated in block 1206, and finally the LPC representation is converted to an ISF factor, as detailed in block 1208 in order to obtain, by last, the target spectral form in the ISF domain, which can then be directly used by the LPC representation generator to generate a substitute LPC representation. In the equations of this application, the target spectral shape in the domain of the

ISF is indicated as ISF^cn9.

In a preferred embodiment illustrated in Fig. 12B, the target spectral shape is derived for example by a minimal statistics and smoothing technique

IMPÍ

ΙΝΤΠΤ, ΓΓΟ MEXICANO DE LA ndOMIDAD INDUSTRIAL

<img file="MX357495B_D0057.tif" />

optimum. Then, at step 1212., .... 80 I perform representation in the time domain by applying an inverse FFT, for example, to the target spectral form. The LPC coefficients are then calculated using the LevinsonDurbin recursion. However, the calculation of the LPC coefficients of block 1214 can also be done by any other procedure apart from the aforementioned recursion of

Levinson-Durbin. Then, in step 1216, the final ISF factor 10 is calculated to obtain the ISF noise estimate.^cng to be used by the LPC rendering generator

100,

Fig. 13 is described below to illustrate the use of noise estimation in the context of calculating a single surrogate LPC representation 1308 for the procedure, for example, illustrated in Fig. 8 or to compute LPC representations codes corresponding to individual codebooks, as indicated in block 1310 for the embodiment illustrated in Fig. 1.

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0058.tif" />

In step 1300, an average value of rins n T-rog is calculated. last correct frames. At step 1302, the last correct LPC rendering frame occurs. In addition, in step 1304, an attenuation factor is output that can be controlled, for example, by a separate signal analyzer that can be included, for example, in the error concealment controller 200 of FIG. 2. Next, in step 1306, a noise estimate is calculated and the procedure in step 1306 can be executed by any of the procedures illustrated in Figs. 12A,

12B.

In the context of calculating a single surrogate LPC representation, the outputs of blocks 1300 are sent,

1304, 1306 to the calculator 1308. Next, a single substitute LPC representation is calculated in such a way that after the loss or error of a certain number of frames / packets, the attenuation to the LPC representation is obtained for noise estimation .

However, the individual LPC representations corresponding to an individual codebook, such as the adaptive codebook and the codebook as outlined in 1310, are then run as described above to compute the

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0059.tif" />

fixed, the ISFa 'procedure is calculated¹ (LPC A) on the one hand and the calculation of ISF_B

-i (LPC B).

Although the present invention has been described in the context of block diagrams in which the blocks represent real or logical hardware components, the present invention can also be implemented by a method instrumented by a computer. In the latter case, the blocks represent the corresponding steps in the method, in which these steps represent the functions performed by the corresponding logical or physical hardware blocks.

Although some aspects have been described in the context of an apparatus, it is obvious that these aspects also represent a description of the corresponding method, in which a block or device corresponds to a method step or a characteristic of a method step. Similarly, the aspects described in the context of a method step also represent a description of a corresponding item or block or of a characteristic of a corresponding apparatus. Some or all of the method steps can be performed by (or using) a

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0060.tif" />

hardware, such as a nri i-.propropsor, a programmable computer, or an electronic circuit. In some embodiments, one or more of the most important steps in the method can be performed by that type of apparatus.

Depending on certain implementation requirements, the embodiments of the invention can be implemented in hardware or in software. The implementation can be carried out using a digital storage medium, for example a

<td>floppy disk, a</td><td>DVD,</td><td colspan="2">a Blue-Ray, a CD,</td><td>a ROM,</td><td>a</td><td>PROM,</td>

<td>an EPROM, a</td><td colspan="2">EEPROM or a</td><td>memory</td><td>FLASH,</td><td>than</td><td>has</td>

<td>stored in</td><td>the</td><td>same</td><td>signs</td><td>control</td><td colspan="2">readable</td>

<td>electronically,</td><td>than</td><td>cooperate</td><td colspan="3">(or have capacity</td><td>for</td>

cooperate) with a programmable computing system such that the respective method is executed. Therefore, the digital storage medium can be readable by a computer.

Some embodiments in accordance with the invention comprise a data carrier comprising electronically readable control signals, capable of cooperating with a programmable computing system in such a manner.

IMPI

MEXICAN INSTITUTE ¹ delapronedap

INDUSTRIAL

<img file="MX357495B_D0061.tif" />

way to run present.

one of the descriptor methods, 1 a In general, the embodiments of the present invention can be implemented as a computer program product with a program code, where the program code fulfills the function of executing one of the methods when executing the computer program on a computer. The program code can be stored, for example, on a machine-readable carrier.

Other embodiments include the computer program for executing one of the methods described herein, stored in a machine-readable carrier.

In other words, one embodiment of the method of the invention therefore consists of a computer program consisting of a program code for performing one of the methods described herein when the computer program is run on a computer.

A further embodiment of the method of the invention therefore consists of a data carrier (or

IMPI

MEXICAN INSTITUTE OF PROPERTY

KDUSTRIAL

<img file="MX357495B_D0062.tif" />

digital storage medium, or · computer labyrinth »that includes, recorded on it, the computer program to execute one of the methods described here. The data carrier, the digital storage medium or the recorded medium are generally tangible and / or non-transient.

Another embodiment of the method of the invention is, therefore, a data stream or a sequence of signals that the computer program represents to execute one of the methods described herein. The data stream or signal sequence may be configured, for example, to be transferred over a data communication connection, for example over the Internet.

Another embodiment comprises a processing means, for example a computer, a programmable logic device, configured or adapted to execute one of the methods described herein.

A further embodiment comprises a computer on which the computer program has been installed to execute one of the methods described herein.

L

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

<img file="MX357495B_D0063.tif" />

Another embodiment according to the invention comprises an apparatus or system configured to transfer (for example electronically or optically) a computer program to implement one of the methods described herein in a receiver. The receiver may be, for example, a computer, a mobile device, a memory device, or the like. The apparatus or system may comprise, for example, a file server for transferring the computer program to the receiver.

In some embodiments, a programmable logic device (for example an array of programmable gates in the field) may be used to execute some or all of the functionality of the methods described herein. In some embodiments, an array of field programmable gates can cooperate with a microprocessor to execute one of the methods described herein. In general, the methods are preferably executed by any hardware device.

The embodiments described above are merely illustrative of the principles of the present invention. It is understood that the modifications and variations

<img file="MX357495B_D0064.tif" />

IMPI mexican institute

OF THE PROPERTY

INDUSTRIAL of the provisions and details described herein should be apparent to those skilled in the art.

Therefore, it is only intended to be limited to the scope of the following patent claims and not to the specific details presented by way of description and explanation of the embodiments presented herein.

IMPI

MEXICAN INSTITUTE OF PROPERTY

INDUSTRIAL

<img file="MX357495B_D0065.tif" />

References [1] ITU-T G.718 Recommendation, 2006 [2] Kazuhiro Kondo, Kiyoshi Nakagawa, „A Packet Loss 5 Concealment Method Using Recursive Linear Prediction

Department of Electrical Engineering, Yamagata University, Japan.

[3] R. Martin, Noise Power Spectral Density Estimation Based on Optimal Smoothing and Minimum Statistics, IEEE Transactions on speech and audio processing, vol. 9, no. 5, July 2001 [4] Ralf Geiger et. al., Patent Application US20110173011

Al, Audio Encoder and Decoder for Encoding and Decoding Frames of a Sampled Audio Signal [5] 3GPP TS 26.190; Transcoding functions; 15 specification

3GPP technical