Apparatus and method for improved concealment of the adaptive codebook in acelp-like concealment employing improved pitch lag estimation
Abstract
An apparatus for determining an estimated pitch lag is provided. The apparatus comprises an input interface (110) for receiving a plurality of original pitch lag values, and a pitch lag estimator (120) for estimating the estimated pitch lag. The pitch lag estimator (120) is configured to estimate the estimated pitch lag depending on a plurality of original pitch lag values and depending on a plurality of information values, wherein for each original pitch lag value of the plurality of original pitch lag values, an information value of the plurality of information values is assigned to said original pitch lag value.
Term
7.7 yearsto projected expiry
Projected expiry 16 June 2034, counted from filing; an application has no term until it is granted.
- Priority
- Filed
- Published
- Today
- Projected expiry
16 claims: 2 independent, 14 dependent
- 1An apparatus for determining an estimated pitch lag, comprising:an input interface (110) for receiving a plurality of original pitch lag values, and a pitch lag estimator (120) for estimating the estimated pitch lag, wherein the pitch lag estimator (120) is configured to estimate the estimated pitch lag depending on a plurality of original pitch lag values and depending on a plurality of information values, wherein for each original pitch lag value of the plurality of original pitch lag values, an information value of the plurality of information values is assigned to said original pitch lag value.
- 15A method for determining an estimated pitch lag, comprising:receiving a plurality of original pitch lag values, and estimating the estimated pitch lag, wherein estimating the estimated pitch lag is conducted depending on a plurality of original pitch lag values and depending on a plurality of information values, wherein for each original pitch lag value of the plurality of original pitch lag values, an information value of the plurality of information values is assigned to said original pitch lag value.
Independent claims2
365 paragraphs, as filed
The present invention relates to audio signal processing, in particular to speech processing, and, more particularly, to an apparatus and a method for improved concealment of the adaptive codebook in ACELP-like concealment (ACELP = Algebraic Code Excited Linear Prediction).
Audio signal processing becomes more and more important. In the field of audio signal processing, concealment techniques play an important role. When a frame gets lost or is corrupted, the lost information from the lost or corrupted frame has to be replaced. In speech signal processing, in particular, when considering ACELP- or ACELP-like-speech codecs, pitch information is very important. Pitch prediction techniques and pulse resynchronization techniques are needed.
Regarding pitch reconstruction, different pitch extrapolation techniques exist in the prior art.
One of these techniques is a repetition based technique. Most of the state of the art codecs apply a simple repetition based concealment approach, which means that the last correctly received pitch period before the packet loss is repeated, until a good frame arrives and new pitch information can be decoded from the bitstream. Or, a pitch stability logic is applied according to which a pitch value is chosen which has been received some more time before the packet loss. Codecs following the repetition based approach are, for example, G.719 (see [ITU08b, 8.6]), G.729 (see [ITU12, 4.4]), AMR (see [3GP12a, 6.2.3.1], [ITU03]), AMR-WB (see [3GP12b, 6.2.3.4.2]) and AMR-WB+ (ACELP and TCX20 (ACELP like) concealment) (see [3GP09]); (AMR = Adaptive Multi-Rate; AMR-WB = Adaptive Multi-Rate-Wideband).
Another pitch reconstruction technique of the prior art is pitch derivation from time domain. For some codecs, the pitch is necessary for concealment, but not embedded in the bitstream. Therefore, the pitch is calculated based on the time domain signal of the previous frame in order to calculate the pitch period, which is then kept constant during concealment. A codec following this approach is, for example, G.722, see, in particular G.722 Appendix 3 (see [ITU06a, III.6.6 and III.6.7]) and G.722 Appendix 4 (see [ITU07, IV.6.1.2.5]).
A further pitch reconstruction technique of the prior art is extrapolation based. Some state of the art codecs apply pitch extrapolation approaches and execute specific algorithms to change the pitch accordingly to the extrapolated pitch estimates during the packet loss. These approaches will be described in more detail as follows with reference to G.718 and G.729.1.
At first, G.718 considered (see [ITU08a]). An estimation of the future pitch is conducted by extrapolation to support the glottal pulse resynchronization module. This information on the possible future pitch value is used to synchronize the glottal pulses of the concealed excitation.
The pitch extrapolation is conducted only if the last good frame was not UNVOICED. The pitch extrapolation of G.718 is based on the assumption that the encoder has a smooth pitch contour. Said extrapolation is conducted based on the pitch lags <maths id="math0001"><math display="inline"><msubsup><mi>d</mi><mi mathvariant="italic">fr</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></msubsup></math><img file="EP4375993A2_D0001.tif" /></maths> of the last seven subframes before the erasure.
In G.718, a history update of the floating pitch values is conducted after every correctly received frame. For this purpose, the pitch values are updated only if the core mode is other than UNVOICED. In the case of a lost frame, the difference <maths id="math0002"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></msubsup></math><img file="EP4375993A2_D0002.tif" /></maths> between the floating pitch lags is computed according to the formula <maths id="math0003" num="(1)"><math display="block"><mtable><mtr><mtd><mrow><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></msubsup><mo>=</mo><msubsup><mi>d</mi><mi mathvariant="italic">fr</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></msubsup><mo>−</mo><msubsup><mi>d</mi><mi mathvariant="italic">fr</mi><mfenced open="[" close="]"><mi>i</mi><mo>−</mo><mn>1</mn></mfenced></msubsup></mrow></mtd><mtd><mi mathvariant="italic">for</mi></mtd><mtd><mrow><mi>i</mi><mo>=</mo><mo>−</mo><mn>1</mn><mo>,</mo><mo>…</mo><mo>,</mo><mo>−</mo><mn>6</mn></mrow></mtd></mtr></mtable></math><img file="EP4375993A2_D0003.tif" /></maths>
In formula (1), <maths id="math0004"><math display="inline"><msubsup><mi>d</mi><mi mathvariant="italic">fr</mi><mfenced open="[" close="]"><mo>−</mo><mn>1</mn></mfenced></msubsup></math><img file="EP4375993A2_D0004.tif" /></maths> denotes the pitch lag of the last (i.e. 4<i><sup>th</sup></i>) subframe of the previous frame; <maths id="math0005"><math display="inline"><msubsup><mi>d</mi><mi mathvariant="italic">fr</mi><mfenced open="[" close="]"><mo>−</mo><mn>2</mn></mfenced></msubsup></math><img file="EP4375993A2_D0005.tif" /></maths> denotes the pitch lag of the 3<i><sup>rd</sup></i> subframe of the previous frame; etc.
According to G.718, the sum of the differences <maths id="math0006"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></msubsup></math><img file="EP4375993A2_D0006.tif" /></maths> is computed as <maths id="math0007" num="(2)"><math display="block"><msub><mi>s</mi><mi mathvariant="normal">Δ</mi></msub><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mo>−</mo><mn>1</mn></mrow><mrow><mo>−</mo><mn>6</mn></mrow></munderover><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></msubsup></mstyle></math><img file="EP4375993A2_D0007.tif" /></maths>
As the values <maths id="math0008"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></msubsup></math><img file="EP4375993A2_D0008.tif" /></maths> can be positive or negative, the number of sign inversions of <maths id="math0009"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></msubsup></math><img file="EP4375993A2_D0009.tif" /></maths> is summed and the position of the first inversion is indicated by a parameter being kept in memory.
The parameter <i>f<sub>corr</sub></i> is found by <maths id="math0010" num="(3)"><math display="block"><msub><mi>ƒ</mi><mi mathvariant="italic">corr</mi></msub><mo>=</mo><mn>1</mn><mo>−</mo><mfrac><msqrt><mstyle displaystyle="true"><msubsup><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mo>−</mo><mn>1</mn></mrow><mrow><mo>−</mo><mn>6</mn></mrow></msubsup><msup><mfenced><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mo>−</mo><mi>i</mi></mfenced></msubsup><mo>−</mo><msub><mi>s</mi><mi mathvariant="normal">Δ</mi></msub></mfenced><mn>2</mn></msup></mstyle></msqrt><mrow><mn>6</mn><mo>⋅</mo><msub><mi>d</mi><mi mathvariant="italic">max</mi></msub></mrow></mfrac></math><img file="EP4375993A2_D0010.tif" /></maths> where <i>d<sub>max</sub></i> = 231 is the maximum considered pitch lag.
In G.718, a position <i>i<sub>max</sub></i>, indicating the maximum absolute difference is found according to the definition <maths id="math0011"><math display="block"><msub><mi>i</mi><mi mathvariant="italic">max</mi></msub><mo>=</mo><mfenced open="{" close="}"><msubsup><mi mathvariant="italic">max</mi><mrow><mi>i</mi><mo>=</mo><mo>−</mo><mn>1</mn></mrow><mrow><mo>−</mo><mn>6</mn></mrow></msubsup><mfenced><mi mathvariant="italic">abs</mi><mfenced><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></msubsup></mfenced></mfenced></mfenced></math><img file="EP4375993A2_D0011.tif" /></maths> and a ratio for this maximum difference is computed as follows: <maths id="math0012" num="(4)"><math display="block"><msub><mi>r</mi><mi mathvariant="italic">max</mi></msub><mo>=</mo><mfenced open="|" close="|"><mfrac><mrow><mn>5</mn><mo>⋅</mo><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><msub><mi>i</mi><mi mathvariant="italic">max</mi></msub></mfenced></msubsup></mrow><mfenced><msub><mi>s</mi><mi mathvariant="normal">Δ</mi></msub><mo>−</mo><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><msub><mi>i</mi><mi mathvariant="italic">max</mi></msub></mfenced></msubsup></mfenced></mfrac></mfenced></math><img file="EP4375993A2_D0012.tif" /></maths>
If this ratio is greater than or equal to 5, then the pitch of the 4<sup>th</sup> subframe of the last correctly received frame is used for all subframes to be concealed. If this ratio is greater than or equal to 5, this means that the algorithm is not sure enough to extrapolate the pitch, and the glottal pulse resynchronization will not be done.
If <i>r<sub>max</sub></i> is less than 5, then additional processing is conducted to achieve the best possible extrapolation. Three different methods are used to extrapolate the future pitch. To choose between the possible pitch extrapolation algorithms, a deviation parameter <i>f<sub>corr2</sub></i> is computed, which depends on the factor <i>f<sub>corr</sub></i> and on the position of the maximum pitch variation <i>i<sub>max</sub>.</i> However, at first, the mean floating pitch difference is modified to remove too large pitch differences from the mean: If <i>f<sub>corr</sub></i> < 0.98 and if <i>i<sub>max</sub></i> = 3, then the mean fractional pitch difference <o ostyle="single">Δ</o><i><sub>dfr</sub></i> is determined according to the formula <maths id="math0013" num="(5)"><math display="block"><msub><mover accent="true"><mi mathvariant="normal">Δ</mi><mo>‾</mo></mover><mi mathvariant="italic">dfr</mi></msub><mo>=</mo><mfenced><mfrac><mrow><msub><mi>s</mi><mi mathvariant="normal">Δ</mi></msub><mo>−</mo><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mo>−</mo><mn>4</mn></mfenced></msubsup><mo>−</mo><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mo>−</mo><mn>5</mn></mfenced></msubsup></mrow><mn>3</mn></mfrac></mfenced></math><img file="EP4375993A2_D0013.tif" /></maths> to remove the pitch differences related to the transition between two frames.
If <i>f<sub>corr</sub></i> ≥ 0.98 or if <i>i<sub>max</sub></i> ≠ 3, the mean fractional pitch difference <o ostyle="single">Δ</o><i><sub>dfr</sub></i> is computed as <maths id="math0014" num="(6)"><math display="block"><msub><mover accent="true"><mi mathvariant="normal">Δ</mi><mo>‾</mo></mover><mi mathvariant="italic">dfr</mi></msub><mo>=</mo><mfrac><mrow><msub><mi>s</mi><mi mathvariant="normal">Δ</mi></msub><mo>−</mo><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><msub><mi>i</mi><mi mathvariant="italic">max</mi></msub></mfenced></msubsup></mrow><mn>6</mn></mfrac></math><img file="EP4375993A2_D0014.tif" /></maths> and the maximum floating pitch difference is replaced with this new mean value <maths id="math0015" num="(7)"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><msub><mi>i</mi><mi mathvariant="italic">max</mi></msub></mfenced></msubsup><mo>=</mo><msub><mover accent="true"><mi mathvariant="normal">Δ</mi><mo>‾</mo></mover><mi mathvariant="italic">dfr</mi></msub></math><img file="EP4375993A2_D0015.tif" /></maths>
With this new mean of the floating pitch differences, the normalized deviation <i>f<sub>corr2</sub></i> is computed as: <maths id="math0016" num="(8)"><math display="block"><msub><mi>ƒ</mi><mrow><mi mathvariant="italic">corr</mi><mn>2</mn></mrow></msub><mo>=</mo><mn>1</mn><mo>−</mo><mfrac><msqrt><mstyle displaystyle="true"><msubsup><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mo>−</mo><mn>1</mn></mrow><msub><mi>I</mi><mi mathvariant="italic">sf</mi></msub></msubsup><msup><mfenced><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></msubsup><mo>−</mo><msub><mover accent="true"><mi mathvariant="normal">Δ</mi><mo>‾</mo></mover><mi mathvariant="italic">dfr</mi></msub></mfenced><mn>2</mn></msup></mstyle></msqrt><mrow><msub><mi>I</mi><mi mathvariant="italic">sf</mi></msub><mo>⋅</mo><msub><mi>d</mi><mi mathvariant="italic">max</mi></msub></mrow></mfrac></math><img file="EP4375993A2_D0016.tif" /></maths> wherein <i>I<sub>sf</sub></i> is equal to 4 in the first case and is equal to 6 in the second case.
Depending on this new parameter, a choice is made between the three methods of extrapolating the future pitch: <ul id="ul0001" list-style="dash" compact="compact"><li>If <maths id="math0017"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></msubsup></math><img file="EP4375993A2_D0017.tif" /></maths> changes sign more than twice (this indicates a high pitch variation), the first sign inversion is in the last good frame (for <i>i</i> < 3), and <i>f<sub>corr2</sub></i> > 0.945, the extrapolated pitch, <i>d<sub>ext</sub>,</i> (the extrapolated pitch is also denoted as <i>T<sub>ext</sub></i>) is computed as follows: <maths id="math0018"><math display="block"><msub><mi>s</mi><mi>y</mi></msub><mo>−</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mo>−</mo><mn>1</mn></mrow><mrow><mo>−</mo><mn>4</mn></mrow></munderover><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></msubsup></mstyle></math><img file="EP4375993A2_D0018.tif" /></maths><maths id="math0019"><math display="block"><msub><mi>s</mi><mi mathvariant="italic">xy</mi></msub><mo>=</mo><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mo>−</mo><mn>2</mn></mfenced></msubsup><mo>+</mo><mn>2</mn><mo>⋅</mo><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mo>−</mo><mn>3</mn></mfenced></msubsup><mo>+</mo><mn>3</mn><mo>⋅</mo><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mfenced open="[" close="]"><mo>−</mo><mn>4</mn></mfenced></msubsup></math><img file="EP4375993A2_D0019.tif" /></maths><maths id="math0020"><math display="block"><msub><mi>d</mi><mi mathvariant="italic">est</mi></msub><mo>=</mo><mi mathvariant="italic">round</mi><mfenced open="[" close="]"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">fr</mi><mfenced open="[" close="]"><mo>−</mo><mn>1</mn></mfenced></msubsup><mo>+</mo><mfenced><mfrac><mfenced><mn>7</mn><mo>⋅</mo><msub><mi>s</mi><mi>y</mi></msub><mo>−</mo><mn>3</mn><mo>⋅</mo><msub><mi>s</mi><mi mathvariant="italic">xy</mi></msub></mfenced><mn>10</mn></mfrac></mfenced></mfenced><mo>.</mo></math><img file="EP4375993A2_D0020.tif" /></maths></li><li>If 0.945 < <i>f<sub>corr2</sub></i> < 0.99 and <maths id="math0021"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mi>i</mi></msubsup></math><img file="EP4375993A2_D0021.tif" /></maths> changes sign at least once, the weighted mean of the fractional pitch differences is employed to extrapolate the pitch. The weighting, <i>f<sub>w</sub>,</i> of the mean difference is related to the normalized deviation, <i>f<sub>corr2</sub>,</i> and the position of the first sign inversion is defined as follows: <maths id="math0022"><math display="block"><msub><mi>ƒ</mi><mi>ω</mi></msub><mo>=</mo><msub><mi>ƒ</mi><mrow><mi mathvariant="italic">corr</mi><mn>2</mn></mrow></msub><mo>⋅</mo><mfenced><mfrac><msub><mi>i</mi><mi mathvariant="italic">mem</mi></msub><mn>7</mn></mfrac></mfenced></math><img file="EP4375993A2_D0022.tif" /></maths> The parameter <i>i<sub>mem</sub></i> of the formula depends on the position of the first sign inversion of <maths id="math0023"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">dfr</mi><mi>i</mi></msubsup></math><img file="EP4375993A2_D0023.tif" /></maths>, such that <i>i<sub>mem</sub></i> = 0 if the first sign inversion occurred between the last two subframes of the past frame, such that <i>i<sub>mem</sub> =</i> 1 if the first sign inversion occurred between the 2<sup>nd</sup> and 3<sup>rd</sup> subframes of the past frame, and so on. If the first sign inversion is close to the last frame end, this means that the pitch variation was less stable just before the lost frame. Thus the weighting factor applied to the mean will be close to 0 and the extrapolated pitch <i>d<sub>ext</sub></i> will be close to the pitch of the 4<sup>th</sup> subframe of the last good frame: <maths id="math0024"><math display="block"><msub><mi>d</mi><mi mathvariant="italic">ext</mi></msub><mo>=</mo><mi mathvariant="italic">round</mi><mfenced open="[" close="]"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">fr</mi><mfenced open="[" close="]"><mo>−</mo><mn>1</mn></mfenced></msubsup><mo>+</mo><mn>4</mn><mo>⋅</mo><msub><mover accent="true"><mi mathvariant="normal">Δ</mi><mo>‾</mo></mover><mi mathvariant="italic">dfr</mi></msub><mo>⋅</mo><msub><mi>ƒ</mi><mi>ω</mi></msub></mfenced></math><img file="EP4375993A2_D0024.tif" /></maths></li><li>Otherwise, the pitch evolution is considered stable and the extrapolated pitch <i>d<sub>ext</sub></i> is determined as follows: <maths id="math0025"><math display="block"><msub><mi>d</mi><mi mathvariant="italic">ext</mi></msub><mo>=</mo><mi mathvariant="italic">round</mi><mfenced open="[" close="]"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">fr</mi><mfenced open="[" close="]"><mo>−</mo><mn>1</mn></mfenced></msubsup><mo>+</mo><mn>4</mn><mo>⋅</mo><msub><mover accent="true"><mi mathvariant="normal">Δ</mi><mo>‾</mo></mover><mi mathvariant="italic">dfr</mi></msub></mfenced><mo>.</mo></math><img file="EP4375993A2_D0025.tif" /></maths></li></ul>
After this processing, the pitch lag is limited between 34 and 231 (values denote the minimum and the maximum allowed pitch lags).
Now, to illustrate another example of extrapolation based pitch reconstruction techniques, G.729.1 is considered (see [ITU06b]).
G.729.1 features a pitch extrapolation approach (see [Gao]), in case that no forward error concealment information (e.g., phase information) is decodable. This happens, for example, if two consecutive frames get lost (one superframe consists of four frames which can be either ACELP or TCX20). There are also TCX40 or TCX80 frames possible and almost all combinations of it.
When one or more frames are lost in a voiced region, previous pitch information is always used to reconstruct the current lost frame. The precision of the current estimated pitch may directly influence the phase alignment to the original signal, and it is critical for the reconstruction quality of the current lost frame and the received frame after the lost frame. Using several past pitch lags instead of just copying the previous pitch lag would result in statistically better pitch estimation. In the G.729.1 coder, pitch extrapolation for FEC (FEC = forward error correction) consists of linear extrapolation based on the past five pitch values. The past five pitch values are <i>P</i>(<i>i</i>), for <i>i</i> = 0, 1, 2, 3, 4, wherein <i>P</i>(4) is the latest pitch value. The extrapolation model is defined according to: <maths id="math0026" num="(9)"><math display="block"><mi>P</mi><mo>′</mo><mfenced><mi>i</mi></mfenced><mo>=</mo><mi>a</mi><mo>+</mo><mi>i</mi><mo>⋅</mo><mi>b</mi></math><img file="EP4375993A2_D0026.tif" /></maths>
The extrapolated pitch value for the first subframe in a lost frame is then defined as: <maths id="math0027" num="(10)"><math display="block"><mi>P</mi><mo>′</mo><mfenced><mn>5</mn></mfenced><mo>=</mo><mi>a</mi><mo>+</mo><mn>5</mn><mo>⋅</mo><mi>b</mi></math><img file="EP4375993A2_D0027.tif" /></maths>
In order to determine the coefficients a and b, an error <i>E</i> is minimized, wherein the error <i>E</i> is defined according to: <maths id="math0028" num="(11)"><math display="block"><mtable><mtr><mtd><mi>E</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><msup><mfenced open="[" close="]"><mi>P</mi><mo>′</mo><mfenced><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mstyle></mtd></mtr><mtr><mtd><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><msup><mfenced open="[" close="]"><mfenced><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mstyle></mtd></mtr></mtable></math><img file="EP4375993A2_D0028.tif" /></maths>
By setting <maths id="math0029" num="(12)"><math display="block"><mfrac><mi mathvariant="italic">δE</mi><mi mathvariant="italic">δa</mi></mfrac><mo>=</mo><mn>0</mn><mspace width="1ex" /><mi>and</mi><mspace width="1ex" /><mfrac><mi mathvariant="italic">δE</mi><mi mathvariant="italic">δb</mi></mfrac><mo>=</mo><mn>0</mn></math><img file="EP4375993A2_D0029.tif" /></maths><i>a</i> and <i>b</i> result to: <maths id="math0030" num="(13)"><math display="block"><mi>a</mi><mo>=</mo><mfrac><mrow><mn>3</mn><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><mi>P</mi><mfenced><mi>i</mi></mfenced></mrow></mstyle><mo>−</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><mi>i</mi><mo>⋅</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mrow></mstyle></mrow><mn>5</mn></mfrac><mspace width="1ex" /><mi>and</mi><mspace width="1ex" /><mi>b</mi><mo>=</mo><mfrac><mrow><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><mi>i</mi><mo>⋅</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mrow></mstyle><mo>−</mo><mn>2</mn><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><mi>P</mi><mfenced><mi>i</mi></mfenced></mrow></mstyle></mrow><mn>10</mn></mfrac></math><img file="EP4375993A2_D0030.tif" /></maths>
In the following, a frame erasure concealment concept of the prior art for the AMR-WB codec as presented in [MCZ11] is described. This frame erasure concealment concept is based on pitch and gain linear prediction. Said paper proposes a linear pitch inter/extrapolation approach in case of a frame loss, based on a Minimum Mean Square Error Criterion.
According to this frame erasure concealment concept, at the decoder, when the type of the last valid frame before the erased frame (the past frame) is the same as that of the earliest one after the erased frame (the future frame), the pitch <i>P</i>(i) is defined, where <i>i</i> = <i>-N</i>, <i>-N</i> + 1, ..., 0, 1, ..., <i>N</i> + 4, <i>N</i> + 5, and where <i>N</i> is the number of past and future subframes of the erased frame. <i>P</i>(1), <i>P</i>(2), <i>P</i>(3), <i>P</i>(4) are the four pitches of four subframes in the erased frame, <i>P</i>(0), <i>P</i>(-1), ..., <i>P</i>(<i>-N</i>) are the pitches of the past subframes, and <i>P</i>(5), <i>P</i>(6), ..., <i>P</i>(<i>N</i> + 5) are the pitches of the future subframes. A linear prediction model <i>P'</i>(<i>i</i>) = <i>a</i> + <i>b</i> · <i>i</i> is employed. For <i>i</i> = 1, 2, 3, 4; <i>P'</i>(1), <i>P'</i>(2)<i>, P'</i>(3)<i>, P</i>'(4) are the predicted pitches for the erased frame. The MMS Criterion (MMS = Minimum Mean Square) is taken into account to derive the values of two predicted coefficients <i>a</i> and <i>b</i> according to an interpolation approach. According to this approach, the error <i>E</i> is defined as: <maths id="math0031" num="(14a)"><math display="block"><mtable columnalign="left"><mtr><mtd><mi>E</mi></mtd><mtd><mrow><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mo>−</mo><mi>N</mi></mrow><mn>0</mn></munderover><msup><mfenced open="[" close="]"><mi>P</mi><mo>′</mo><mfenced><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mstyle><mo>+</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mn>5</mn><mrow><mi>N</mi><mo>+</mo><mn>5</mn></mrow></munderover><msup><mfenced open="[" close="]"><mi>P</mi><mo>′</mo><mfenced><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mstyle></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mo>−</mo><mi>N</mi></mrow><mn>0</mn></munderover><msup><mfenced open="[" close="]"><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mstyle><mo>+</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mn>5</mn><mrow><mi>N</mi><mo>+</mo><mn>5</mn></mrow></munderover><msup><mfenced open="[" close="]"><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mstyle></mrow></mtd></mtr></mtable></math><img file="EP4375993A2_D0031.tif" /></maths>
Then, the coefficients <i>a</i> and <i>b</i> can be obtained by calculating <maths id="math0032" num="(14b)"><math display="block"><mtable><mtr><mtd><mrow><mfrac><mi mathvariant="italic">δE</mi><mi mathvariant="italic">δa</mi></mfrac><mo>=</mo><mn>0</mn></mrow></mtd><mtd><mi>and</mi></mtd><mtd><mrow><mfrac><mi mathvariant="italic">δE</mi><mi mathvariant="italic">δb</mi></mfrac><mo>=</mo><mn>0</mn></mrow></mtd></mtr></mtable></math><img file="EP4375993A2_D0032.tif" /></maths><maths id="math0033" num="(14c)"><math display="block"><mi>a</mi><mo>=</mo><mfrac><mrow><mn>2</mn><mfenced open="[" close="]"><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mo>−</mo><mi>N</mi></mrow><mn>0</mn></munderover><mrow><mi>P</mi><mfenced><mi>i</mi></mfenced></mrow></mstyle><mo>+</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>5</mn></mrow><mrow><mi>N</mi><mo>+</mo><mn>5</mn></mrow></munderover><mrow><mi>P</mi><mfenced><mi>i</mi></mfenced></mrow></mstyle></mfenced><mo>⋅</mo><mfenced><msup><mi>N</mi><mn>3</mn></msup><mo>+</mo><mn>9</mn><msup><mi>N</mi><mn>2</mn></msup><mo>+</mo><mn>38</mn><mi>N</mi><mo>+</mo><mn>1</mn></mfenced></mrow><mrow><mfenced><mi>N</mi><mo>+</mo><mn>1</mn></mfenced><mo>⋅</mo><mfenced><mn>4</mn><msup><mi>N</mi><mn>3</mn></msup><mo>+</mo><mn>36</mn><msup><mi>N</mi><mn>2</mn></msup><mo>+</mo><mn>107</mn><mi>N</mi><mo>−</mo><mn>1</mn></mfenced></mrow></mfrac></math><img file="EP4375993A2_D0033.tif" /></maths><maths id="math0034" num="(14d)"><math display="block"><mi>b</mi><mo>=</mo><mfrac><mrow><mn>9</mn><mfenced open="[" close="]"><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mo>−</mo><mi>N</mi></mrow><mn>0</mn></munderover><mrow><mi>P</mi><mfenced><mi>i</mi></mfenced></mrow></mstyle><mo>+</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>5</mn></mrow><mrow><mi>N</mi><mo>+</mo><mn>5</mn></mrow></munderover><mrow><mi>P</mi><mfenced><mi>i</mi></mfenced></mrow></mstyle></mfenced></mrow><mrow><mn>1</mn><mo>−</mo><mn>107</mn><mi>N</mi><mo>−</mo><mn>36</mn><msup><mi>N</mi><mn>2</mn></msup><mo>−</mo><mn>4</mn><msup><mi>N</mi><mn>3</mn></msup></mrow></mfrac></math><img file="EP4375993A2_D0034.tif" /></maths>
The pitch lags for the last four subframes of the erased frame can be calculated according to: <maths id="math0035" num="(14e)"><math display="block"><mtable><mtr><mtd><mtable columnalign="left"><mtr><mtd><mi>P</mi><mo>′</mo><mfenced><mn>1</mn></mfenced><mo>=</mo><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mn>1</mn><mo>;</mo></mtd></mtr><mtr><mtd><mi>P</mi><mo>′</mo><mfenced><mn>3</mn></mfenced><mo>=</mo><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mn>3</mn><mo>;</mo></mtd></mtr></mtable></mtd><mtd><mtable columnalign="left"><mtr><mtd><mi>P</mi><mo>′</mo><mfenced><mn>2</mn></mfenced><mo>=</mo><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mn>2</mn></mtd></mtr><mtr><mtd><mi>P</mi><mo>′</mo><mfenced><mn>4</mn></mfenced><mo>=</mo><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mn>4</mn></mtd></mtr></mtable></mtd></mtr></mtable></math><img file="EP4375993A2_D0035.tif" /></maths>
It is found that <i>N</i> = 4 provides the best result. <i>N</i> = 4 means that five past subframes and five future subframes are used for the interpolation.
However, when the type of the past frames is different from the type of the future frames, for example, when the past frame is voiced but the future frame is unvoiced, just the voiced pitches of the past or the future frames are used to predict the pitches of the erased frame using the above extrapolation approach.
Now, pulse resynchronization in the prior art is considered, in particular with reference to G.718 and G.729.1. An approach for pulse resynchronization is described in [VJGS12].
At first, constructing the periodic part of the excitation is described.
For a concealment of erased frames following a correctly received frame other than UNVOICED, the periodic part of the excitation is constructed by repeating the low pass filtered last pitch period of the previous frame.
The construction of the periodic part is done using a simple copy of a low pass filtered segment of the excitation signal from the end of the previous frame.
The pitch period length is rounded to the closest integer: <maths id="math0036" num="(15a)"><math display="block"><msub><mi>T</mi><mi>c</mi></msub><mo>=</mo><mi mathvariant="italic">round</mi><mfenced><mi mathvariant="italic">last</mi><mo>_</mo><mi mathvariant="italic">pitch</mi></mfenced></math><img file="EP4375993A2_D0036.tif" /></maths>
Considering that the last pitch period length is <i>T<sub>p</sub>,</i> then the length of the segment that is copied, <i>T<sub>r</sub></i>, may, e.g., be defined according to: <maths id="math0037" num="(15b)"><math display="block"><msub><mi>T</mi><mi>r</mi></msub><mo>=</mo><mrow><mo>⌊</mo><mrow><msub><mi>T</mi><mi>p</mi></msub><mo>+</mo><mn>0.5</mn></mrow><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0037.tif" /></maths>
The periodic part is constructed for one frame and one additional subframe.
For example, with <i>M</i> subframes in a frame, the subframe length is <maths id="math0038"><math display="inline"><mi>L</mi><mo>_</mo><mi mathvariant="italic">subfr</mi><mo>=</mo><mfrac><mi>L</mi><mi>M</mi></mfrac></math><img file="EP4375993A2_D0038.tif" /></maths>. wherein <i>L</i> is the frame length, also denoted as <i>L<sub>frame</sub></i>: <i>L</i> = <i>L<sub>frame</sub>.</i>
<figref idref="f0005">Fig. 3</figref> illustrates a constructed periodic part of a speech signal.
<i>T</i> [0] is the location of the first maximum pulse in the constructed periodic part of the excitation. The positions of the other pulses are given by: <maths id="math0039" num="(16a)"><math display="block"><mi>T</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>=</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mi>i</mi><mspace width="1ex" /><msub><mi>T</mi><mi>c</mi></msub></math><img file="EP4375993A2_D0039.tif" /></maths> corresponding to <maths id="math0040" num="(16b)"><math display="block"><mi>T</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>=</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mi>i</mi><mspace width="1ex" /><msub><mi>T</mi><mi>r</mi></msub></math><img file="EP4375993A2_D0040.tif" /></maths>
After the construction of the periodic part of the excitation, the glottal pulse resynchronization is performed to correct the difference between the estimated target position of the last pulse in the lost frame (<i>P</i>), and its actual position in the constructed periodic part of the excitation (<i>T</i>(<i>k</i>]).
The pitch lag evolution is extrapolated based on the pitch lags of the last seven subframes before the lost frame. The evolving pitch lags in each subframe are: <maths id="math0041" num="(17a)"><math display="block"><mi>p</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>=</mo><mi mathvariant="italic">round</mi><mfenced><msub><mi>T</mi><mi>c</mi></msub><mo>+</mo><mfenced><mi>i</mi><mo>+</mo><mn>1</mn></mfenced><mi>δ</mi></mfenced><mo>,</mo><mspace width="1ex" /><mn>0</mn><mo>≤</mo><mi>i</mi><mo><</mo><mi>M</mi></math><img file="EP4375993A2_D0041.tif" /></maths> where <maths id="math0042" num="(17b)"><math display="block"><mi>δ</mi><mo>=</mo><mfrac><mrow><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub><mo>−</mo><msub><mi>T</mi><mi>c</mi></msub></mrow><mi>M</mi></mfrac></math><img file="EP4375993A2_D0042.tif" /></maths> and <i>T<sub>ext</sub></i> (also denoted as <i>d<sub>ext</sub></i>) is the extrapolated pitch as described above for <i>d<sub>ext</sub>.</i>
The difference, denoted as <i>d</i>, between the sum of the total number of samples within pitch cycles with the constant pitch (<i>T<sub>c</sub></i>) and the sum of the total number of samples within pitch cycles with the evolving pitch, <i>p</i>[<i>i</i>], is found within a frame length. There is no description in the documentation how to find <i>d.</i>
In the source code of G.718 (see [ITU08a]), <i>d</i> is found using the following algorithm (where <i>M</i> is the number of subframes in a frame): <img file="EP4375993A2_D0043.tif" />
The number of pulses in the constructed periodic part within a frame length plus the first pulse in the future frame is <i>N.</i> There is no description in the documentation how to find <i>N.</i>
In the source code of G.718 (see [ITU08a]), <i>N</i> is found according to: <maths id="math0043" num="(18a)"><math display="block"><mi>N</mi><mo>=</mo><mn>1</mn><mo>+</mo><mrow><mo>⌊</mo><mfrac><mrow><mi>L</mi><mo>_</mo><mi mathvariant="italic">frame</mi></mrow><mi mathvariant="italic">Tc</mi></mfrac><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0044.tif" /></maths>
The position of the last pulse <i>T</i>[<i>n</i>] in the constructed periodic part of the excitation that belongs to the lost frame is determined by: <maths id="math0044" num="(18b)"><math display="block"><mi>n</mi><mo>=</mo><mrow><mo>{</mo><mtable><mtr><mtd><mrow><mi>N</mi><mo>−</mo><mn>1</mn><mspace width="1ex" /><mo>,</mo><mspace width="1ex" /><mi>T</mi><mfenced open="[" close="]"><mi>N</mi><mo>−</mo><mn>1</mn></mfenced><mo><</mo><mi>L</mi><mo>_</mo><mi mathvariant="italic">frame</mi></mrow></mtd></mtr><mtr><mtd><mrow><mi>N</mi><mo>−</mo><mn>2</mn><mspace width="1ex" /><mo>,</mo><mspace width="1ex" /><mi>T</mi><mfenced open="[" close="]"><mi>N</mi><mo>−</mo><mn>1</mn></mfenced><mo>≥</mo><mi>L</mi><mo>_</mo><mi mathvariant="italic">frame</mi></mrow></mtd></mtr></mtable></mrow></math><img file="EP4375993A2_D0045.tif" /></maths>
The estimated last pulse position <i>P</i> is: <maths id="math0045" num="(19a)"><math display="block"><mi>P</mi><mo>=</mo><mi>T</mi><mfenced open="[" close="]"><mi>n</mi></mfenced><mo>+</mo><mi>d</mi></math><img file="EP4375993A2_D0046.tif" /></maths>
The actual position of the last pulse position <i>T</i> [<i>k</i>] is the position of the pulse in the constructed periodic part of the excitation (including in the search the first pulse after the current frame) closest to the estimated target position <i>P</i>: <maths id="math0046" num="(19b)"><math display="block"><mo>∀</mo><mi>i</mi><mspace width="1ex" /><mfenced open="|" close="|"><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced><mo>−</mo><mi>P</mi></mfenced><mo>≤</mo><mfenced open="|" close="|"><mi>T</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>−</mo><mi>P</mi></mfenced><mo>,</mo><mspace width="1ex" /><mn>0</mn><mo>≤</mo><mi>i</mi><mo><</mo><mi>N</mi></math><img file="EP4375993A2_D0047.tif" /></maths>
The glottal pulse resynchronization is conducted by adding or removing samples in the minimum energy regions of the full pitch cycles. The number of samples to be added or removed is determined by the difference: <maths id="math0047" num="(19c)"><math display="block"><mi mathvariant="italic">diff</mi><mo>=</mo><mi>P</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></math><img file="EP4375993A2_D0048.tif" /></maths>
The minimum energy regions are determined using a sliding 5-sample window. The minimum energy position is set at the middle of the window at which the energy is at a minimum. The search is performed between two pitch pulses from <i>T</i> [<i>i</i>] + <i>T<sub>c</sub></i> / 8 to <i>T</i>[<i>i</i> + 1] - <i>T<sub>c</sub></i>/4<i>.</i> There are <i>N<sub>min</sub></i> = <i>n</i> - 1 minimum energy regions.
If <i>N<sub>min</sub></i> = 1, then there is only one minimum energy region and <i>dif f</i> samples are inserted or deleted at that position.
For <i>N<sub>min</sub></i> > 1, less samples are added or removed at the beginning and more towards the end of the frame. The number of samples to be removed or added between pulses <i>T</i>[<i>i</i>] and <i>T</i>[<i>i</i>+1] is found using the following recursive relation: <maths id="math0048" num="(19d)"><math display="block"><mi>R</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>=</mo><mi mathvariant="italic">round</mi><mfenced><mfrac><msup><mfenced><mi>i</mi><mo>+</mo><mn>1</mn></mfenced><mn>2</mn></msup><mn>2</mn></mfrac><mi>ƒ</mi><mo>−</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>k</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>i</mi><mo>−</mo><mn>1</mn></mrow></munderover><mrow><mi>R</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow></mstyle></mfenced><mspace width="1ex" /><mi>with</mi><mspace width="1ex" /><mi>ƒ</mi><mo>=</mo><mfrac><mrow><mn>2</mn><mfenced open="|" close="|"><mi mathvariant="italic">diff</mi></mfenced></mrow><msubsup><mi>N</mi><mi>min</mi><mn>2</mn></msubsup></mfrac></math><img file="EP4375993A2_D0049.tif" /></maths>
If <i>R</i>[<i>i</i>] < <i>R</i>[<i>i</i> - 1], then the values of <i>R</i>[<i>i</i>] and <i>R</i>[<i>i</i> - 1] are interchanged.
The object of the present invention is to provide improved concepts for audio signal processing, in particular, to provide improved concepts for speech processing, and, more particularly, to provide improved concealment concepts.
The object of the present invention is solved by an apparatus according to claim 1, by a method according to claim 15 and by a computer program according to claim 16.
An apparatus for determining an estimated pitch lag is provided. The apparatus comprises an input interface for receiving a plurality of original pitch lag values, and a pitch lag estimator for estimating the estimated pitch lag. The pitch lag estimator is configured to estimate the estimated pitch lag depending on a plurality of original pitch lag values and depending on a plurality of information values, wherein for each original pitch lag value of the plurality of original pitch lag values, an information value of the plurality of information values is assigned to said original pitch lag value.
According to an embodiment, the pitch lag estimator may, e.g., be configured to estimate the estimated pitch lag depending on the plurality of original pitch lag values and depending on a plurality of pitch gain values as the plurality of information values, wherein for each original pitch lag value of the plurality of original pitch lag values, a pitch gain value of the plurality of pitch gain values is assigned to said original pitch lag value.
In a particular embodiment, each of the plurality of pitch gain values may, e.g., be an adaptive codebook gain.
In an embodiment, the pitch lag estimator may, e.g., be configured to estimate the estimated pitch lag by minimizing an error function.
According to an embodiment, the pitch lag estimator may, e.g., be configured to estimate the estimated pitch lag by determining two parameters <i>a, b,</i> by minimizing the error function <maths id="math0049"><math display="block"><mi mathvariant="italic">err</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mi>k</mi></munderover><mrow><msub><mi>g</mi><mi>p</mi></msub><mfenced><mi>i</mi></mfenced><mo>⋅</mo><msup><mfenced><mfenced><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mrow></mstyle><mo>,</mo></math><img file="EP4375993A2_D0050.tif" /></maths> wherein <i>a</i> is a real number, wherein <i>b</i> is a real number, wherein <i>k</i> is an integer with <i>k</i> ≥ 2, and wherein P(i) is the <i>i</i>-th original pitch lag value, wherein <i>g<sub>p</sub></i>(<i>i</i>) is the <i>i</i>-th pitch gain value being assigned to the <i>i</i> -th pitch lag value P(<i>i</i>).
In an embodiment, the pitch lag estimator may, e.g., be configured to estimate the estimated pitch lag by determining two parameters <i>a, b,</i> by minimizing the error function <maths id="math0050"><math display="block"><mi mathvariant="italic">err</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><msub><mi>g</mi><mi>p</mi></msub><mfenced><mi>i</mi></mfenced><mo>⋅</mo><msup><mfenced><mfenced><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mrow></mstyle><mo>,</mo></math><img file="EP4375993A2_D0051.tif" /></maths> wherein <i>a</i> is a real number, wherein <i>b</i> is a real number, wherein P(i) is the <i>i</i>-th original pitch lag value, wherein <i>g<sub>p</sub></i>(<i>i</i>) is the <i>i</i>-th pitch gain value being assigned to the <i>i</i> -th pitch lag value P(<i>i</i>).
According to an embodiment, the pitch lag estimator may, e.g., be configured to determine the estimated pitch lag <i>p</i> according to <i>p</i> = <i>a</i> · <i>i</i> + <i>b.</i>
In an embodiment, the pitch lag estimator may, e.g., be configured to estimate the estimated pitch lag depending on the plurality of original pitch lag values and depending on a plurality of time values as the plurality of information values, wherein for each original pitch lag value of the plurality of original pitch lag values, a time value of the plurality of time values is assigned to said original pitch lag value.
According to an embodiment, the pitch lag estimator may, e.g., be configured to estimate the estimated pitch lag by minimizing an error function.
In an embodiment, the pitch lag estimator may, e.g., be configured to estimate the estimated pitch lag by determining two parameters <i>a, b,</i> by minimizing the error function <maths id="math0051"><math display="block"><mi mathvariant="italic">err</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mi>k</mi></munderover><mrow><msub><mi mathvariant="italic">time</mi><mi mathvariant="italic">passed</mi></msub><mfenced><mi>i</mi></mfenced><mo>⋅</mo><msup><mfenced><mfenced><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mrow></mstyle><mo>,</mo></math><img file="EP4375993A2_D0052.tif" /></maths> wherein <i>a</i> is a real number, wherein <i>b</i> is a real number, wherein <i>k</i> is an integer with <i>k</i> ≥ 2, and wherein P(i) is the <i>i</i>-th original pitch lag value, wherein <i>time<sub>passed</sub></i>(<i>i</i>) is the <i>i</i>-th time value being assigned to the <i>i</i> -th pitch lag value P(<i>i</i>).
According to an embodiment, the pitch lag estimator may, e.g., be configured to estimate the estimated pitch lag by determining two parameters <i>a, b,</i> by minimizing the error function <maths id="math0052"><math display="block"><mi mathvariant="italic">err</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><msub><mi mathvariant="italic">time</mi><mi mathvariant="italic">passed</mi></msub><mfenced><mi>i</mi></mfenced><mo>⋅</mo><msup><mfenced><mfenced><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mrow></mstyle><mo>,</mo></math><img file="EP4375993A2_D0053.tif" /></maths> wherein <i>a</i> is a real number, wherein <i>b</i> is a real number, wherein <i>P</i>(<i>i</i>) is the <i>i</i>-th original pitch lag value, wherein <i>time<sub>passe</sub></i>(<i>i</i>) is the <i>i</i>-th time value being assigned to the <i>i</i> -th pitch lag value P(<i>i</i>).
In an embodiment, the pitch lag estimator is configured to determine the estimated pitch lag <i>p</i> according to <i>p</i> = <i>a</i> · <i>i</i> + <i>b.</i>
Moreover, a method for determining an estimated pitch lag is provided. The method comprises: <ul id="ul0002" list-style="dash"><li>Receiving a plurality of original pitch lag values. And:</li><li>Estimating the estimated pitch lag.</li></ul>
Estimating the estimated pitch lag is conducted depending on a plurality of original pitch lag values and depending on a plurality of information values, wherein for each original pitch lag value of the plurality of original pitch lag values, an information value of the plurality of information values is assigned to said original pitch lag value.
Furthermore, a computer program for implementing the above-described method when being executed on a computer or signal processor is provided.
Moreover, an apparatus for reconstructing a frame comprising a speech signal as a reconstructed frame is provided, said reconstructed frame being associated with one or more available frames, said one or more available frames being at least one of one or more preceding frames of the reconstructed frame and one or more succeeding frames of the reconstructed frame, wherein the one or more available frames comprise one or more pitch cycles as one or more available pitch cycles. The apparatus comprises a determination unit for determining a sample number difference indicating a difference between a number of samples of one of the one or more available pitch cycles and a number of samples of a first pitch cycle to be reconstructed. Moreover, the apparatus comprises a frame reconstructor for reconstructing the reconstructed frame by reconstructing, depending on the sample number difference and depending on the samples of said one of the one or more available pitch cycles, the first pitch cycle to be reconstructed as a first reconstructed pitch cycle. The frame reconstructor is configured to reconstruct the reconstructed frame, such that the reconstructed frame completely or partially comprises the first reconstructed pitch cycle, such that the reconstructed frame completely or partially comprises a second reconstructed pitch cycle, and such that the number of samples of the first reconstructed pitch cycle differs from a number of samples of the second reconstructed pitch cycle.
According to an embodiment, the determination unit may, e.g., be configured to determine a sample number difference for each of a plurality of pitch cycles to be reconstructed, such that the sample number difference of each of the pitch cycles indicates a difference between the number of samples of said one of the one or more available pitch cycles and a number of samples of said pitch cycle to be reconstructed. The frame reconstructor may, e.g., be configured to reconstruct each pitch cycle of the plurality of pitch cycles to be reconstructed depending on the sample number difference of said pitch cycle to be reconstructed and depending on the samples of said one of the one or more available pitch cycles, to reconstruct the reconstructed frame.
In an embodiment, the frame reconstructor may, e.g., be configured to generate an intermediate frame depending on said one of the of the one or more available pitch cycles. The frame reconstructor may, e.g., be configured to modify the intermediate frame to obtain the reconstructed frame.
According to an embodiment, the determination unit may, e.g., be configured to determine a frame difference value (<i>d</i>; <i>s</i>) indicating how many samples are to be removed from the intermediate frame or how many samples are to be added to the intermediate frame. Moreover, the frame reconstructor may, e.g., be configured to remove first samples from the intermediate frame to obtain the reconstructed frame, when the frame difference value indicates that the first samples shall be removed from the frame. Furthermore, the frame reconstructor may, e.g., be configured to add second samples to the intermediate frame to obtain the reconstructed frame, when the frame difference value (<i>d; s</i>) indicates that the second samples shall be added to the frame.
In an embodiment, the frame reconstructor may, e.g., be configured to remove the first samples from the intermediate frame when the frame difference value indicates that the first samples shall be removed from the frame, so that the number of first samples that are removed from the intermediate frame is indicated by the frame difference value. Moreover, the frame reconstructor may, e.g., be configured to add the second samples to the intermediate frame when the frame difference value indicates that the second samples shall be added to the frame, so that the number of second samples that are added to the intermediate frame is indicated by the frame difference value.
According to an embodiment, the determination unit may, e.g., be configured to determine the frame difference number <i>s</i> so that the formula: <maths id="math0053"><math display="block"><mi>s</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>M</mi><mo>−</mo><mn>1</mn></mrow></munderover><mrow><mfenced><mi>p</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>−</mo><msub><mi>T</mi><mi>r</mi></msub></mfenced><mfrac><mi>L</mi><msub><mi mathvariant="italic">MT</mi><mi>r</mi></msub></mfrac></mrow></mstyle></math><img file="EP4375993A2_D0054.tif" /></maths> holds true, wherein <i>L</i> indicates a number of samples of the reconstructed frame, wherein <i>M</i> indicates a number of subframes of the reconstructed frame, wherein <i>T<sub>r</sub></i> indicates a rounded pitch period length of said one of the one or more available pitch cycles, and wherein <i>p</i>[<i>i</i>] indicates a pitch period length of a reconstructed pitch cycle of the <i>i</i>-th subframe of the reconstructed frame.
In an embodiment, the frame reconstructor may, e.g., be adapted to generate an intermediate frame depending on said one of the one or more available pitch cycles. Moreover, the frame reconstructor may, e.g., be adapted to generate the intermediate frame so that the intermediate frame comprises a first partial intermediate pitch cycle, one or more further intermediate pitch cylces, and a second partial intermediate pitch cycle. Furthermore, the first partial intermediate pitch cycle may, e.g., depend on one or more of the samples of said one of the one or more available pitch cycles, wherein each of the one or more further intermediate pitch cycles depends on all of the samples of said one of the one or more available pitch cycles, and wherein the second partial intermediate pitch cycle depends on one or more of the samples of said one of the one or more available pitch cycles. Moreover, the determination unit may, e.g., be configured to determine a start portion difference number indicating how many samples are to be removed or added from the first partial intermediate pitch cycle, and wherein the frame reconstructor is configured to remove one or more first samples from the first partial intermediate pitch cycle, or is configured to add one or more first samples to the first partial intermediate pitch cycle depending on the start portion difference number. Furthermore, the determination unit may, e.g., be configured to determine for each of the further intermediate pitch cycles a pitch cycle difference number indicating how many samples are to be removed or added from said one of the further intermediate pitch cycles. Moreover, the frame reconstructor may, e.g., be configured to remove one or more second samples from said one of the further intermediate pitch cycles, or is configured to add one or more second samples to said one of the further intermediate pitch cycles depending on said pitch cycle difference number. Furthermore, the determination unit may, e.g., be configured to determine an end portion difference number indicating how many samples are to be removed or added from the second partial intermediate pitch cycle, and wherein the frame reconstructor is configured to remove one or more third samples from the second partial intermediate pitch cycle, or is configured to add one or more third samples to the second partial intermediate pitch cycle depending on the end portion difference number.
According to an embodiment, the frame reconstructor may, e.g., be configured to generate an intermediate frame depending on said one of the of the one or more available pitch cycles. Moreover, the determination unit may, e.g., be adapted to determine one or more low energy signal portions of the speech signal comprised by the intermediate frame, wherein each of the one or more low energy signal portions is a first signal portion of the speech signal within the intermediate frame, where the energy of the speech signal is lower than in a second signal portion of the speech signal comprised by the intermediate frame. Furthermore, the frame reconstructor may, e.g., be configured to remove one or more samples from at least one of the one or more low energy signal portions of the speech signal, or to add one or more samples to at least one of the one or more low energy signal portions of the speech signal, to obtain the reconstructed frame.
In a particular embodiment, the frame reconstructor may, e.g., be configured to generate the intermediate frame, such that the intermediate frame comprises one or more reconstructed pitch cycles, such that each of the one or more reconstructed pitch cylces depends on said one of the of the one or more available pitch cycles. Moreover, the determination unit may, e.g., be configured to determine a number of samples that shall be removed from each of the one or more reconstructed pitch cycles. Furthermore, the determination unit may, e.g., be configured to determine each of the one or more low energy signal portions such that for each of the one or more low energy signal portions a number of samples of said low energy signal portion depends on the number of samples that shall be removed from one of the one or more reconstructed pitch cycles, wherein said low energy signal portion is located within said one of the one or more reconstructed pitch cycles.
In an embodiment, the determination unit may, e.g., be configured to determine a position of one or more pulses of the speech signal of the frame to be reconstructed as reconstructed frame. Moreover, the frame reconstructor may, e.g., be configured to reconstruct the reconstructed frame depending on the position of the one or more pulses of the speech signal.
According to an embodiment, the determination unit may, e.g., be configured to determine a position of two or more pulses of the speech signal of the frame to be reconstructed as reconstructed frame, wherein <i>T</i>[0] is the position of one of the two or more pulses of the speech signal of the frame to be reconstructed as reconstructed frame, and wherein the determination unit is configured to determine the position (<i>T</i>[<i>i</i>]) of further pulses of the two or more pulses of the speech signal according to the formula: <maths id="math0054"><math display="block"><mi>T</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>=</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mi>i</mi><mspace width="1ex" /><msub><mi>T</mi><mi>r</mi></msub></math><img file="EP4375993A2_D0055.tif" /></maths> wherein <i>T<sub>r</sub></i> indicates a rounded length of said one of the one or more available pitch cycles, and wherein <i>i</i> is an integer.
According to an embodiment, the determination unit may, e.g., be configured to determine an index <i>k</i> of the last pulse of the speech signal of the frame to be reconstructed as the reconstructed frame such that <maths id="math0055"><math display="block"><mi>k</mi><mo>=</mo><mrow><mo>⌈</mo><mrow><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>−</mo><mn>1</mn></mrow><mo>⌉</mo></mrow><mo>,</mo></math><img file="EP4375993A2_D0056.tif" /></maths> wherein <i>L</i> indicates a number of samples of the reconstructed frame, wherein <i>s</i> indicates the frame difference value, wherein <i>T</i> [0] indicates a position of a pulse of the speech signal of the frame to be reconstructed as the reconstructed frame, being different from the last pulse of the speech signal, and wherein <i>T<sub>r</sub></i> indicates a rounded length of said one of the one or more available pitch cycles.
In an embodiment, the determination unit may, e.g., be configured to reconstruct the frame to be reconstructed as the reconstructed frame by determining a parameter <i>δ</i> , wherein <i>δ</i> is defined according to the formula: <maths id="math0056"><math display="block"><mi>δ</mi><mo>=</mo><mfrac><mrow><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub><mo>−</mo><msub><mi>T</mi><mi>p</mi></msub></mrow><mi>M</mi></mfrac></math><img file="EP4375993A2_D0057.tif" /></maths> wherein the frame to be reconstructed as the reconstructed frame comprises <i>M</i> subframes, wherein <i>T<sub>p</sub></i> indicates the length of said one of the one or more available pitch cycles, and wherein <i>T<sub>ext</sub></i> indicates a length of one of the pitch cycles to be reconstructed of the frame to be reconstructed as the reconstructed frame.
According to an embodiment, the determination unit may, e.g., be configured to reconstruct the reconstructed frame by determining a rounded length <i>T<sub>r</sub></i> of said one of the one or more available pitch cycles based on formula: <maths id="math0057"><math display="block"><msub><mi>T</mi><mi>r</mi></msub><mo>=</mo><mrow><mo>⌊</mo><mrow><msub><mi>T</mi><mi>p</mi></msub><mo>+</mo><mn>0.5</mn></mrow><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0058.tif" /></maths> wherein <i>T<sub>p</sub></i> indicates the length of said one of the one or more available pitch cycles.
In an embodiment, the determination unit may, e.g., be configured to reconstruct the reconstructed frame by applying the formula: <maths id="math0058"><math display="block"><mi>s</mi><mo>=</mo><mi>δ</mi><mfrac><mi>L</mi><msub><mi>T</mi><mi>r</mi></msub></mfrac><mfrac><mrow><mi>M</mi><mo>+</mo><mn>1</mn></mrow><mn>2</mn></mfrac><mo>−</mo><mi>L</mi><mfenced><mn>1</mn><mo>−</mo><mfrac><msub><mi>T</mi><mi>p</mi></msub><msub><mi>T</mi><mi>r</mi></msub></mfrac></mfenced></math><img file="EP4375993A2_D0059.tif" /></maths> wherein <i>T<sub>p</sub></i> indicates the length of said one of the one or more available pitch cycles, wherein <i>T<sub>r</sub></i> indicates a rounded length of said one of the one or more available pitch cycles, wherein the frame to be reconstructed as the reconstructed frame comprises <i>M</i> subframes, wherein the frame to be reconstructed as the reconstructed frame comprises <i>L</i> samples, and wherein <i>δ</i> is a real number indicating a difference between a number of samples of said one of the one or more available pitch cycles and a number of samples of one of one or more pitch cycles to be reconstructed.
Moreover, a method for reconstructing a frame comprising a speech signal as a reconstructed frame is provided, said reconstructed frame being associated with one or more available frames, said one or more available frames being at least one of one or more preceding frames of the reconstructed frame and one or more succeeding frames of the reconstructed frame, wherein the one or more available frames comprise one or more pitch cycles as one or more available pitch cycles. The method comprises: <ul id="ul0003" list-style="dash" compact="compact"><li>Determining a sample number difference ( <maths id="math0059"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup></math><img file="EP4375993A2_D0060.tif" /></maths>; Δ<i><sub>i</sub></i> ; <maths id="math0060"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mi>p</mi></msubsup></math><img file="EP4375993A2_D0061.tif" /></maths>) indicating a difference between a number of samples of one of the one or more available pitch cycles and a number of samples of a first pitch cycle to be reconstructed. And: <ul id="ul0004" list-style="none" compact="compact"><li>- Reconstructing the reconstructed frame by reconstructing, depending on the sample number difference ( <maths id="math0061"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup></math><img file="EP4375993A2_D0062.tif" /></maths>; Δ<i><sub>i</sub></i> ; <maths id="math0062"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mi>p</mi></msubsup></math><img file="EP4375993A2_D0063.tif" /></maths>) and depending on the samples of said one of the one or more available pitch cycles, the first pitch cycle to be reconstructed as a first reconstructed pitch cycle.</li></ul></li></ul>
Reconstructing the reconstructed frame is conducted, such that the reconstructed frame completely or partially comprises the first reconstructed pitch cycle, such that the reconstructed frame completely or partially comprises a second reconstructed pitch cycle, and such that the number of samples of the first reconstructed pitch cycle differs from a number of samples of the second reconstructed pitch cycle.
Furthermore, a computer program for implementing the above-described method when being executed on a computer or signal processor is provided.
Moreover, a system for reconstructing a frame comprising a speech signal is provided. The system comprises an apparatus for determining an estimated pitch lag according to one of the above-described or below-described embodiments, and an apparatus for reconstructing the frame, wherein the apparatus for reconstructing the frame is configured to reconstruct the frame depending on the estimated pitch lag. The estimated pitch lag is a pitch lag of the speech signal.
In an embodiment, the reconstructed frame may, e.g., be associated with one or more available frames, said one or more available frames being at least one of one or more preceding frames of the reconstructed frame and one or more succeeding frames of the reconstructed frame, wherein the one or more available frames comprise one or more pitch cycles as one or more available pitch cycles. The apparatus for reconstructing the frame may, e.g., be an apparatus for reconstructing a frame according to one of the above-described or below-described embodiments.
The present invention is based on the finding that the prior art has significant drawbacks. Both G.718 (see [ITU08a]) and G.729.1 (see [ITU06b]) use pitch extrapolation in case of a frame loss. This is necessary, because in case of a frame loss, also the pitch lags are lost. According to G.718 and G.729.1, the pitch is extrapolated by taking the pitch evolution during the last two frames into account. However, the pitch lag being reconstructed by G.718 and G.729.1 is not very accurate and, e.g., often results in a reconstructed pitch lag that differs significantly from the real pitch lag.
Embodiments of the present invention provide a more accurate pitch lag reconstruction. For this purpose, in contrast to G.718 and G.729.1, some embodiments take information on the reliability of the pitch information into account.
According to the prior art, the pitch information on which the extrapolation is based comprises the last eight correctly received pitch lags, for which the coding mode was different from UNVOICED. However, in the prior art, the voicing characteristic might be quite weak, indicated by a low pitch gain (which corresponds to a low prediction gain). In the prior art, in case the extrapolation is based on pitch lags which have different pitch gains, the extrapolation will not be able to output reasonable results or even fail at all and will fall back to a simple pitch lag repetition approach.
Embodiments are based on the finding that the reason for these shortcomings of the prior art are that on the encoder side, the pitch lag is chosen with respect to maximize the pitch gain in order to maximize the coding gain of the adaptive codebook, but that, in case the speech characteristic is weak, the pitch lag might not indicate the fundamental frequency precisely, since the noise in the speech signal causes the pitch lag estimation to become imprecise.
Therefore, during concealment, according to embodiments, the application of the pitch lag extrapolation is weighted depending on the reliability of the previously received lags used for this extrapolation.
According to some embodiments, the past adaptive codebook gains (pitch gains) may be employed as a reliability measure.
According to some further embodiments of the present invention, weighting according to how far in the past, the pitch lags were received, is used as a reliability measure. For example, high weights are put to more recent lags and less weights are put to lags being received longer ago.
According to embodiments, weighted pitch prediction concepts are provided. In contrast to the prior art, the provided pitch prediction of embodiments of the present invention uses a reliability measure for each of the pitch lags it is based on, making the prediction result much more valid and stable. Particularly, the pitch gain can be used as an indicator for the reliability. Alternatively or additionally, according to some embodiments, the time that has been passed after the correct reception of the pitch lag may, for example, be used as an indicator.
Regarding pulse resynchronization, the present invention is based on the finding that one of the shortcomings of the prior art regarding the glottal pulse resynchronization is, that the pitch extrapolation does not take into account, how many pulses (pitch cycles) should be constructed in the concealed frame.
According to the prior art, the pitch extrapolation is conducted such that changes in the pitch are only expected at the borders of the subframes.
According to embodiments, when conducting glottal pulse resynchronization, pitch changes which are different from continuous pitch changes can be taken into account.
Embodiments of the present invention are based on the finding that G.718 and G.729.1 have the following drawbacks:
At first, in the prior art, when calculating <i>d</i>, it is assumed that there is an integer number of pitch cycles within the frame. Since <i>d</i> defines the location of the last pulse in the concealed frame, the position of the last pulse will not be correct, when there is a non-integer number of the pitch cycles within the frame. This is depicted in <figref idref="f0008">Fig. 6</figref> and <figref idref="f0009">Fig. 7</figref><figref idref="f0008">Fig. 6</figref> illustrates a speech signal before a removal of samples. <figref idref="f0009">Fig. 7</figref> illustrates the speech signal after the removal of samples. Furthermore, the algorithm employed by the prior art for the calculation of <i>d</i> is inefficient.
Moreover, the calculation of the prior art requires the number of pulses <i>N</i> in the constructed periodic part of the excitation. This adds not needed computational complexity.
Furthermore, in the prior art, the calculation of the number of pulses <i>N</i> in the constructed periodic part of the excitation does not take the location of the first pulse into account.
The signals presented in <figref idref="f0006">Fig. 4</figref> and <figref idref="f0007">Fig. 5</figref> have the same pitch period of length <i>T<sub>c</sub>.</i>
<figref idref="f0006">Fig. 4</figref> illustrates a speech signal having 3 pulses within a frame.
In contrast, <figref idref="f0007">Fig. 5</figref> illustrates a speech signal which only has two pulses within a frame.
These examples illustrated by <figref idref="f0006">Figs. 4</figref> and <figref idref="f0007">5</figref> show that the number of pulses is dependent on the first pulse position.
Moreover, according to the prior art, it is checked, if <i>T</i> [<i>N -</i> 1], the location of the <i>N<sup>th</sup></i> pulse in the constructed periodic part of the excitation is within the frame length, even though <i>N</i> is defined to include the first pulse in the following frame.
Furthermore, according to the prior art, no samples are added or removed before the first and after the last pulse. Embodiments of the present invention are based on the finding that this leads to the drawback that there could be a sudden change in the length of the first full pitch cycle, and moreover, this furthermore leads to the drawback that the length of the pitch cycle after the last pulse could be greater than the length of the last full pitch cycle before the last pulse, even when the pitch lag is decreasing (see <figref idref="f0008">Figs. 6</figref> and <figref idref="f0009">7</figref>).
Embodiments are based on the finding that the pulses <i>T</i> [<i>k</i>] = <i>P</i> - <i>dif f</i> and <i>T</i> [<i>n</i>] = <i>P</i> - <i>d</i> are not equal when: <ul id="ul0005" list-style="dash"><li><maths id="math0063"><math display="inline"><mi>d</mi><mo>></mo><mrow><mo>⌈</mo><mfrac><msub><mi>T</mi><mi>c</mi></msub><mn>2</mn></mfrac><mo>⌉</mo></mrow></math><img file="EP4375993A2_D0064.tif" /></maths>. In this case <i>dif f</i> = <i>T<sub>c</sub></i> - <i>d</i> and the number of removed samples will be <i>dif f</i> instead of <i>d.</i></li><li><i>T</i> [<i>k</i>] is in the future frame and it is moved to the current frame only after removing <i>d</i> samples.</li><li><i>T</i> [<i>n</i>] is moved to the future frame after adding <i>-d</i> samples (<i>d</i> < 0).</li></ul>
This will lead to wrong position of pulses in the concealed frame.
Moreover, embodiments are based on the finding that in the prior art, the maximum value of <i>d</i> is limited to the minimum allowed value for the coded pitch lag. This is a constraint that limits the occurrences of other problems, but it also limits the possible change in the pitch and thus limits the pulse resynchronization.
Furthermore, embodiments are based on the finding that in the prior art, the periodic part is constructed using integer pitch lag, and that this creates a frequency shift of the harmonics and significant degradation in concealment of tonal signals with a constant pitch. This degradation can be seen in <figref idref="f0010">Fig. 8</figref>, wherein <figref idref="f0010">Fig. 8</figref> depicts a time-frequency representation of a speech signal being resynchronized when using a rounded pitch lag.
Embodiments are moreover based on the finding that most of the problems of the prior art occur in situations as illustrated by the examples depicted in <figref idref="f0008">Figs. 6</figref> and <figref idref="f0009">7</figref>, where <i>d</i> samples are removed. Here it is considered that there is no constraint on the maximum value for <i>d,</i> in order to make the problem easily visible. The problem also occurs when there is a limit for <i>d,</i> but is not so obviously visible. Instead of continuously increasing the pitch, one would get a sudden increase followed by a sudden decrease of the pitch. Embodiments are based on the finding that this happens, because no samples are removed before and after the last pulse, indirectly also caused by not taking into account that the pulse <i>T</i> [2] moves within the frame after the removal of <i>d</i> samples. The wrong calculation of <i>N</i> also happens in this example.
According to embodiments, improved pulse resynchronization concepts are provided. Embodiments provide improved concealment of monophonic signals, including speech, which is advantageous compared to the existing techniques described in the standards G.718 (see [ITU08a]) and G.729.1 (see [ITU06b]). The provided embodiments are suitable for signals with a constant pitch, as well as for signals with a changing pitch.
Inter alia, according to embodiments, three techniques are provided: According to a first technique provided by an embodiment, a search concept for the pulses is provided that, in contrast to G.718 and G.729.1, takes into account the location of the first pulse in the calculation of the number of pulses in the constructed periodic part, denoted as <i>N.</i>
According to a second technique provided by another embodiment, an algorithm for searching for pulses is provided that, in contrast to G.718 and G.729.1, does not need the number of pulses in the constructed periodic part, denoted as <i>N</i>, that takes the location of the first pulse into account, and that directly calculates the last pulse index in the concealed frame, denoted as <i>k.</i>
According to a third technique provided by a further embodiment, a pulse search is not needed. According to this third technique, a construction of the periodic part is combined with the removal or addition of the samples, thus achieving less complexity than previous techniques.
Additionally or alternatively, some embodiments provide the following changes for the above techniques as well as for the techniques of G.718 and G.729.1: <ul id="ul0006" list-style="dash"><li>The fractional part of the pitch lag may, e.g., be used for constructing the periodic part for signals with a constant pitch.</li><li>The offset to the expected location of the last pulse in the concealed frame may, e.g., be calculated for a non-integer number of pitch cycles within the frame.</li><li>Samples may, e.g., be added or removed also before the first pulse and after the last pulse.</li><li>Samples may, e.g., also be added or removed if there is just one pulse.</li><li>The number of samples to be removed or added may e.g. change linearly, following the predicted linear change in the pitch.</li></ul>
In the following, embodiments of the present invention are described in more detail with reference to the figures, in which: <dl id="dl0001" compact="compact"><dt>Fig. 1</dt><dd>illustrates an apparatus for determining an estimated pitch lag according to an embodiment,</dd><dt>Fig. 2a</dt><dd>illustrates an apparatus for reconstructing a frame comprising a speech signal as a reconstructed frame according to an embodiment,</dd><dt>Fig. 2b</dt><dd>illustrates a speech signal comprising a plurality of pulses,</dd><dt>Fig. 2c</dt><dd>illustrates a system for reconstructing a frame comprising a speech signal according to an embodiment,</dd><dt>Fig. 3</dt><dd>illustrates a constructed periodic part of a speech signal,</dd><dt>Fig. 4</dt><dd>illustrates a speech signal having three pulses within a frame,</dd><dt>Fig. 5</dt><dd>illustrates a speech signal having two pulses within a frame,</dd><dt>Fig. 6</dt><dd>illustrates a speech signal before a removal of samples,</dd><dt>Fig. 7</dt><dd>illustrates the speech signal of <figref idref="f0008">Fig. 6</figref> after the removal of samples,</dd><dt>Fig. 8</dt><dd>illustrates a time-frequency representation of a speech signal being resynchronized using a rounded pitch lag,</dd><dt>Fig. 9</dt><dd>illustrates a time-frequency representation of a speech signal being resynchronized using a non-rounded pitch lag with the fractional part,</dd><dt>Fig. 10</dt><dd>illustrates a pitch lag diagram, wherein the pitch lag is reconstructed employing state of the art concepts,</dd><dt>Fig. 11</dt><dd>illustrates a pitch lag diagram, wherein the pitch lag is reconstructed according to embodiments,</dd><dt>Fig. 12</dt><dd>illustrates a speech signal before removing samples, and</dd><dt>Fig. 13</dt><dd>illustrates the speech signal of <figref idref="f0014">Fig. 12</figref>, additionally illustrating Δ<sub>0</sub> to Δ<sub>3</sub>.</dd></dl>
<figref idref="f0001">Fig. 1</figref> illustrates an apparatus for determining an estimated pitch lag according to an embodiment. The apparatus comprises an input interface 110 for receiving a plurality of original pitch lag values, and a pitch lag estimator 120 for estimating the estimated pitch lag. The pitch lag estimator 120 is configured to estimate the estimated pitch lag depending on a plurality of original pitch lag values and depending on a plurality of information values, wherein for each original pitch lag value of the plurality of original pitch lag values, an information value of the plurality of information values is assigned to said original pitch lag value.
According to an embodiment, the pitch lag estimator 120 may, e.g., be configured to estimate the estimated pitch lag depending on the plurality of original pitch lag values and depending on a plurality of pitch gain values as the plurality of information values, wherein for each original pitch lag value of the plurality of original pitch lag values, a pitch gain value of the plurality of pitch gain values is assigned to said original pitch lag value.
In a particular embodiment, each of the plurality of pitch gain values may, e.g., be an adaptive codebook gain.
In an embodiment, the pitch lag estimator 120 may, e.g., be configured to estimate the estimated pitch lag by minimizing an error function.
According to an embodiment, the pitch lag estimator 120 may, e.g., be configured to estimate the estimated pitch lag by determining two parameters <i>a, b,</i> by minimizing the error function <maths id="math0064"><math display="block"><mi mathvariant="italic">err</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mi>k</mi></munderover><mrow><msub><mi>g</mi><mi>p</mi></msub><mfenced><mi>i</mi></mfenced><mo>⋅</mo><msup><mfenced><mfenced><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mrow></mstyle><mo>,</mo></math><img file="EP4375993A2_D0065.tif" /></maths> wherein <i>a</i> is a real number, wherein <i>b</i> is a real number, wherein <i>k</i> is an integer with <i>k</i> ≥ 2, and wherein P(i) is the <i>i</i>-th original pitch lag value, wherein <i>g<sub>p</sub></i>(<i>i</i>) is the <i>i</i>-th pitch gain value being assigned to the <i>i</i> -th pitch lag value P(<i>i</i>).
In an embodiment, the pitch lag estimator 120 may, e.g., be configured to estimate the estimated pitch lag by determining two parameters <i>a, b,</i> by minimizing the error function <maths id="math0065"><math display="block"><mi mathvariant="italic">err</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><msub><mi>g</mi><mi>p</mi></msub><mfenced><mi>i</mi></mfenced><mo>⋅</mo><msup><mfenced><mfenced><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mrow></mstyle><mo>,</mo></math><img file="EP4375993A2_D0066.tif" /></maths> wherein <i>a</i> is a real number, wherein <i>b</i> is a real number, wherein P(i) is the <i>i</i>-th original pitch lag value, wherein <i>g<sub>p</sub></i>(<i>i</i>) is the <i>i</i>-th pitch gain value being assigned to the <i>i</i> -th pitch lag value P(<i>i</i>).
According to an embodiment, the pitch lag estimator 120 may, e.g., be configured to determine the estimated pitch lag <i>p</i> according to <i>p</i> = <i>a</i> · <i>i</i> + <i>b.</i>
In an embodiment, the pitch lag estimator 120 may, e.g., be configured to estimate the estimated pitch lag depending on the plurality of original pitch lag values and depending on a plurality of time values as the plurality of information values, wherein for each original pitch lag value of the plurality of original pitch lag values, a time value of the plurality of time values is assigned to said original pitch lag value.
According to an embodiment, the pitch lag estimator 120 may, e.g., be configured to estimate the estimated pitch lag by minimizing an error function.
In an embodiment, the pitch lag estimator 120 may, e.g., be configured to estimate the estimated pitch lag by determining two parameters <i>a, b,</i> by minimizing the error function <maths id="math0066"><math display="block"><mi mathvariant="italic">err</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mi>k</mi></munderover><mrow><msub><mi mathvariant="italic">time</mi><mi mathvariant="italic">passed</mi></msub><mfenced><mi>i</mi></mfenced><mo>⋅</mo><msup><mfenced><mfenced><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mrow></mstyle><mo>,</mo></math><img file="EP4375993A2_D0067.tif" /></maths> wherein <i>a</i> is a real number, wherein <i>b</i> is a real number, wherein <i>k</i> is an integer with <i>k</i> ≥ 2, and wherein P(i) is the <i>i</i>-th original pitch lag value, wherein <i>time<sub>passed</sub></i>(<i>i</i>) is the <i>i</i>-th time value being assigned to the <i>i</i> -th pitch lag value P(<i>i</i>).
According to an embodiment, the pitch lag estimator 120 may, e.g., be configured to estimate the estimated pitch lag by determining two parameters <i>a, b,</i> by minimizing the error function <maths id="math0067"><math display="block"><mi mathvariant="italic">err</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><msub><mi mathvariant="italic">time</mi><mi mathvariant="italic">passed</mi></msub><mfenced><mi>i</mi></mfenced><mo>⋅</mo><msup><mfenced><mfenced><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup><mo>,</mo></mrow></mstyle></math><img file="EP4375993A2_D0068.tif" /></maths> wherein <i>a</i> is a real number, wherein <i>b</i> is a real number, wherein <i>P</i>(<i>i</i>) is the <i>i</i>-th original pitch lag value, wherein <i>time<sub>passed</sub></i>(<i>i</i>) is the <i>i</i>-th time value being assigned to the <i>i</i> -th pitch lag value P(<i>i</i>).
In an embodiment, the pitch lag estimator 120 is configured to determine the estimated pitch lag <i>p</i> according to <i>p</i> = <i>a</i> · <i>i</i> + <i>b.</i>
In the following, embodiments providing weighted pitch prediction are described with respect to formulae (20) - (24b).
At first, weighted pitch prediction embodiments employing weighting according to the pitch gain are described with reference to formulae (20) - (22c). According to some of these embodiments, to overcome the drawback of the prior art, the pitch lags are weighted with the pitch gain to perform the pitch prediction.
In some embodiments, the pitch gain may be the adaptive-codebook gain <i>g<sub>p</sub></i> as defined in the standard G.729 (see [ITU12], in particular chapter 3.7.3, more particularly formula (43)). In G.729, the adaptive-codebook gain is determined according to: <maths id="math0068"><math display="block"><msub><mi>g</mi><mi>p</mi></msub><mo>=</mo><mfrac><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mn>39</mn></munderover><mrow><mi>x</mi><mfenced><mi>n</mi></mfenced><mi>y</mi><mfenced><mi>n</mi></mfenced></mrow></mstyle><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mn>39</mn></munderover><mrow><mi>y</mi><mfenced><mi>n</mi></mfenced><mi>y</mi><mfenced><mi>n</mi></mfenced></mrow></mstyle></mfrac><mspace width="1ex" /><mi>bounded</mi><mspace width="1ex" /><mi>by</mi><mspace width="1ex" /><mn>0</mn><mo>≤</mo><msub><mi>g</mi><mi>p</mi></msub><mo>≤</mo><mn>1.2</mn></math><img file="EP4375993A2_D0069.tif" /></maths>
There, <i>x</i>(<i>n</i>) is the target signal and <i>y</i>(<i>n</i>) is obtained by convolving <i>v</i>(<i>n</i>) with <i>h</i>(<i>n</i>) according to: <maths id="math0069"><math display="block"><mtable><mtr><mtd><mrow><mfenced><mi>y</mi><mspace width="1ex" /><mi>n</mi></mfenced><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mi>n</mi></munderover><mrow><mi>ν</mi><mfenced><mi>i</mi></mfenced><mi>h</mi><mfenced><mi>n</mi><mo>−</mo><mi>i</mi></mfenced></mrow></mstyle></mrow></mtd><mtd><mrow><mi>n</mi><mo>=</mo><mn>0</mn><mo>,</mo><mo>…</mo><mo>,</mo><mn>39</mn></mrow></mtd></mtr></mtable></math><img file="EP4375993A2_D0070.tif" /></maths> wherein <i>v</i>(<i>n</i>) is the adaptive-codebook vector, wherein <i>y</i>(<i>n</i>) the filtered adaptive-codebook vector, and wherein <i>h</i>(<i>n</i> - <i>i</i>) is an impulse response of a weighted synthesis filter, as defined in G.729 (see (ITU12]).
Similarly, in some embodiments, the pitch gain may be the adaptive-codebook gain <i>g<sub>p</sub></i> as defined in the standard G.718 (see [ITU08a], in particular chapter 6.8.4.1.4.1, more particularly formula (170)). In G.718, the adaptive-codebook gain is determined according to: <maths id="math0070"><math display="block"><msub><mi>C</mi><mi mathvariant="italic">CL</mi></msub><mo>=</mo><mfrac><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mn>63</mn></munderover><mrow><mi>x</mi><mfenced><mi>n</mi></mfenced><msub><mi>y</mi><mi>k</mi></msub><mfenced><mi>n</mi></mfenced></mrow></mstyle><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mn>63</mn></munderover><mrow><msub><mi>y</mi><mi>k</mi></msub><mfenced><mi>n</mi></mfenced><msub><mi>y</mi><mi>k</mi></msub><mfenced><mi>n</mi></mfenced></mrow></mstyle></mfrac></math><img file="EP4375993A2_D0071.tif" /></maths> wherein <i>x</i>(<i>n</i>) is the target signal and <i>y<sub>k</sub></i>(<i>n</i>) is the past filtered excitation at delay <i>k.</i>
For example, see [ITU08a], chapter 6.8.4.1.4.1, formula (171), for a definition, how <i>y<sub>k</sub></i>(<i>n</i>) could be defined.
Similarly, in some embodiments, the pitch gain may be the adaptive-codebook gain <i>g<sub>p</sub></i> as defined in the AMR standard (see [3GP12b]), wherein the adaptive-codebook gain <i>g<sub>p</sub></i> as the pitch gain is defined according to: <maths id="math0071"><math display="block"><msub><mi>g</mi><mi>p</mi></msub><mo>=</mo><mfrac><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mn>63</mn></munderover><mrow><mi>x</mi><mfenced><mi>n</mi></mfenced><mi>y</mi><mfenced><mi>n</mi></mfenced></mrow></mstyle><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>n</mi><mo>=</mo><mn>0</mn></mrow><mn>63</mn></munderover><mrow><mi>y</mi><mfenced><mi>n</mi></mfenced><mi>y</mi><mfenced><mi>n</mi></mfenced></mrow></mstyle></mfrac></math><img file="EP4375993A2_D0072.tif" /></maths> bounded by 0 ≤ <i>g<sub>p</sub></i> ≤ 1.2 wherein <i>y</i>(<i>n</i>) is a filtered adaptive codebook vector.
In some particular embodiments, the pitch lags may, e.g., be weighted with the pitch gain, for example, prior to performing the pitch prediction.
For this purpose, according to an embodiment, a second buffer of length 8 may, for example, be introduced holding the pitch gains, which are taken at the same subframes as the pitch lags. In an embodiment, the buffer may, e.g., be updated using the exact same rules as the update of the pitch lags. One possible realization is to update both buffers (holding pitch lags and pitch gains of the last eight subframes) at the end of each frame, regardless whether this frame was error free or error prone.
There are two different prediction strategies known from the prior art, which can be enhanced to use weighted pitch prediction:
Some embodiments provide significant inventive improvements of the prediction strategy of the G.718 standard, in G.718, in case of a packet loss, the buffers may be multiplied with each other element wise, in order to weight the pitch lag with a high factor if the associated pitch gain is high, and to weight it with a low factor if the associated pitch gain is low. After that, according to G.718, the pitch prediction is performed like usual (see [ITU08a, section 7.11.1.3] for details on G.718).
Some embodiments provide significant inventive improvements of the prediction strategy of the G.729.1 standard. The algorithm used in G.729.1 to predict the pitch (see [ITU06b] for details on G.729.1) is modified according to embodiments in order to use weighted prediction.
According to some embodiments, the goal is to minimize the error function: <maths id="math0072" num="(20)"><math display="block"><mi mathvariant="italic">err</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><msub><mi>g</mi><mi>p</mi></msub><mfenced><mi>i</mi></mfenced><mo>⋅</mo><msup><mfenced><mfenced><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></mrow></mstyle></math><img file="EP4375993A2_D0073.tif" /></maths> where <i>g<sub>p</sub></i>(<i>i</i>) is holding the pitch gains from the past subframes and <i>P(i)</i> is holding the corresponding pitch lags.
In the inventive formula (20), <i>g<sub>p</sub></i>(<i>i</i>) is representing the weighting factor. In the above example, each <i>g<sub>p</sub></i>(<i>i</i>) is representing a pitch gain from one of the past subframes.
Below, equations according to embodiments are provided, which describe how to derive the factors <i>a</i> and <i>b,</i> which could be used to predict the pitch lag according to: <i>a</i> + <i>i</i> · <i>b,</i> where <i>i</i> is the subframe number of the subframe to be predicted.
For example, to obtain the first predicted subframe based the prediction on the last five subframes <i>P</i>(0), ..., <i>P</i>(4), the predicted pitch value <i>P</i>(5) would be: <maths id="math0073"><math display="block"><mi>P</mi><mfenced><mn>5</mn></mfenced><mo>=</mo><mi>a</mi><mo>+</mo><mn>5</mn><mo>⋅</mo><mi>b</mi><mo>.</mo></math><img file="EP4375993A2_D0074.tif" /></maths>
In order to derive the coefficients <i>a</i> and <i>b,</i> the error function may, for example, be derived (derivated) and may be set to zero: <maths id="math0074" num="(21a)"><math display="block"><mtable><mtr><mtd><mrow><mfrac><mrow><mi>δ</mi><mspace width="1ex" /><mi mathvariant="italic">err</mi></mrow><mrow><mi>δ</mi><mspace width="1ex" /><mi>a</mi></mrow></mfrac><mo>=</mo><mn>0</mn></mrow></mtd><mtd><mi mathvariant="italic">and</mi></mtd><mtd><mrow><mfrac><mrow><mi>δ</mi><mspace width="1ex" /><mi mathvariant="italic">err</mi></mrow><mrow><mi>δ</mi><mspace width="1ex" /><mi>b</mi></mrow></mfrac><mo>=</mo><mn>0</mn></mrow></mtd></mtr></mtable></math><img file="EP4375993A2_D0075.tif" /></maths>
The prior art that does not disclose to employ the inventive weighting provided by embodiments. In particular, the prior art does not employ the weighting factor <i>g<sub>p</sub></i>(<i>i</i>).
Thus, in the prior art, which does not employ a weighting factor <i>g<sub>p</sub></i>(<i>i</i>), deriving the error function and setting the derivative of the error function to 0 would result to: <maths id="math0075" num="(21b)"><math display="block"><mtable><mtr><mtd><mrow><mi>a</mi><mo>=</mo><mfrac><mrow><mn>3</mn><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><mi>P</mi><mfenced><mi>i</mi></mfenced><mo>−</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><mi>i</mi><mo>⋅</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mrow></mstyle></mrow></mstyle></mrow><mn>5</mn></mfrac></mrow></mtd><mtd><mi>and</mi></mtd><mtd><mrow><mi>b</mi><mo>=</mo><mfrac><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><mi>i</mi><mo>⋅</mo><mi>P</mi><mfenced><mi>i</mi></mfenced><mo>−</mo><mn>2</mn><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><mi>P</mi><mfenced><mi>i</mi></mfenced></mrow></mstyle></mrow></mstyle><mn>10</mn></mfrac></mrow></mtd></mtr></mtable></math><img file="EP4375993A2_D0076.tif" /></maths> (see [ITU06b, 7.6.5]).
In contrast, when using the weighted prediction approach of the provided embodiments, e.g., the weighted prediction approach of formula (20) with weighting factor <i>g<sub>p</sub></i>(<i>i</i>), <i>a</i> and <i>b</i> result to: <maths id="math0076" num="(22a)"><math display="block"><mi>a</mi><mo>=</mo><mo>−</mo><mfrac><mrow><mi>A</mi><mo>+</mo><mi>B</mi><mo>+</mo><mi>C</mi><mo>+</mo><mi>D</mi><mo>+</mo><mi>E</mi></mrow><mi>K</mi></mfrac></math><img file="EP4375993A2_D0077.tif" /></maths><maths id="math0077" num="(22b)"><math display="block"><mi>b</mi><mo>=</mo><mo>+</mo><mfrac><mrow><mi>F</mi><mo>+</mo><mi>G</mi><mo>+</mo><mi>H</mi><mo>+</mo><mi>I</mi><mo>+</mo><mi>J</mi></mrow><mi>K</mi></mfrac></math><img file="EP4375993A2_D0078.tif" /></maths>
According to a particular embodiment, <i>A, B, C, D; E, F, G, H, I, J</i> and <i>K</i> may, e.g., have the following values: <maths id="math0078" num="(22c)"><math display="block"><mtable columnalign="left"><mtr><mtd><mi>A</mi><mo>=</mo><mfenced><mn>3</mn><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><mo>+</mo><mn>4</mn><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><mo>+</mo><mn>3</mn><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub></mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>4</mn></msub></msub><mo>⋅</mo><mi>P</mi><mfenced><mn>4</mn></mfenced></mtd></mtr><mtr><mtd><mi>B</mi><mo>=</mo><mfenced><mfenced><mn>2</mn><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><mo>+</mo><mn>2</mn><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub></mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><mo>−</mo><mn>4</mn><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>4</mn></msub></msub></mfenced><mo>⋅</mo><mi>P</mi><mfenced><mn>3</mn></mfenced></mtd></mtr><mtr><mtd><mi>C</mi><mo>=</mo><mfenced><mo>−</mo><mn>8</mn><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>4</mn></msub></msub><mo>−</mo><mn>3</mn><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><mo>+</mo><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub></mfenced><mo>⋅</mo><mi>P</mi><mfenced><mn>2</mn></mfenced></mtd></mtr><mtr><mtd><mi>D</mi><mo>=</mo><mfenced><mo>−</mo><mn>12</mn><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>4</mn></msub></msub><mo>−</mo><mn>6</mn><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><mo>−</mo><mn>2</mn><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub></mfenced><mo>⋅</mo><mi>P</mi><mfenced><mn>1</mn></mfenced></mtd></mtr><mtr><mtd><mi>E</mi><mo>=</mo><mfenced><mo>−</mo><mn>16</mn><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>4</mn></msub></msub><mo>−</mo><mn>9</mn><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><mo>−</mo><mn>4</mn><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><mo>−</mo><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub></mfenced><mo>⋅</mo><mi>P</mi><mfenced><mn>0</mn></mfenced></mtd></mtr><mtr><mtd><mi>F</mi><mo>=</mo><mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><mo>+</mo><mn>2</mn><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><mo>+</mo><mn>3</mn><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><mo>+</mo><mn>4</mn><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub></mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>4</mn></msub></msub><mo>⋅</mo><mi>P</mi><mfenced><mn>4</mn></mfenced></mtd></mtr><mtr><mtd><mi>G</mi><mo>=</mo><mfenced><mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><mo>+</mo><mn>2</mn><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><mo>+</mo><mn>3</mn><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub></mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><mo>−</mo><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>4</mn></msub></msub></mfenced><mo>⋅</mo><mi>P</mi><mfenced><mn>3</mn></mfenced></mtd></mtr><mtr><mtd><mi>H</mi><mo>=</mo><mfenced><mo>−</mo><mn>2</mn><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>4</mn></msub></msub><mo>−</mo><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><mo>+</mo><mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><mo>+</mo><mn>2</mn><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub></mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub></mfenced><mo>⋅</mo><mi>P</mi><mfenced><mn>2</mn></mfenced></mtd></mtr><mtr><mtd><mi>I</mi><mo>=</mo><mfenced><mo>−</mo><mn>3</mn><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>4</mn></msub></msub><mo>−</mo><mn>2</mn><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><mo>−</mo><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><mo>+</mo><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub></mfenced><mo>⋅</mo><mi>P</mi><mfenced><mn>1</mn></mfenced></mtd></mtr><mtr><mtd><mi>J</mi><mo>=</mo><mfenced><mo>−</mo><mn>4</mn><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>4</mn></msub></msub><mo>−</mo><mn>3</mn><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><mo>−</mo><mn>2</mn><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><mo>−</mo><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub></mfenced><mo>⋅</mo><mi>P</mi><mfenced><mn>0</mn></mfenced></mtd></mtr><mtr><mtd><mi>K</mi><mo>=</mo><mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><mo>+</mo><mn>4</mn><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><mo>+</mo><mn>9</mn><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><mo>+</mo><mn>16</mn><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub></mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>4</mn></msub></msub><mo>+</mo><mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><mo>+</mo><mn>4</mn><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><mo>+</mo><mn>9</mn><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub></mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>3</mn></msub></msub><mo>+</mo><mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub><mo>+</mo><mn>4</mn><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub></mfenced><msub><mi>g</mi><msub><mi>p</mi><mn>2</mn></msub></msub><mo>+</mo><msub><mi>g</mi><msub><mi>p</mi><mn>0</mn></msub></msub><msub><mi>g</mi><msub><mi>p</mi><mn>1</mn></msub></msub></mtd></mtr></mtable></math><img file="EP4375993A2_D0079.tif" /></maths>
<figref idref="f0012">Fig. 10</figref> and <figref idref="f0013">Fig. 11</figref> show the superior performance of the proposed pitch extrapolation.
There, <figref idref="f0012">Fig. 10</figref> illustrates a pitch lag diagram, wherein the pitch lag is reconstructed employing state of the art concepts. In contrast, <figref idref="f0013">Fig. 11</figref> illustrates a pitch lag diagram, wherein the pitch lag is reconstructed according to embodiments.
In particular, <figref idref="f0012">Fig. 10</figref> illustrates the performance of the prior art standards G.718 and G.729.1, while <figref idref="f0013">Fig. 11</figref> illustrates the performance of a provided concept provided by an embodiment.
The abscissa axis denotes the subframe number. The continuous line 1010 shows the encoder pitch lag which is embedded in the bitstream, and which is lost in the area of the grey segment 1030. The left ordinate axis represents a pitch lag axis. The right ordinate axis represents a pitch gain axis. The continuous line 1010 illustrates the pitch lag, while the dashed lines 1021, 1022, 1023 illustrate the pitch gain.
The grey rectangle 1030 denotes the frame loss. Because of the frame loss that occurred in the area of the grey segment 1030, information on the pitch lag and pitch gain in this area is not available at the decoder side and has to be reconstructed.
In <figref idref="f0012">Fig. 10</figref>, the pitch lag being concealed using the G.718 standard is illustrated by the dashed-dotted line portion 1011. The pitch lag being concealed using the G.729.1 standard is illustrated by the continuous line portion 1012. It can be clearly seen, that using the provided pitch prediction (<figref idref="f0013">Fig. 11</figref>, continuous line portion 1013) corresponds essentially to the lost encoder pitch lag and is thus advantageous over the G.718 and G.729.1 techniques.
In the following, embodiments employing weighting depending on passed time are described with reference to formulae (23a) - (24b).
To overcome the drawbacks of the prior art, some embodiments apply a time weighting on the pitch lags, prior to performing the pitch prediction. Applying a time weighting can be achieved by minimizing this error function: <maths id="math0079" num="(23a)"><math display="block"><mi mathvariant="italic">err</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mn>4</mn></munderover><mrow><msub><mi mathvariant="italic">time</mi><mi mathvariant="italic">passed</mi></msub><mfenced><mi>i</mi></mfenced></mrow></mstyle><mo>⋅</mo><msup><mfenced><mfenced><mi>a</mi><mo>+</mo><mi>b</mi><mo>⋅</mo><mi>i</mi></mfenced><mo>−</mo><mi>P</mi><mfenced><mi>i</mi></mfenced></mfenced><mn>2</mn></msup></math><img file="EP4375993A2_D0080.tif" /></maths> where <i>time<sub>passed</sub></i>(<i>i</i>) is representing the inverse of the amount of time that has passed after correctly receiving the pitch lag and <i>P</i>(<i>i</i>) is holding the corresponding pitch lags.
Some embodiments may, e.g., put high weights to more recent lags and less weight to lags being received longer ago.
According to some embodiments, formula (21a) may then be employed to derive <i>a</i> and <i>b.</i>
To obtain the first predicted subframe, some embodiments may, e.g., conduct the prediction based on the last five subframes, <i>P</i>(0)... <i>P</i>(4). For example, the predicted pitch value <i>P</i>(5) may then be obtained according to: <maths id="math0080" num="(23b)"><math display="block"><mi>P</mi><mfenced><mn>5</mn></mfenced><mo>=</mo><mi>a</mi><mo>+</mo><mn>5</mn><mo>⋅</mo><mi>b</mi></math><img file="EP4375993A2_D0081.tif" /></maths>
For example, if <maths id="math0081"><math display="block"><msub><mi mathvariant="italic">time</mi><mi mathvariant="italic">passed</mi></msub><mo>=</mo><mfenced open="[" close="]"><mn>1</mn><mo>/</mo><mn>5</mn><mspace width="1ex" /><mn>1</mn><mo>/</mo><mn>4</mn><mspace width="1ex" /><mn>1</mn><mo>/</mo><mn>3</mn><mspace width="1ex" /><mn>1</mn><mo>/</mo><mn>2</mn><mspace width="1ex" /><mn>1</mn></mfenced></math><img file="EP4375993A2_D0082.tif" /></maths> (time weighting according to subframe delay), this would result to: <maths id="math0082" num="(24a)"><math display="block"><mi>a</mi><mo>=</mo><mfrac><mrow><mo>−</mo><mn>3.5833</mn><mo>⋅</mo><mi>P</mi><mfenced><mn>4</mn></mfenced><mo>+</mo><mn>1.4167</mn><mo>⋅</mo><mi>P</mi><mfenced><mn>3</mn></mfenced><mo>+</mo><mn>3.0833</mn><mo>⋅</mo><mi>P</mi><mfenced><mn>2</mn></mfenced><mo>+</mo><mn>3.9167</mn><mo>⋅</mo><mi>P</mi><mfenced><mn>1</mn></mfenced><mo>+</mo><mn>4.4167</mn><mo>⋅</mo><mi>P</mi><mfenced><mn>0</mn></mfenced></mrow><mn>9.2500</mn></mfrac></math><img file="EP4375993A2_D0083.tif" /></maths><maths id="math0083" num="(24b)"><math display="block"><mi>b</mi><mo>=</mo><mfrac><mrow><mo>+</mo><mn>2.7167</mn><mo>⋅</mo><mi>P</mi><mfenced><mn>4</mn></mfenced><mo>+</mo><mn>0.2167</mn><mo>⋅</mo><mi>P</mi><mfenced><mn>3</mn></mfenced><mo>−</mo><mn>0.6167</mn><mo>⋅</mo><mi>P</mi><mfenced><mn>2</mn></mfenced><mo>−</mo><mn>1.0333</mn><mo>⋅</mo><mi>P</mi><mfenced><mn>1</mn></mfenced><mo>−</mo><mn>1.2833</mn><mo>⋅</mo><mi>P</mi><mfenced><mn>0</mn></mfenced></mrow><mn>9.2500</mn></mfrac></math><img file="EP4375993A2_D0084.tif" /></maths>
In the following, embodiments providing pulse resynchronization are described.
<figref idref="f0002">Fig. 2a</figref> illustrates an apparatus for reconstructing a frame comprising a speech signal as a reconstructed frame according to an embodiment. Said reconstructed frame is associated with one or more available frames, said one or more available frames being at least one of one or more preceding frames of the reconstructed frame and one or more succeeding frames of the reconstructed frame, wherein the one or more available frames comprise one or more pitch cycles as one or more available pitch cycles.
The apparatus comprises a determination unit 210 for determining a sample number difference ( <maths id="math0084"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup></math><img file="EP4375993A2_D0085.tif" /></maths>; Δi ; <maths id="math0085"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mi>p</mi></msubsup></math><img file="EP4375993A2_D0086.tif" /></maths>) indicating a difference between a number of samples of one of the one or more available pitch cycles and a number of samples of a first pitch cycle to be reconstructed.
Moreover, the apparatus comprises a frame reconstructor for reconstructing the reconstructed frame by reconstructing, depending on the sample number difference ( <maths id="math0086"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup></math><img file="EP4375993A2_D0087.tif" /></maths>; Δ<i><sub>i</sub></i> ; <maths id="math0087"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mi>p</mi></msubsup></math><img file="EP4375993A2_D0088.tif" /></maths>) and depending on the samples of said one of the one or more available pitch cycles, the first pitch cycle to be reconstructed as a first reconstructed pitch cycle.
The frame reconstructor 220 is configured to reconstruct the reconstructed frame, such that the reconstructed frame completely or partially comprises the first reconstructed pitch cycle, such that the reconstructed frame completely or partially comprises a second reconstructed pitch cycle, and such that the number of samples of the first reconstructed pitch cycle differs from a number of samples of the second reconstructed pitch cycle.
Reconstructing a pitch cycle is conducted by reconstructing some or all of the samples of the pitch cycle that shall be reconstructed. If the pitch cycle to be reconstructed is completely comprised by a frame that is lost, then all of the samples of the pitch cycle may, e.g., have to be reconstructed. If the pitch cycle to be reconstructed is only partially comprised by the frame that is lost, and if some the samples of the pitch cycle are available, e.g., as they are comprised another frame, than it may, e.g., be sufficient to only reconstruct the samples of the pitch cycle that are comprised by the frame that is lost to reconstruct the pitch cycle.
<figref idref="f0003">Fig. 2b</figref> illustrates the functionality of the apparatus of <figref idref="f0002">Fig. 2a</figref>. In particular, <figref idref="f0003">Fig. 2b</figref> illustrates a speech signal 222 comprising the pulses 211, 212, 213, 214, 215, 216, 217.
A first portion of the speech signal 222 is comprised by a frame n-1. A second portion of the speech signal 222 is comprised by a frame n. A third portion of the speech signal 222 is comprised by a frame n+1.
In <figref idref="f0003">Fig. 2b</figref>, frame n-1 is preceding frame n and frame n+1 is succeeding frame n. This means, frame n-1 comprises a portion of the speech signal that occurred earlier in time compared to the portion of the speech signal of frame n; and frame n+1 comprises a portion of the speech signal that occurred later in time compared to the portion of the speech signal of frame n.
In the example of <figref idref="f0003">Fig. 2b</figref> it is assumed that frame n got lost or is corrupted and thus, only the frames preceding frame n ("preceding frames") and the frames succeeding frame n ("succeeding frames") are available ("available frames").
A pitch cycle, may, for example, be defined as follows: A pitch cycle starts with one of the pulses 211, 212, 213, etc. and ends with the immediately succeeding pulse in the speech signal. For example, pulse 211 and 212 define the pitch cycle 201. Pulse 212 and 213 define the pitch cycle 202. Pulse 213 and 214 define the pitch cycle 203, etc.
Other definitions of the pitch cycle, well known to a person skilled in the art, which employ, for example, other start and end points of the pitch cycle, may alternatively be considered.
In the example of <figref idref="f0003">Fig. 2b</figref>, frame n is not available at a receiver or is corrupted. Thus, the receiver is aware of the pulses 211 and 212 and of the pitch cycle 201 of frame n-1. Moreover, the receiver is aware of the pulses 216 and 217 and of the pitch cycle 206 of frame n+1. However, frame n which comprises the pulses 213, 214 and 215, which completely comprises the pitch cycles 203 and 204 and which partially comprises the pitch cycles 202 and 205, has to be reconstructed.
According to some embodiments, frame n may be reconstructed depending on the samples of at least one pitch cycle ("available pitch cylces") of the available frames (e.g., preceding frame n-1 or succeeding frame n+1). For example, the samples of the pitch cycle 201 of frame n-1 may, e.g., cyclically repeatedly copied to reconstruct the samples of the lost or corrupted frame. By cyclically repeatedly copying the samples of the pitch cycle, the pitch cycle itself is copied, e.g., if the pitch cycle is c, then <maths id="math0088"><math display="block"><mi>sample</mi><mfenced><mi mathvariant="normal">x</mi><mo>+</mo><mi mathvariant="normal">i</mi><mo>⋅</mo><mi mathvariant="normal">c</mi></mfenced><mo>=</mo><mi>sample</mi><mfenced><mi mathvariant="normal">x</mi></mfenced><mspace width="1ex" /><mi mathvariant="normal">;</mi></math><img file="EP4375993A2_D0089.tif" /></maths> with i being an integer.
In embodiments, samples from the end of the frame n-1 are copied. The length of the portion of the n-1<sup>st</sup> frame that is copied is equal to the length of the pitch cycle 201 (or almost equal). But the samples from both 201 and 202 are used for copying. This may be especially carefully considered when there is just one pulse in the n-1<sup>st</sup> frame.
In some embodiments, the copied samples are modified.
The present invention is moreover based on the finding that by cyclically repeatedly copying the samples of a pitch cycle, the pulses 213, 214, 215 of the lost frame n move to wrong positions, when the size of the pitch cycles that are (completely or partially) comprised by the lost frame (n) (pitch cycles 202, 203, 204 and 205) differs from the size of the copied available pitch cycle (here: pitch cycle 201).
E.g., in <figref idref="f0003">Fig. 2b</figref>, the difference between pitch cycle 201 and pitch cycle 202 is indicated by Δ<sub>1</sub>, the difference between pitch cycle 201 and pitch cycle 203 is indicated by Δ<sub>2</sub>, the difference between pitch cycle 201 and pitch cycle 204 is indicated by Δ<sub>3</sub>, and the difference between pitch cycle 201 and pitch cycle 205 is indicated by Δ<sub>4</sub>.
In <figref idref="f0003">Fig. 2b</figref>, it can be seen that pitch cycle 201 of frame n-1 is significantly greater than pitch cycle 206. Moreover, the pitch cycles 202, 203, 204 and 205, being (partially or completely) comprised by frame n and, are each smaller than pitch cycle 201 and greater than pitch cycle 206. Furthermore, the pitch cycles being closer to the large pitch cycle 201 (e.g., pitch cycle 202) are larger than the pitch cycles (e.g., pitch cycle 205) being closer to the small pitch cycle 206.
Based on these findings of the present invention, according to embodiments, the frame reconstructor 220 is configured to reconstruct the reconstructed frame such that the number of samples of the first reconstructed pitch cycle differs from a number of samples of a second reconstructed pitch cycle being partially or completely comprised by the reconstructed frame.
E.g., according to some embodiments, the reconstruction of the frame depends on a sample number difference indicating a difference between a number of samples of one of the one or more available pitch cycles (e.g., pitch cycle 201) and a number of samples of a first pitch cycle (e.g., pitch cycle 202, 203, 204, 205) that shall be reconstructed.
For example, according to an embodiment, the samples of pitch cycle 201 may, e.g., be cyclically repeatedly copied.
Then, the sample number difference indicates how many samples shall be deleted from the cyclically repeated copy corresponding to the first pitch cycle to be reconstructed, or how many samples shall be added to the cyclically repeated copy corresponding to the first pitch cycle to be reconstructed.
In <figref idref="f0003">Fig. 2b</figref>, each sample number indicates how many samples shall be deleted from the cyclically repeated copy. However, in other examples, the sample number may indicate how many samples shall be added to the cyclically repeated copy. For example, in some embodiments, samples may be added by adding samples with amplitude zero to the corresponding pitch cycle. In other embodiments, samples may be added to the pitch cycle by coping other samples of the pitch cycle, e.g., by copying samples being neighboured to the positions of the samples to be added.
While above, embodiments have been described where samples of a pitch cycle of a frame preceding the lost or corrupted frame have been cyclically repeatedly copied, in other embodiments, samples of a pitch cycle of a frame succeeding the lost or corrupted frame are cyclically repeatedly copied to reconstruct the lost frame. The same principles described above and below apply analogously.
Such a sample number difference may be determined for each pitch cycle to be reconstructed. Then, the sample number difference of each pitch cycle indicates how many samples shall be deleted from the cyclically repeated copy corresponding to the corresponding pitch cycle to be reconstructed, or how many samples shall be added to the cyclically repeated copy corresponding to the corresponding pitch cycle to be reconstructed.
According to an embodiment, the determination unit 210 may, e.g., be configured to determine a sample number difference for each of a plurality of pitch cycles to be reconstructed, such that the sample number difference of each of the pitch cycles indicates a difference between the number of samples of said one of the one or more available pitch cycles and a number of samples of said pitch cycle to be reconstructed. The frame reconstructor 220 may, e.g., be configured to reconstruct each pitch cycle of the plurality of pitch cycles to be reconstructed depending on the sample number difference of said pitch cycle to be reconstructed and depending on the samples of said one of the one or more available pitch cycles, to reconstruct the reconstructed frame.
In an embodiment, the frame reconstructor 220 may, e.g., be configured to generate an intermediate frame depending on said one of the of the one or more available pitch cycles. The frame reconstructor 220 may, e.g., be configured to modify the intermediate frame to obtain the reconstructed frame.
According to an embodiment, the determination unit 210 may, e.g., be configured to determine a frame difference value (<i>d</i>; <i>s</i>) indicating how many samples are to be removed from the intermediate frame or how many samples are to be added to the intermediate frame. Moreover, the frame reconstructor 220 may, e.g., be configured to remove first samples from the intermediate frame to obtain the reconstructed frame, when the frame difference value indicates that the first samples shall be removed from the frame. Furthermore, the frame reconstructor 220 may, e.g., be configured to add second samples to the intermediate frame to obtain the reconstructed frame, when the frame difference value (<i>d</i>; <i>s</i>) indicates that the second samples shall be added to the frame.
In an embodiment, the frame reconstructor 220 may, e.g., be configured to remove the first samples from the intermediate frame when the frame difference value indicates that the first samples shall be removed from the frame, so that the number of first samples that are removed from the intermediate frame is indicated by the frame difference value. Moreover, the frame reconstructor 220 may, e.g., be configured to add the second samples to the intermediate frame when the frame difference value indicates that the second samples shall be added to the frame, so that the number of second samples that are added to the intermediate frame is indicated by the frame difference value.
According to an embodiment, the determination unit 210 may, e.g., be configured to determine the frame difference number <i>s</i> so that the formula: <maths id="math0089"><math display="block"><mi>s</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>M</mi><mo>−</mo><mn>1</mn></mrow></munderover><mrow><mfenced><mi>p</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>−</mo><msub><mi>T</mi><mi>r</mi></msub></mfenced><mfrac><mi>L</mi><msub><mi mathvariant="italic">MT</mi><mi>r</mi></msub></mfrac></mrow></mstyle></math><img file="EP4375993A2_D0090.tif" /></maths> holds true, wherein <i>L</i> indicates a number of samples of the reconstructed frame, wherein <i>M</i> indicates a number of subframes of the reconstructed frame, wherein <i>T<sub>r</sub></i> indicates a rounded pitch period length of said one of the one or more available pitch cycles, and wherein <i>p</i>[i] indicates a pitch period length of a reconstructed pitch cycle of the <i>i</i>-th subframe of the reconstructed frame.
In an embodiment, the frame reconstructor 220 may, e.g., be adapted to generate an intermediate frame depending on said one of the one or more available pitch cycles. Moreover, the frame reconstructor 220 may, e.g., be adapted to generate the intermediate frame so that the intermediate frame comprises a first partial intermediate pitch cycle, one or more further intermediate pitch cylces, and a second partial intermediate pitch cycle. Furthermore, the first partial intermediate pitch cycle may, e.g., depend on one or more of the samples of said one of the one or more available pitch cycles, wherein each of the one or more further intermediate pitch cycles depends on all of the samples of said one of the one or more available pitch cycles, and wherein the second partial intermediate pitch cycle depends on one or more of the samples of said one of the one or more available pitch cycles. Moreover, the determination unit 210 may, e.g., be configured to determine a start portion difference number indicating how many samples are to be removed or added from the first partial intermediate pitch cycle, and wherein the frame reconstructor 220 is configured to remove one or more first samples from the first partial intermediate pitch cycle, or is configured to add one or more first samples to the first partial intermediate pitch cycle depending on the start portion difference number. Furthermore, the determination unit 210 may, e.g., be configured to determine for each of the further intermediate pitch cycles a pitch cycle difference number indicating how many samples are to be removed or added from said one of the further intermediate pitch cycles. Moreover, the frame reconstructor 220 may, e.g., be configured to remove one or more second samples from said one of the further intermediate pitch cycles, or is configured to add one or more second samples to said one of the further intermediate pitch cycles depending on said pitch cycle difference number. Furthermore, the determination unit 210 may, e.g., be configured to determine an end portion difference number indicating how many samples are to be removed or added from the second partial intermediate pitch cycle, and wherein the frame reconstructor 220 is configured to remove one or more third samples from the second partial intermediate pitch cycle, or is configured to add one or more third samples to the second partial intermediate pitch cycle depending on the end portion difference number.
According to an embodiment, the frame reconstructor 220 may, e.g., be configured to generate an intermediate frame depending on said one of the of the one or more available pitch cycles. Moreover, the determination unit 210 may, e.g., be adapted to determine one or more low energy signal portions of the speech signal comprised by the intermediate frame, wherein each of the one or more low energy signal portions is a first signal portion of the speech signal within the intermediate frame, where the energy of the speech signal is lower than in a second signal portion of the speech signal comprised by the intermediate frame. Furthermore, the frame reconstructor 220 may, e.g., be configured to remove one or more samples from at least one of the one or more low energy signal portions of the speech signal, or to add one or more samples to at least one of the one or more low energy signal portions of the speech signal, to obtain the reconstructed frame.
In a particular embodiment, the frame reconstructor 220 may, e.g., be configured to generate the intermediate frame, such that the intermediate frame comprises one or more reconstructed pitch cycles, such that each of the one or more reconstructed pitch cylces depends on said one of the of the one or more available pitch cycles. Moreover, the determination unit 210 may, e.g., be configured to determine a number of samples that shall be removed from each of the one or more reconstructed pitch cycles. Furthermore, the determination unit 210 may, e.g., be configured to determine each of the one or more low energy signal portions such that for each of the one or more low energy signal portions a number of samples of said low energy signal portion depends on the number of samples that shall be removed from one of the one or more reconstructed pitch cycles, wherein said low energy signal portion is located within said one of the one or more reconstructed pitch cycles.
In an embodiment, the determination unit 210 may, e.g., be configured to determine a position of one or more pulses of the speech signal of the frame to be reconstructed as reconstructed frame. Moreover, the frame reconstructor 220 may, e.g., be configured to reconstruct the reconstructed frame depending on the position of the one or more pulses of the speech signal.
According to an embodiment, the determination unit 210 may, e.g., be configured to determine a position of two or more pulses of the speech signal of the frame to be reconstructed as reconstructed frame, wherein <i>T</i> [0] is the position of one of the two or more pulses of the speech signal of the frame to be reconstructed as reconstructed frame, and wherein the determination unit 210 is configured to determine the position (<i>T</i> [<i>i</i>]) of further pulses of the two or more pulses of the speech signal according to the formula: <maths id="math0090"><math display="block"><mi>T</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>=</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mi>i</mi><mspace width="1ex" /><msub><mi>T</mi><mi>r</mi></msub></math><img file="EP4375993A2_D0091.tif" /></maths> wherein <i>T<sub>r</sub></i> indicates a rounded length of said one of the one or more available pitch cycles, and wherein <i>i</i> is an integer.
According to an embodiment, the determination unit 210 may, e.g., be configured to determine an index <i>k</i> of the last pulse of the speech signal of the frame to be reconstructed as the reconstructed frame such that <maths id="math0091"><math display="block"><mi>k</mi><mo>=</mo><mrow><mo>⌈</mo><mrow><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>−</mo><mn>1</mn></mrow><mo>⌉</mo></mrow><mo>,</mo></math><img file="EP4375993A2_D0092.tif" /></maths> wherein <i>L</i> indicates a number of samples of the reconstructed frame, wherein <i>s</i> indicates the frame difference value, wherein <i>T</i> [0] indicates a position of a pulse of the speech signal of the frame to be reconstructed as the reconstructed frame, being different from the last pulse of the speech signal, and wherein <i>T<sub>r</sub></i> indicates a rounded length of said one of the one or more available pitch cycles.
In an embodiment, the determination unit 210 may, e.g., be configured to reconstruct the frame to be reconstructed as the reconstructed frame by determining a parameter <i>δ</i> , wherein <i>δ</i> is defined according to the formula: <maths id="math0092"><math display="block"><mi>δ</mi><mo>=</mo><mfrac><mrow><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub><mo>−</mo><msub><mi>T</mi><mi>p</mi></msub></mrow><mi>M</mi></mfrac></math><img file="EP4375993A2_D0093.tif" /></maths> wherein the frame to be reconstructed as the reconstructed frame comprises <i>M</i> subframes, wherein <i>T<sub>p</sub></i> indicates the length of said one of the one or more available pitch cycles, and wherein <i>T<sub>ext</sub></i> indicates a length of one of the pitch cycles to be reconstructed of the frame to be reconstructed as the reconstructed frame.
According to an embodiment, the determination unit 210 may, e.g., be configured to reconstruct the reconstructed frame by determining a rounded length <i>T<sub>r</sub></i> of said one of the one or more available pitch cycles based on formula: <maths id="math0093"><math display="block"><msub><mi>T</mi><mi>r</mi></msub><mo>=</mo><mrow><mo>⌊</mo><mrow><msub><mi>T</mi><mi>p</mi></msub><mo>+</mo><mn>0.5</mn></mrow><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0094.tif" /></maths> wherein <i>T<sub>p</sub></i> indicates the length of said one of the one or more available pitch cycles.
In an embodiment, the determination unit 210 may, e.g., be configured to reconstruct the reconstructed frame by applying the formula: <maths id="math0094"><math display="block"><mi>s</mi><mo>=</mo><mi>δ</mi><mfrac><mi>L</mi><msub><mi>T</mi><mi>r</mi></msub></mfrac><mfrac><mrow><mi>M</mi><mo>+</mo><mn>1</mn></mrow><mn>2</mn></mfrac><mo>−</mo><mi>L</mi><mfenced><mn>1</mn><mo>−</mo><mfrac><msub><mi>T</mi><mi>p</mi></msub><msub><mi>T</mi><mi>r</mi></msub></mfrac></mfenced></math><img file="EP4375993A2_D0095.tif" /></maths> wherein <i>T<sub>p</sub></i> indicates the length of said one of the one or more available pitch cycles, wherein <i>T<sub>r</sub></i> indicates a rounded length of said one of the one or more available pitch cycles, wherein the frame to be reconstructed as the reconstructed frame comprises <i>M</i> subframes, wherein the frame to be reconstructed as the reconstructed frame comprises <i>L</i> samples, and wherein <i>δ</i> is a real number indicating a difference between a number of samples of said one of the one or more available pitch cycles and a number of samples of one of one or more pitch cycles to be reconstructed.
Now, embodiments are described in more detail.
In the following, a first group of pulse resynchronization embodiments is described with reference to formulae (25) - (63).
In such embodiments, if there is no pitch change, the last pitch lag is used without rounding, preserving the fractional part. The periodic part is constructed using the non-integer pitch and interpolation as for example in [MTTA90]. This will reduce the frequency shift of the harmonics, compared to using the rounded pitch lag and thus significantly improve concealment of tonal or voiced signals with constant pitch.
The advantage is illustrated by <figref idref="f0010">Fig. 8</figref> and <figref idref="f0011">Fig. 9</figref>, where the signal representing pitch pipe with frame losses is concealed using respectively rounded and non-rounded fractional pitch lag. There, <figref idref="f0010">Fig. 8</figref> illustrates a time-frequency representation of a speech signal being resynchronized using a rounded pitch lag. In contrast, <figref idref="f0011">Fig. 9</figref> illustrates a time-frequency representation of a speech signal being resynchronized using a non-rounded pitch lag with the fractional part.
There will be an increased computational complexity when using the fractional part of the pitch. This should not influence the worst case complexity as there is no need for the glottal pulse resynchronization.
If there is no predicted pitch change then there is no need for the processing explained below.
If a pitch change is predicted, the embodiments described with reference to formulae (25) - (63) provide concepts for determining <i>d,</i> being the difference, between the sum of the total number of samples within pitch cycles with the constant pitch (<i>T<sub>c</sub></i>) and the sum of the total number of samples within pitch cycles with the evolving pitch <i>p</i>[<i>i</i>]<i>.</i>
In the following, <i>T<sub>c</sub></i> is defined as in formula (15a): <i>T<sub>c</sub></i> = <i>round</i> (<i>last_pitch</i>)<i>.</i>
According to embodiments, the difference, <i>d</i> may be determined using a faster and more precise algorithm (fast algorithm for determining <i>d</i> approach) as described in the following.
Such an algorithm may, e.g., be based on the following principles: <ul id="ul0007" list-style="dash"><li>In each subframe <i>i</i>: <i>T<sub>c</sub></i> - <i>p</i>[<i>i</i>] samples for each pitch cycle (of length <i>T<sub>c</sub></i>) should be removed (or <i>p</i>[<i>i</i>] - <i>T<sub>c</sub></i> added if <i>T<sub>c</sub></i> - <i>p</i>[<i>i</i>] < 0).</li><li>There are <maths id="math0095"><math display="inline"><mfrac><mrow><mi>L</mi><mo>_</mo><mi mathvariant="italic">subfr</mi></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac></math><img file="EP4375993A2_D0096.tif" /></maths> pitch cycles in each subframe.</li><li>Thus, for each subframe <maths id="math0096"><math display="inline"><mfenced><msub><mi>T</mi><mi>c</mi></msub><mo>−</mo><mi>p</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></mfenced><mfrac><mrow><mi>L</mi><mo>_</mo><mi mathvariant="italic">subfr</mi></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac></math><img file="EP4375993A2_D0097.tif" /></maths> samples should be removed.</li></ul>
According to some embodiments, no rounding is conducted and a fractional pitch is used. Then: <ul id="ul0008" list-style="dash"><li><i>p</i>[<i>i</i>] = <i>T<sub>c</sub></i> + (<i>i</i> + 1)<i>δ</i> .</li><li>Thus, for each subframe <i>i</i>, <maths id="math0097"><math display="inline"><mo>−</mo><mfenced><mi>i</mi><mo>+</mo><mn>1</mn></mfenced><mi>δ</mi><mfrac><mrow><mi>L</mi><mo>_</mo><mi mathvariant="italic">subfr</mi></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac></math><img file="EP4375993A2_D0098.tif" /></maths> samples should be removed if <i>δ</i> < 0 (or added if <i>δ</i> > 0).</li><li>Thus, <maths id="math0098"><math display="inline"><mi>d</mi><mo>=</mo><mo>−</mo><mi>δ</mi><mfrac><mrow><mi>L</mi><mo>_</mo><mi mathvariant="italic">subfr</mi></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mstyle displaystyle="true"><msubsup><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>M</mi></msubsup><mi>i</mi></mstyle></math><img file="EP4375993A2_D0099.tif" /></maths> (where <i>M</i> is the number of subframes in a frame).</li></ul>
According to some other embodiments, rounding is conducted. For the integer pitch (M is the number of subframes in a frame), <i>d</i> is defined as follows: <maths id="math0099" num="(25)"><math display="block"><mi>d</mi><mo>=</mo><mi mathvariant="italic">round</mi><mfenced><mfenced><msub><mi mathvariant="italic">MT</mi><mi>c</mi></msub><mo>−</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>M</mi><mo>−</mo><mn>1</mn></mrow></munderover><mrow><mi>p</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></mrow></mstyle></mfenced><mfrac><mrow><mi>L</mi><mo>_</mo><mi mathvariant="italic">subfr</mi></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac></mfenced></math><img file="EP4375993A2_D0100.tif" /></maths>
According to an embodiment, an algorithm is provided for calculating <i>d</i> accordingly: <img file="EP4375993A2_D0101.tif" />
In another embodiment, the last line of the algorithm is replaced by: <maths id="math0100"><math display="block"><mi mathvariant="normal">d</mi><mo>=</mo><mfenced><mi>short</mi></mfenced><mi>floor</mi><mfenced><mi>L_frame</mi><mo>−</mo><mi>ftmp</mi><mo>∗</mo><mfenced><mi>float</mi></mfenced><mi>L_subfr</mi><mo>/</mo><mi>T_c</mi><mo>+</mo><mn>0.5</mn></mfenced><mo>;</mo></math><img file="EP4375993A2_D0102.tif" /></maths>
According to embodiments the last pulse T[n] is found according to: <maths id="math0101" num="(26)"><math display="block"><mi>n</mi><mo>=</mo><mrow><mi>i</mi><mo>|</mo></mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><msub><mi mathvariant="italic">iT</mi><mi>c</mi></msub><mo><</mo><mi>L</mi><mo>_</mo><mi mathvariant="italic">frame</mi><mspace width="1ex" /><mo>∧</mo><mspace width="1ex" /><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mfenced><mi>i</mi><mo>+</mo><mn>1</mn></mfenced><msub><mi>T</mi><mi>c</mi></msub><mo>≥</mo><mi>L</mi><mo>_</mo><mi mathvariant="italic">frame</mi></math><img file="EP4375993A2_D0103.tif" /></maths>
According to an embodiment, a formula to calculate <i>N</i> is employed. This formula is obtained from formula (26) according to: <maths id="math0102" num="(27)"><math display="block"><mi>N</mi><mo>=</mo><mn>1</mn><mo>+</mo><mrow><mo>⌈</mo><mfrac><mrow><mi>L</mi><mo>_</mo><mi mathvariant="italic">frame</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>⌉</mo></mrow></math><img file="EP4375993A2_D0104.tif" /></maths> and the last pulse has then the index <i>N</i> - 1.
According to this formula, <i>N</i> may be calculated for the examples illustrated by <figref idref="f0006">Fig. 4</figref> and <figref idref="f0007">Fig. 5</figref>.
In the following, a concept without explicit search for the last pulse, but taking pulse positions into account, is described. Such a concept that does not need <i>N</i>, the last pulse index in the constructed periodic part.
Actual last pulse position in the constructed periodic part of the excitation (<i>T</i>[<i>k</i>]) determines the number of the full pitch cycles <i>k</i>, where samples are removed (or added).
<figref idref="f0014">Fig. 12</figref> illustrates a position of the last pulse <i>T</i>[2] before removing <i>d</i> samples. Regarding the embodiments described with respect to formulae (25) - (63), reference sign 1210 denotes <i>d.</i>
In the example of <figref idref="f0014">Fig. 12</figref>, the index of the last pulse <i>k</i> is 2 and there are 2 full pitch cycles from which the samples should be removed.
After removing <i>d</i> samples from the signal of length <i>L_frame</i> + <i>d,</i> there are no samples from the original signal beyond <i>L_frame</i> + <i>d</i> samples. Thus <i>T</i>[<i>k</i>] is within <i>L_frame</i> + <i>d</i> samples and <i>k</i> is thus determined by <maths id="math0103" num="(28)"><math display="block"><mi>k</mi><mo>=</mo><mrow><mi>i</mi><mo>|</mo></mrow><mi>T</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo><</mo><msub><mi>L</mi><mi mathvariant="italic">frame</mi></msub><mo>+</mo><mi>d</mi><mo>≤</mo><mi>T</mi><mfenced open="[" close="]"><mi>i</mi><mo>+</mo><mn>1</mn></mfenced></math><img file="EP4375993A2_D0105.tif" /></maths>
From formula (17) and formula (28), it follows that <maths id="math0104" num="(29)"><math display="block"><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><msub><mi mathvariant="italic">kT</mi><mi>c</mi></msub><mo><</mo><msub><mi>L</mi><mi mathvariant="italic">frame</mi></msub><mo>+</mo><mi>d</mi><mo>≤</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><msub><mi>T</mi><mi>c</mi></msub></math><img file="EP4375993A2_D0106.tif" /></maths>
That is <maths id="math0105" num="(30)"><math display="block"><mfrac><mrow><msub><mi>L</mi><mi mathvariant="italic">frame</mi></msub><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>−</mo><mn>1</mn><mo>≤</mo><mi>k</mi><mo><</mo><mfrac><mrow><msub><mi>L</mi><mi mathvariant="italic">frame</mi></msub><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac></math><img file="EP4375993A2_D0107.tif" /></maths>
From formula (30) it follows that <maths id="math0106" num="(31)"><math display="block"><mi>k</mi><mo>=</mo><mrow><mo>⌈</mo><mrow><mfrac><mrow><msub><mi>L</mi><mi mathvariant="italic">frame</mi></msub><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>−</mo><mn>1</mn></mrow><mo>⌉</mo></mrow></math><img file="EP4375993A2_D0108.tif" /></maths>
In a codec that, e.g., uses frames of at least 20 ms and, where the lowest fundamental frequency of speech is, e.g., at least 40 Hz, in most cases at least one pulse exists in the concealed frame other than UNVOICED.
In the following, a case with at least two pulses (k ≥ 1) is described with reference to formulae (32) - (46).
Assume that in each full <i>i</i><sup>th</sup> pitch cycle between pulses, Δ<i><sub>i</sub></i> samples shall be removed, wherein Δ<i><sub>i</sub></i> is defined as: <maths id="math0107" num="(32)"><math display="block"><msub><mi mathvariant="normal">Δ</mi><mi>i</mi></msub><mo>=</mo><mi mathvariant="normal">Δ</mi><mo>+</mo><mfenced><mi>i</mi><mo>−</mo><mn>1</mn></mfenced><mspace width="1ex" /><mi>a</mi><mo>,</mo><mspace width="1ex" /><mn>1</mn><mo>≤</mo><mi>i</mi><mo>≤</mo><mi>k</mi><mo>,</mo></math><img file="EP4375993A2_D0109.tif" /></maths> where <i>a</i> is an unknown variable that needs to be expressed in terms of the known variables.
Assume that Δ<sub>0</sub> samples shall be removed before the first pulse, wherein Δ<sub>0</sub> is defined as: <maths id="math0108" num="(33)"><math display="block"><msub><mi mathvariant="normal">Δ</mi><mn>0</mn></msub><mo>=</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>−</mo><mi>a</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac></math><img file="EP4375993A2_D0110.tif" /></maths>
Assume that Δ<sub>k+1</sub> samples shall be removed after the last pulse, wherein Δ<sub>k+1</sub> is defined as: <maths id="math0109" num="(34)"><math display="block"><msub><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow></msub><mo>=</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>+</mo><mi mathvariant="italic">ka</mi></mfenced><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac></math><img file="EP4375993A2_D0111.tif" /></maths>
The last two assumptions are in line with formula (32) taking into account the length of the partial first and last pitch cycles.
Each of the Δ<i><sub>i</sub></i> values is a sample number difference. Moreover, Δ<sub>0</sub> is a sample number difference. Furthermore, Δ<sub><i>k</i>+1</sub> is a sample number difference.
<figref idref="f0015">Fig. 13</figref> illustrates the speech signal of <figref idref="f0014">Fig. 12</figref>, additionally illustrating Δ<sub>0</sub> to Δ<sub>3</sub>. The number of samples to be removed in each pitch cycle is schematically presented in the example in <figref idref="f0015">Fig. 13</figref>, where <i>k</i> = 2. Regarding the embodiments described with reference to formulae (25) - (63), reference sign 1210 denotes <i>d.</i>
The total number of samples to be removed, <i>d,</i> is then related to Δ<i><sub>i</sub></i> as: <maths id="math0110" num="(35)"><math display="block"><mi>d</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow></munderover><msub><mi mathvariant="normal">Δ</mi><mi>i</mi></msub></mstyle></math><img file="EP4375993A2_D0112.tif" /></maths>
From formulae (32) - (35), <i>d</i> can be obtained as: <maths id="math0111" num="(36)"><math display="block"><mi>d</mi><mo>=</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>−</mo><mi>a</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>+</mo><mi mathvariant="italic">ka</mi></mfenced><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>k</mi></munderover><mfenced><mi mathvariant="normal">Δ</mi><mo>+</mo><mfenced><mi>i</mi><mo>−</mo><mn>1</mn></mfenced><mi>a</mi></mfenced></mstyle></math><img file="EP4375993A2_D0113.tif" /></maths>
Formula (36) is equivalent to: <maths id="math0112" num="(37)"><math display="block"><mi>d</mi><mo>=</mo><mi mathvariant="normal">Δ</mi><mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mi>k</mi></mfenced><mo>+</mo><mi>a</mi><mfenced><mi>k</mi><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>−</mo><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac></mfenced></math><img file="EP4375993A2_D0114.tif" /></maths>
Assume that the last full pitch cycle in a concealed frame has <i>p</i>[<i>M -</i> 1] length, that is: <maths id="math0113" num="(38)"><math display="block"><msub><mi mathvariant="normal">Δ</mi><mi>k</mi></msub><mo>=</mo><msub><mi>T</mi><mi>c</mi></msub><mo>−</mo><mi>p</mi><mfenced open="[" close="]"><mi>M</mi><mo>−</mo><mn>1</mn></mfenced></math><img file="EP4375993A2_D0115.tif" /></maths>
From formula (32) and formula (38) it follows that: <maths id="math0114" num="(39)"><math display="block"><mi mathvariant="normal">Δ</mi><mo>=</mo><msub><mi>T</mi><mi>c</mi></msub><mo>−</mo><mi>p</mi><mfenced open="[" close="]"><mi>M</mi><mo>−</mo><mn>1</mn></mfenced><mo>−</mo><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced><mi>a</mi></math><img file="EP4375993A2_D0116.tif" /></maths>
Moreover, from formula (37) and formula (39), it follows that: <maths id="math0115"><math display="block"><mi>d</mi><mo>=</mo><mfenced><msub><mi>T</mi><mi>c</mi></msub><mo>−</mo><mi>p</mi><mfenced open="[" close="]"><mi>M</mi><mo>−</mo><mn>1</mn></mfenced><mo>+</mo><mfenced><mn>1</mn><mo>−</mo><mi>k</mi></mfenced><mi>a</mi></mfenced><mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mi>k</mi></mfenced><mo>+</mo></math><img file="EP4375993A2_D0117.tif" /></maths><maths id="math0116" num="(40)"><math display="block"><mo>+</mo><mi>a</mi><mfenced><mi>k</mi><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>−</mo><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac></mfenced></math><img file="EP4375993A2_D0118.tif" /></maths>
Formula (40) is equivalent to: <maths id="math0117" num="(41)"><math display="block"><mtable><mtr><mtd><mi>d</mi><mo>=</mo><mfenced><msub><mi>T</mi><mi>c</mi></msub><mo>−</mo><mi>p</mi><mfenced open="[" close="]"><mi>M</mi><mo>−</mo><mn>1</mn></mfenced></mfenced><mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mi>k</mi></mfenced><mo>+</mo></mtd></mtr><mtr><mtd><mo>+</mo><mi>a</mi><mfenced><mtable columnalign="left"><mtr><mtd><mfenced><mn>1</mn><mo>−</mo><mi>k</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mfenced><mn>1</mn><mo>−</mo><mi>k</mi></mfenced><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo></mtd></mtr><mtr><mtd><mo>+</mo><mfenced><mn>1</mn><mo>−</mo><mi>k</mi></mfenced><mi>k</mi><mo>+</mo><mi>k</mi><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>−</mo><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac></mtd></mtr></mtable></mfenced></mtd></mtr></mtable></math><img file="EP4375993A2_D0119.tif" /></maths>
From formula (17) and formula (41), it follows that: <maths id="math0118" num="(42)"><math display="block"><mi>d</mi><mo>=</mo><mfenced><msub><mi>T</mi><mi>c</mi></msub><mo>−</mo><mi>p</mi><mfenced open="[" close="]"><mi>M</mi><mo>−</mo><mn>1</mn></mfenced></mfenced><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mi>a</mi><mfenced><mo>−</mo><mi>k</mi><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>−</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac></mfenced></math><img file="EP4375993A2_D0120.tif" /></maths>
Formula (42) is equivalent to: <maths id="math0119" num="(43)"><math display="block"><mtable><mtr><mtd><msub><mi mathvariant="italic">dT</mi><mi>c</mi></msub><mo>=</mo><mfenced><msub><mi>T</mi><mi>c</mi></msub><mo>−</mo><mi>p</mi><mfenced open="[" close="]"><mi>M</mi><mo>−</mo><mn>1</mn></mfenced></mfenced><mfenced><mi>L</mi><mo>+</mo><mi>d</mi></mfenced><mo>+</mo></mtd></mtr><mtr><mtd><mo>+</mo><mi>a</mi><mfenced><mo>−</mo><mi mathvariant="italic">kT</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mn>1</mn><mo>−</mo><mi>k</mi></mfenced></mrow><mn>2</mn></mfrac><msub><mi>T</mi><mi>c</mi></msub></mfenced></mtd></mtr></mtable></math><img file="EP4375993A2_D0121.tif" /></maths>
Furthermore, from formula (43), it follows that: <maths id="math0120" num="(44)"><math display="block"><mi>a</mi><mo>=</mo><mfrac><mrow><msub><mi mathvariant="italic">dT</mi><mi>c</mi></msub><mo>−</mo><mfenced><msub><mi>T</mi><mi>c</mi></msub><mo>−</mo><mi>p</mi><mfenced open="[" close="]"><mi>M</mi><mo>−</mo><mn>1</mn></mfenced></mfenced><mfenced><mi>L</mi><mo>+</mo><mi>d</mi></mfenced></mrow><mrow><mo>−</mo><mi mathvariant="italic">kT</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mn>1</mn><mo>−</mo><mi>k</mi></mfenced></mrow><mn>2</mn></mfrac><msub><mi>T</mi><mi>c</mi></msub></mrow></mfrac></math><img file="EP4375993A2_D0122.tif" /></maths>
Formula (44) is equivalent to: <maths id="math0121" num="(45)"><math display="block"><mi>a</mi><mo>=</mo><mfrac><mrow><mi>p</mi><mfenced open="[" close="]"><mi>M</mi><mo>−</mo><mn>1</mn></mfenced><mfenced><mi>L</mi><mo>+</mo><mi>d</mi></mfenced><mo>−</mo><msub><mi>T</mi><mi>c</mi></msub><mi>L</mi></mrow><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>−</mo><msub><mi mathvariant="italic">kT</mi><mi>c</mi></msub><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mn>1</mn><mo>−</mo><mi>k</mi></mfenced></mrow><mn>2</mn></mfrac><msub><mi>T</mi><mi>c</mi></msub></mrow></mfrac></math><img file="EP4375993A2_D0123.tif" /></maths>
Moreover, formula (45) is equivalent to: <maths id="math0122" num="(46)"><math display="block"><mi>a</mi><mo>=</mo><mfrac><mrow><mi>p</mi><mfenced open="[" close="]"><mi>M</mi><mo>−</mo><mn>1</mn></mfenced><mfenced><mi>L</mi><mo>+</mo><mi>d</mi></mfenced><mo>−</mo><msub><mi>T</mi><mi>c</mi></msub><mi>L</mi></mrow><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>−</mo><mfrac><mrow><mi>k</mi><mfenced><mn>1</mn><mo>+</mo><mi>k</mi></mfenced></mrow><mn>2</mn></mfrac><msub><mi>T</mi><mi>c</mi></msub></mrow></mfrac></math><img file="EP4375993A2_D0124.tif" /></maths>
According to embodiments, it is now calculated based on formulae (32)-(34), (39) and (46), how many samples are to be removed or added before the first pulse, and/or between pulses and/or after the last pulse.
In an embodiment, the samples are removed or added in the minimum energy regions.
According to embodiments, the number of samples to be removed may, for example, be rounded using: <maths id="math0123"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mo>′</mo></msubsup><mo>=</mo><mrow><mo>⌊</mo><msub><mi mathvariant="normal">Δ</mi><mn>0</mn></msub><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0125.tif" /></maths><maths id="math0124"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mi>i</mi><mo>′</mo></msubsup><mo>=</mo><mrow><mo>⌊</mo><mrow><msub><mi mathvariant="normal">Δ</mi><mi>i</mi></msub><mo>+</mo><msub><mi mathvariant="normal">Δ</mi><mrow><mi>i</mi><mo>−</mo><mn>1</mn></mrow></msub><mo>−</mo><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>i</mi><mo>−</mo><mn>1</mn></mrow><mo>′</mo></msubsup></mrow><mo>⌋</mo></mrow><mo>,</mo><mspace width="1ex" /><mn>0</mn><mo><</mo><mi>i</mi><mo>≤</mo><mi>k</mi></math><img file="EP4375993A2_D0126.tif" /></maths><maths id="math0125"><math display="block"><msub><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow></msub><mo>=</mo><mi>d</mi><mo>−</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mi>k</mi></munderover><msub><mi mathvariant="normal">Δ</mi><mi>i</mi></msub></mstyle></math><img file="EP4375993A2_D0127.tif" /></maths>
In the following, a case with one pulse (k = 0) is described with reference to formulae (47) - (55).
If there is just one pulse in the concealed frame, then Δ<sub>0</sub> samples are to be removed before the pulse: <maths id="math0126" num="(47)"><math display="block"><msub><mi mathvariant="normal">Δ</mi><mn>0</mn></msub><mo>=</mo><mfenced><mi>Δ−</mi><mi>a</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac></math><img file="EP4375993A2_D0128.tif" /></maths> wherein Δ and <i>a</i> are unknown variables that need to be expressed in terms of the known variables. Δ<sub>1</sub> samples are to be removed after the pulse, where: <maths id="math0127" num="(48)"><math display="block"><msub><mi mathvariant="normal">Δ</mi><mn>1</mn></msub><mo>=</mo><mi mathvariant="normal">Δ</mi><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac></math><img file="EP4375993A2_D0129.tif" /></maths>
Then the total number of samples to be removed is given by: <maths id="math0128" num="(49)"><math display="block"><mi>d</mi><mo>=</mo><msub><mi mathvariant="normal">Δ</mi><mn>0</mn></msub><mo>+</mo><msub><mi mathvariant="normal">Δ</mi><mn>1</mn></msub></math><img file="EP4375993A2_D0130.tif" /></maths>
From formulae (47) - (49), it follows that: <maths id="math0129" num="(50)"><math display="block"><mi>d</mi><mo>=</mo><mfenced><mi>Δ−</mi><mi>a</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mi mathvariant="normal">Δ</mi><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac></math><img file="EP4375993A2_D0131.tif" /></maths>
Formula (50) is equivalent to: <maths id="math0130" num="(51)"><math display="block"><msub><mi mathvariant="italic">dT</mi><mi>c</mi></msub><mo>=</mo><mi mathvariant="normal">Δ</mi><mfenced><mi>L</mi><mo>+</mo><mi>d</mi></mfenced><mo>−</mo><mi mathvariant="italic">aT</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></math><img file="EP4375993A2_D0132.tif" /></maths>
It is assumed that the ratio of the pitch cycle before the pulse to the pitch cycle after the pulse is the same as the ratio between the pitch lag in the last subframe and the first subframe in the previously received frame: <maths id="math0131" num="(52)"><math display="block"><mfrac><mi mathvariant="normal">Δ</mi><mrow><mi>Δ−</mi><mi>a</mi></mrow></mfrac><mo>=</mo><mfrac><mrow><mi>p</mi><mfenced open="[" close="]"><mo>−</mo><mn>1</mn></mfenced></mrow><mrow><mi>p</mi><mfenced open="[" close="]"><mo>−</mo><mn>4</mn></mfenced></mrow></mfrac><mo>=</mo><mi>r</mi></math><img file="EP4375993A2_D0133.tif" /></maths>
From formula (52), it follows that: <maths id="math0132" num="(53)"><math display="block"><mi>a</mi><mo>=</mo><mi mathvariant="normal">Δ</mi><mspace width="1ex" /><mfenced><mn>1</mn><mo>−</mo><mfrac><mn>1</mn><mi>r</mi></mfrac></mfenced></math><img file="EP4375993A2_D0134.tif" /></maths>
Moreover, from formula (51) and formula (53), it follows that: <maths id="math0133" num="(54)"><math display="block"><msub><mi mathvariant="italic">dT</mi><mi>c</mi></msub><mo>=</mo><mi mathvariant="normal">Δ</mi><mspace width="1ex" /><mfenced><mi>L</mi><mo>+</mo><mi>d</mi></mfenced><mo>−</mo><mi mathvariant="normal">Δ</mi><mspace width="1ex" /><mfenced><mn>1</mn><mo>−</mo><mfrac><mn>1</mn><mi>r</mi></mfrac></mfenced><mspace width="1ex" /><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></math><img file="EP4375993A2_D0135.tif" /></maths>
Formula (54) is equivalent to: <maths id="math0134" num="(55)"><math display="block"><mi mathvariant="normal">Δ</mi><mo>=</mo><mfrac><msub><mi mathvariant="italic">dT</mi><mi>c</mi></msub><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>+</mo><mfenced><mfrac><mn>1</mn><mi>r</mi></mfrac><mo>−</mo><mn>1</mn></mfenced><mspace width="1ex" /><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow></mfrac></math><img file="EP4375993A2_D0136.tif" /></maths>
There are <maths id="math0135"><math display="inline"><mo>⌊</mo><mrow><mi mathvariant="normal">Δ</mi><mo>−</mo><mi>a</mi></mrow><mo>⌋</mo></math><img file="EP4375993A2_D0137.tif" /></maths> samples to be removed or added in the minimum energy region before the pulse and <maths id="math0136"><math display="inline"><mi>d</mi><mo>−</mo><mrow><mo>⌊</mo><mrow><mi mathvariant="normal">Δ</mi><mo>−</mo><mi>a</mi></mrow><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0138.tif" /></maths> samples after the pulse.
In the following, a simplified concept according to embodiments, which does not require a search for (the location of) pulses, is described with reference to formulae (56) - (63).
<i>t</i> [<i>i</i>] denotes the length of the <i>i<sup>th</sup></i> pitch cycle. After removing <i>d</i> samples from the signal, <i>k</i> full pitch cycles and 1 partial (up to full) pitch cycle are obtained.
Thus: <maths id="math0137" num="(56)"><math display="block"><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>k</mi><mo>−</mo><mn>1</mn></mrow></munderover><mrow><mi>t</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></mrow></mstyle><mo><</mo><mi>L</mi><mo>≤</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mi>k</mi></munderover><mrow><mi>t</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></mrow></mstyle></math><img file="EP4375993A2_D0139.tif" /></maths>
As pitch cycles of length <i>t</i> [<i>i</i>] are obtained from the pitch cycle of length <i>T<sub>c</sub></i> after removing some samples, and as the total number of removed samples is d, it follows that <maths id="math0138" num="(57)"><math display="block"><msub><mi mathvariant="italic">kT</mi><mi>c</mi></msub><mo><</mo><mi>L</mi><mo>+</mo><mi>d</mi><mo>≤</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><msub><mi>T</mi><mi>c</mi></msub></math><img file="EP4375993A2_D0140.tif" /></maths>
It follows that: <maths id="math0139" num="(58)"><math display="block"><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>−</mo><mn>1</mn><mo>≤</mo><mi>k</mi><mo><</mo><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac></math><img file="EP4375993A2_D0141.tif" /></maths>
Moreover, it follows that <maths id="math0140" num="(59)"><math display="block"><mi>k</mi><mo>=</mo><mrow><mo>⌈</mo><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>⌉</mo></mrow><mo>−</mo><mn>1</mn></math><img file="EP4375993A2_D0142.tif" /></maths>
According to embodiments, a linear change in the pitch lag may be assumed: <maths id="math0141"><math display="block"><mi>t</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>=</mo><msub><mi>T</mi><mi>c</mi></msub><mo>−</mo><mfenced><mi>i</mi><mo>+</mo><mn>1</mn></mfenced><mi mathvariant="normal">Δ</mi><mo>,</mo><mspace width="1ex" /><mn>0</mn><mo>≤</mo><mi>i</mi><mo>≤</mo><mi>k</mi></math><img file="EP4375993A2_D0143.tif" /></maths>
In embodiments, (<i>k</i> + 1) Δ samples are removed in the <i>k<sup>th</sup></i> pitch cycle.
According to embodiments, in the part of the <i>k<sup>th</sup></i> pitch cycle, that stays in the frame after removing the samples, <maths id="math0142"><math display="block"><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><msub><mi mathvariant="italic">kT</mi><mi>c</mi></msub></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mi mathvariant="normal">Δ</mi></math><img file="EP4375993A2_D0144.tif" /></maths> samples are removed.
Thus, the total number of the removed samples is: <maths id="math0143" num="(60)"><math display="block"><mi>d</mi><mo>=</mo><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><msub><mi mathvariant="italic">kT</mi><mi>c</mi></msub></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mi mathvariant="normal">Δ</mi><mo>+</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>k</mi><mo>−</mo><mn>1</mn></mrow></munderover><mfenced><mi>i</mi><mo>+</mo><mn>1</mn></mfenced></mstyle><mi mathvariant="normal">Δ</mi></math><img file="EP4375993A2_D0145.tif" /></maths>
Formula (60) is equivalent to: <maths id="math0144" num="(61)"><math display="block"><mi>d</mi><mo>=</mo><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><msub><mi mathvariant="italic">kT</mi><mi>c</mi></msub></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mi mathvariant="normal">Δ</mi><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac><mi mathvariant="normal">Δ</mi></math><img file="EP4375993A2_D0146.tif" /></maths>
Moreover, formula (61) is equivalent to: <maths id="math0145" num="(62)"><math display="block"><mfrac><mi>d</mi><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced></mfrac><mo>=</mo><mfenced><mfrac><mrow><mi>L</mi><mo>+</mo><mi>d</mi><mo>−</mo><msub><mi mathvariant="italic">kT</mi><mi>c</mi></msub></mrow><msub><mi>T</mi><mi>c</mi></msub></mfrac><mo>+</mo><mfrac><mi>k</mi><mn>2</mn></mfrac></mfenced><mi mathvariant="normal">Δ</mi></math><img file="EP4375993A2_D0147.tif" /></maths>
Furthermore, formula (62) is equivalent to: <maths id="math0146" num="(63)"><math display="block"><mi mathvariant="normal">Δ</mi><mo>=</mo><mfrac><mrow><mn>2</mn><msub><mi mathvariant="italic">dT</mi><mi>c</mi></msub></mrow><mrow><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mfenced><mn>2</mn><mi>L</mi><mo>+</mo><mn>2</mn><mi>d</mi><mo>−</mo><msub><mi mathvariant="italic">kT</mi><mi>c</mi></msub></mfenced></mrow></mfrac></math><img file="EP4375993A2_D0148.tif" /></maths>
According to embodiments, (<i>i</i> + 1) Δ samples are removed at the position of the minimum energy. There is no need to know the location of pulses, as the search for the minimum energy position is done in the circular buffer that holds one pitch cycle.
If the minimum energy position is after the first pulse and if samples before the first pulse are not removed, then a situation could occur, where the pitch lag evolves as (<i>T<sub>c</sub></i> + Δ),<i>T<sub>c</sub></i>, <i>T<sub>c</sub>,</i> (<i>T<sub>c</sub></i> - Δ), (<i>T<sub>c</sub></i> - 2Δ) (2 pitch cycles in the last received frame and 3 pitch cycles in the concealed frame). Thus, there would be a discontinuity. The similar discontinuity may arise after the last pulse, but not at the same time when it happens before the first pulse.
On the other hand, the minimum energy region would appear after the first pulse more likely, if the pulse is closer to the concealed frame beginning. If the first pulse is closer to the concealed frame beginning, it is more likely that the last pitch cycle in the last received frame is larger than <i>T<sub>c</sub>.</i> To reduce the possibility of the discontinuity in the pitch change, weighting should be used to give advantage to minimum regions closer to the beginning or to the end of the pitch cycle.
According to embodiments, an implementation of the provided concepts is described, which implements one or more or all of the following method steps: <ol id="ol0001"><li>1. Store, in a temporary buffer B, low pass filtered <i>T<sub>c</sub></i> samples from the end of the last received frame, searching in parallel for the minimum energy region. The temporary buffer is considered as a circular buffer when searching for the minimum energy region. (This may mean that the minimum energy region may consist of few samples from the beginning and few samples from the end of the pitch cycle.) The minimum energy region may, e.g., be the location of the minimum for the sliding window of length <maths id="math0147"><math display="inline"><mo>⌈</mo><mrow><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mi mathvariant="normal">Δ</mi></mrow><mo>⌉</mo></math><img file="EP4375993A2_D0149.tif" /></maths> samples. Weighting may, for example, be used, that may, e.g., give advantage to the minimum regions closer to the beginning of the pitch cycle.</li><li>2. Copy the samples from the temporary buffer B to the frame, skipping <maths id="math0148"><math display="inline"><mo>⌊</mo><mi mathvariant="normal">Δ</mi><mo>⌋</mo></math><img file="EP4375993A2_D0150.tif" /></maths> samples at the minimum energy region. Thus, a pitch cycle with length <i>t</i> [0] is created. Set <maths id="math0149"><math display="inline"><msub><mi>δ</mi><mn>0</mn></msub><mo>=</mo><mi mathvariant="normal">Δ</mi><mo>−</mo><mrow><mo>⌊</mo><mi mathvariant="normal">Δ</mi><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0151.tif" /></maths>.</li><li>3. For the <i>i<sup>th</sup></i> pitch cycle (0 < i < k), copy the samples from the (i - 1)<i><sup>th</sup></i> pitch cycles, skipping <maths id="math0150"><math display="inline"><mrow><mo>⌊</mo><mi mathvariant="normal">Δ</mi><mo>⌋</mo></mrow><mo>+</mo><mrow><mo>⌊</mo><msub><mi>δ</mi><mrow><mi>i</mi><mo>−</mo><mn>1</mn></mrow></msub><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0152.tif" /></maths> samples at the minimum energy region. Set <maths id="math0151"><math display="inline"><msub><mi>δ</mi><mi>i</mi></msub><mo>=</mo><msub><mi>δ</mi><mrow><mi>i</mi><mo>−</mo><mn>1</mn></mrow></msub><mo>−</mo><mrow><mo>⌊</mo><msub><mi>δ</mi><mrow><mi>i</mi><mo>−</mo><mn>1</mn></mrow></msub><mo>⌋</mo></mrow><mo>+</mo><mi mathvariant="normal">Δ</mi><mo>−</mo><mrow><mo>⌊</mo><mi mathvariant="normal">Δ</mi><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0153.tif" /></maths>. Repeat this step <i>k -</i> 1 times.</li><li>4. For <i>k<sup>th</sup></i> pitch cycle search for the new minimum region in the (<i>k</i> - 1)<i><sup>nd</sup></i> pitch cycle using weighting that gives advantage to the minimum regions closer to the end of the pitch cycle. Then copy the samples from the (<i>k</i> - 1)<i><sup>nd</sup></i> pitch cycle, skipping <maths id="math0152"><math display="block"><mi>d</mi><mo>−</mo><mrow><mo>⌊</mo><mrow><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac><mi>Δ+</mi><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac><mi mathvariant="normal">Δ</mi></mrow><mo>⌋</mo></mrow><mo>=</mo><mi>d</mi><mo>−</mo><mrow><mo>⌊</mo><mrow><msup><mi>k</mi><mn>2</mn></msup><mi mathvariant="normal">Δ</mi></mrow><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0154.tif" /></maths> samples at the minimum energy region.</li></ol>
If samples have to be added, the equivalent procedure can be used by taking into account that <i>d</i> < 0 and Δ < 0 and that we add in total |<i>d</i>| samples, that is (<i>k</i> + 1)|Δ| samples are added in the <i>k<sup>th</sup></i> cycle at the position of the minimum energy.
The fractional pitch can be used at the subframe level to derive d as described above with respect to the "fast algorithm for determining <i>d</i> approach", as anyhow the approximated pitch cycle lengths are used.
In the following, a second group of pulse resynchronization embodiments is described with reference to formulae (64) - (113). These embodiments of the first group employ the definition of formula (15b), <maths id="math0153"><math display="block"><msub><mi>T</mi><mi>r</mi></msub><mo>=</mo><mrow><mo>⌊</mo><mrow><msub><mi>T</mi><mi>p</mi></msub><mo>+</mo><mn>0.5</mn></mrow><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0155.tif" /></maths> wherein the last pitch period length is <i>T<sub>p</sub>,</i> and the length of the segment that is copied is <i>Tr.</i>
If some parameters used by the second group of pulse resynchronization embodiments are not defined below, embodiments of the present invention may employ the definitions provided for these parameters with respect to the first group of pulse resynchronization embodiments defined above (see formulae (25) - (63)).
Some of the formulae (64) - (113) of the second group of pulse resynchronization embodiments may redefine some of the parameters already used with respect to the first group of pulse resynchronization embodiments. In this case, the provided redefined definitions apply for the second pulse resynchronization embodiments.
As described above, according to some embodiments, the periodic part may, e.g., be constructed for one frame and one additional subframe, wherein the frame length is denoted as <i>L</i> = <i>L<sub>frame</sub>.</i>
For example, with <i>M</i> subframes in a frame, the subframe length is <maths id="math0154"><math display="inline"><mi>L</mi><mo>_</mo><mi mathvariant="italic">subfr</mi><mo>=</mo><mfrac><mi>L</mi><mi>M</mi></mfrac></math><img file="EP4375993A2_D0156.tif" /></maths>.
As already described, <i>T</i>[0] is the location of the first maximum pulse in the constructed periodic part of the excitation. The positions of the other pulses are given by: <maths id="math0155"><math display="block"><mi>T</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>=</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><msub><mi mathvariant="italic">iT</mi><mi>r</mi></msub><mo>.</mo></math><img file="EP4375993A2_D0157.tif" /></maths>
According to embodiments, depending on the construction of the periodic part of the excitation, for example, after the construction of the periodic part of the excitation, the glottal pulse resynchronization is performed to correct the difference between the estimated target position of the last pulse in the lost frame (<i>P</i>), and its actual position in the constructed periodic part of the excitation (<i>T</i> [<i>k</i>])<i>.</i>
The estimated target position of the last pulse in the lost frame (<i>P</i>) may, for example, be determined indirectly by the estimation of the pitch lag evolution. The pitch lag evolution is, for example, extrapolated based on the pitch lags of the last seven subframes before the lost frame. The evolving pitch lags in each subframe are: <maths id="math0156" num="(64)"><math display="block"><mi>p</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>=</mo><msub><mi>T</mi><mi>p</mi></msub><mo>+</mo><mfenced><mi>i</mi><mo>+</mo><mn>1</mn></mfenced><mi>δ</mi><mo>,</mo><mn>0</mn><mo>≤</mo><mi>i</mi><mo><</mo><mi>M</mi></math><img file="EP4375993A2_D0158.tif" /></maths> where <maths id="math0157" num="(65)"><math display="block"><mi>δ</mi><mo>=</mo><mfrac><mrow><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub><mo>−</mo><msub><mi>T</mi><mi>p</mi></msub></mrow><mi>M</mi></mfrac></math><img file="EP4375993A2_D0159.tif" /></maths> and <i>T<sub>ext</sub></i> is the extrapolated pitch and <i>i</i> is the subframe index. The pitch extrapolation can be done, for example, using weighted linear fitting or the method from G.718 or the method from G.729.1 or any other method for the pitch interpolation that, e.g., takes one or more pitches from future frames into account. The pitch extrapolation can also be non-linear. In an embodiment, <i>T<sub>ext</sub></i> may be determined in the same way as <i>T<sub>ext</sub></i> is determined above.
The difference within a frame length between the sum of the total number of samples within pitch cycles with the evolving pitch (<i>p</i>[<i>i</i>]) and the sum of the total number of samples within pitch cycles with the constant pitch (<i>T<sub>p</sub></i>) is denoted as s.
According to embodiments, if <i>T<sub>ext</sub> > T<sub>p</sub></i> then s samples should be added to a frame, and if <i>T<sub>ext</sub></i> < <i>T<sub>p</sub></i> then -<i>s</i> samples should be removed from a frame. After adding or removing |<i>s</i>| samples, the last pulse in the concealed frame will be at the estimated target position (7).
If <i>T<sub>ext</sub></i> = <i>T<sub>p</sub>,</i> there is no need for an addition or a removal of samples within a frame.
According to some embodiments, the glottal pulse resynchronization is done by adding or removing samples in the minimum energy regions of all of the pitch cycles.
In the following, calculating parameter s according to embodiments is described with reference to formulae (66) - (69).
According to some embodiments, the difference, s, may, for example, be calculated based on the following principles: <ul id="ul0009" list-style="dash" compact="compact"><li>In each subframe <i>i</i>, <i>p</i>[<i>i</i>] - <i>T<sub>r</sub></i> samples for each pitch cycle (of length <i>T<sub>r</sub></i>) should be added (if <i>p</i>[<i>i</i>] - <i>T<sub>r</sub></i> > 0); (or <i>T<sub>r</sub></i> - <i>p</i>[<i>i</i>] samples should be removed if <i>p</i>[<i>i</i>] - <i>T<sub>r</sub></i> < 0).</li><li>There are <maths id="math0158"><math display="inline"><mfrac><mrow><mi>L</mi><mo>_</mo><mi mathvariant="italic">subfr</mi></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>=</mo><mfrac><mi>L</mi><msub><mi mathvariant="italic">MT</mi><mi>r</mi></msub></mfrac></math><img file="EP4375993A2_D0160.tif" /></maths> pitch cycles in each subframe.</li><li>Thus in i-th subframe <maths id="math0159"><math display="inline"><mfenced><mi>p</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>−</mo><msub><mi>T</mi><mi>r</mi></msub></mfenced><mfrac><mi>L</mi><msub><mi mathvariant="italic">MT</mi><mi>r</mi></msub></mfrac></math><img file="EP4375993A2_D0161.tif" /></maths> samples should be removed.</li></ul>
Therefore, in line with formula (64), according to an embodiment, s may, e.g., be calculated according to formula (66): <maths id="math0160" num="(66)"><math display="block"><mtable><mtr><mtd><mi>s</mi><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>M</mi><mo>−</mo><mn>1</mn></mrow></munderover><mfenced><mi>p</mi><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>−</mo><msub><mi>T</mi><mi>r</mi></msub></mfenced></mstyle><mfrac><mi>L</mi><msub><mi mathvariant="italic">MT</mi><mi>r</mi></msub></mfrac><mo>=</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>M</mi><mo>−</mo><mn>1</mn></mrow></munderover><mrow><mfenced><msub><mi>T</mi><mi>p</mi></msub><mo>+</mo><mfenced><mi>i</mi><mo>+</mo><mn>1</mn></mfenced><mi>δ</mi><mo>−</mo><msub><mi>T</mi><mi>r</mi></msub></mfenced><mfrac><mi>L</mi><msub><mi mathvariant="italic">MT</mi><mi>r</mi></msub></mfrac><mo>=</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mo>=</mo><mfrac><mi>L</mi><msub><mi mathvariant="italic">MT</mi><mi>r</mi></msub></mfrac><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>M</mi><mo>−</mo><mn>1</mn></mrow></munderover><mfenced><mfenced><mi>i</mi><mo>+</mo><mn>1</mn></mfenced><mi>δ</mi><mo>+</mo><msub><mi>T</mi><mi>p</mi></msub><mo>−</mo><msub><mi>T</mi><mi>r</mi></msub></mfenced></mstyle></mtd></mtr></mtable></math><img file="EP4375993A2_D0162.tif" /></maths>
Formula (66) is equivalent to: <maths id="math0161" num="(67)"><math display="block"><mi>s</mi><mo>=</mo><mfrac><mi>L</mi><msub><mi mathvariant="italic">MT</mi><mi>r</mi></msub></mfrac><mfenced><mi>M</mi><mfenced><msub><mi>T</mi><mi>p</mi></msub><mo>−</mo><msub><mi>T</mi><mi>r</mi></msub></mfenced><mo>+</mo><mi>δ</mi><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mrow><mi>M</mi><mo>−</mo><mn>1</mn></mrow></munderover><mfenced><mi>i</mi><mo>+</mo><mn>1</mn></mfenced></mstyle></mfenced><mo>=</mo><mfrac><mi>L</mi><msub><mi mathvariant="italic">MT</mi><mi>r</mi></msub></mfrac><mfenced><mi>M</mi><mfenced><msub><mi>T</mi><mi>p</mi></msub><mo>−</mo><msub><mi>T</mi><mi>r</mi></msub></mfenced><mo>+</mo><mi>δ</mi><mfrac><mrow><mi>M</mi><mfenced><mi>M</mi><mo>+</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac></mfenced><mo>,</mo></math><img file="EP4375993A2_D0163.tif" /></maths> wherein formula (67) is equivalent to: <maths id="math0162" num="(68)"><math display="block"><mi>s</mi><mo>=</mo><mfrac><mi>L</mi><msub><mi>T</mi><mi>r</mi></msub></mfrac><mfenced><msub><mi>T</mi><mi>p</mi></msub><mo>−</mo><msub><mi>T</mi><mi>r</mi></msub><mo>+</mo><mi>δ</mi><mfrac><mfenced><mi>M</mi><mo>+</mo><mn>1</mn></mfenced><mn>2</mn></mfrac></mfenced><mo>=</mo><mfrac><mi>L</mi><msub><mi>T</mi><mi>r</mi></msub></mfrac><mi>δ</mi><mfrac><mrow><mi>M</mi><mo>+</mo><mn>1</mn></mrow><mn>2</mn></mfrac><mo>+</mo><mfrac><mi>L</mi><msub><mi>T</mi><mi>r</mi></msub></mfrac><mfenced><msub><mi>T</mi><mi>p</mi></msub><mo>−</mo><msub><mi>T</mi><mi>r</mi></msub></mfenced><mo>,</mo></math><img file="EP4375993A2_D0164.tif" /></maths> and wherein formula (68) is equivalent to: <maths id="math0163" num="(69)"><math display="block"><mi>s</mi><mo>=</mo><mi>δ</mi><mfrac><mi>L</mi><msub><mi>T</mi><mi>r</mi></msub></mfrac><mfrac><mrow><mi>M</mi><mo>+</mo><mn>1</mn></mrow><mn>2</mn></mfrac><mo>−</mo><mi>L</mi><mfenced><mn>1</mn><mo>−</mo><mfrac><msub><mi>T</mi><mi>p</mi></msub><msub><mi>T</mi><mi>r</mi></msub></mfrac></mfenced></math><img file="EP4375993A2_D0165.tif" /></maths>
Note that s is positive if <i>T<sub>ext</sub> > T<sub>p</sub></i> and samples should be added, and that s is negative if <i>T<sub>ext</sub> < T<sub>p</sub></i> and samples should be removed. Thus, the number of samples to be removed or added can be denoted as |<i>s</i>|.
In the following, calculating the index of the last pulse according to embodiments is described with reference to formulae (70) - (73).
The actual last pulse position in the constructed periodic part of the excitation (T[<i>k</i>]) determines the number of the full pitch cycles <i>k</i>, where samples are removed (or added).
<figref idref="f0014">Fig. 12</figref> illustrates a speech signal before removing samples.
In the example illustrated by <figref idref="f0014">Fig. 12</figref>, the index of the last pulse <i>k</i> is 2 and there are two full pitch cycles from which the samples should be removed. Regarding the embodiments described with reference to formulae (64) - (113), reference sign 1210 denotes |<i>s</i>|.
After removing Isl samples from the signal of length <i>L</i> - <i>s,</i> where <i>L</i> = <i>L_frame</i>, or after adding |<i>s</i>| samples to the signal of length <i>L</i> - <i>s</i>, there are no samples from the original signal beyond <i>L</i> - <i>s</i> samples. It should be noted that <i>s</i> is positive if samples are added and that s is negative if samples are removed. Thus <i>L</i> - <i>s</i> < <i>L</i> if samples are added and <i>L</i> - <i>s</i> > <i>L</i> if samples are removed. Thus <i>T</i> [<i>k</i>] must be within <i>L</i> - <i>s</i> samples and <i>k</i> is thus determined by: <maths id="math0164" num="(70)"><math display="block"><mi>k</mi><mo>=</mo><mi>i</mi><mrow><mo>|</mo><mrow><mi>T</mi><mfenced open="[" close="]"><mi>i</mi></mfenced></mrow></mrow><mo><</mo><mi>L</mi><mo>−</mo><mi>s</mi><mo>≤</mo><mi>T</mi><mfenced open="[" close="]"><mi>i</mi><mo>+</mo><mn>1</mn></mfenced></math><img file="EP4375993A2_D0166.tif" /></maths>
From formula (15b) and formula (70), it follows that <maths id="math0165" num="(71)"><math display="block"><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><msub><mi mathvariant="italic">kT</mi><mi>r</mi></msub><mo><</mo><mi>L</mi><mo>−</mo><mi>s</mi><mo>≤</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><msub><mi>T</mi><mi>r</mi></msub></math><img file="EP4375993A2_D0167.tif" /></maths>
That is <maths id="math0166" num="(72)"><math display="block"><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>−</mo><mn>1</mn><mo>≤</mo><mi>k</mi><mo><</mo><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac></math><img file="EP4375993A2_D0168.tif" /></maths>
According to an embodiment, <i>k</i> may, e.g., be determined based on formula (72) as: <maths id="math0167" num="(73)"><math display="block"><mi>k</mi><mo>=</mo><mrow><mo>⌈</mo><mrow><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>−</mo><mn>1</mn></mrow><mo>⌉</mo></mrow></math><img file="EP4375993A2_D0169.tif" /></maths>
For example, in a codec employing frames of, for example, at least 20 ms, and employing a lowest fundamental frequency of speech of at least 40 Hz, in most cases at least one pulse exists in the concealed frame other than UNVOICED.
in the following, calculating the number of samples to be removed in minimum regions according to embodiments is described with reference to formulae (74) - (99).
It may, e.g., be assumed that Δ<i><sub>i</sub></i> samples in each full <i>i<sup>th</sup></i> pitch cycle between pulses shall be removed (or added), where Δ<i><sub>i</sub></i> is defined as: <maths id="math0168" num="(74)"><math display="block"><msub><mi mathvariant="normal">Δ</mi><mi>i</mi></msub><mo>=</mo><mi mathvariant="normal">Δ</mi><mo>+</mo><mfenced><mi>i</mi><mo>−</mo><mn>1</mn></mfenced><mi>a</mi><mo>,</mo><mspace width="1ex" /><mn>1</mn><mo>≤</mo><mi>i</mi><mo>≤</mo><mi>k</mi></math><img file="EP4375993A2_D0170.tif" /></maths> and where <i>a</i> is an unknown variable that may, e.g., be expressed in terms of the known variables.
Moreover, it may, e.g., be assumed that <maths id="math0169"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup></math><img file="EP4375993A2_D0171.tif" /></maths> samples shall be removed (or added) before the first pulse , where <maths id="math0170"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup></math><img file="EP4375993A2_D0172.tif" /></maths> is defined as: <maths id="math0171" num="(75)"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup><mo>=</mo><msub><mi mathvariant="normal">Δ</mi><mn>0</mn></msub><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>=</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>−</mo><mi>a</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac></math><img file="EP4375993A2_D0173.tif" /></maths>
Furthermore, it may, e.g., be assumed that <maths id="math0172"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mi>p</mi></msubsup></math><img file="EP4375993A2_D0174.tif" /></maths> samples after the last pulse shall be removed (or added), where <maths id="math0173"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mi>p</mi></msubsup></math><img file="EP4375993A2_D0175.tif" /></maths> is defined as: <maths id="math0174" num="(76)"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mi>p</mi></msubsup><mo>=</mo><msub><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow></msub><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>=</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>+</mo><mi mathvariant="italic">ka</mi></mfenced><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac></math><img file="EP4375993A2_D0176.tif" /></maths>
The last two assumptions are in line with formula (74) taking the length of the partial first and last pitch cycles into account.
The number of samples to be removed (or added) in each pitch cycle is schematically presented in the example in <figref idref="f0015">Fig. 13</figref>, where <i>k</i> = 2. <figref idref="f0015">Fig. 13</figref> illustrates a schematic representation of samples removed in each pitch cycle. Regarding the embodiments described with reference to formulae (64) - (113), reference sign 1210 denotes |<i>s</i>|.
The total number of samples to be removed (or added), <i>s</i>, is related to Δ<i><sub>i</sub></i> according to: <maths id="math0175" num="(77)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><mo>=</mo><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup><mo>+</mo><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mi>p</mi></msubsup><mo>+</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>k</mi></munderover><msub><mi mathvariant="normal">Δ</mi><mi>i</mi></msub></mstyle></math><img file="EP4375993A2_D0177.tif" /></maths>
From formulae (74) - (77) it follows that: <maths id="math0176" num="(78)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><mo>=</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>−</mo><mi>a</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>+</mo><mi mathvariant="italic">ka</mi></mfenced><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>k</mi></munderover><mfenced><mi>Δ+</mi><mfenced><mi>i</mi><mo>−</mo><mn>1</mn></mfenced><mi>a</mi></mfenced></mstyle></math><img file="EP4375993A2_D0178.tif" /></maths>
Formula (78) is equivalent to: <maths id="math0177" num="(79)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><mo>=</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>−</mo><mi>a</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>+</mo><mi mathvariant="italic">ka</mi></mfenced><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mi>k</mi><mi mathvariant="normal">Δ</mi><mo>+</mo><mi>a</mi><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>k</mi></munderover><mfenced><mi>i</mi><mo>−</mo><mn>1</mn></mfenced></mstyle></math><img file="EP4375993A2_D0179.tif" /></maths>
Moreover, formula (79) is equivalent to: <maths id="math0178" num="(80)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><mo>=</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>−</mo><mi>a</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>+</mo><mi mathvariant="italic">ka</mi></mfenced><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mi>k</mi><mi mathvariant="normal">Δ</mi><mo>+</mo><mi>a</mi><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac></math><img file="EP4375993A2_D0180.tif" /></maths>
Furthermore, formula (80) is equivalent to: <maths id="math0179" num="(81)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><mo>=</mo><mi mathvariant="normal">Δ</mi><mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mi>k</mi></mfenced><mo>+</mo><mi>a</mi><mfenced><mi>k</mi><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>−</mo><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac></mfenced></math><img file="EP4375993A2_D0181.tif" /></maths>
Moreover, taking formula (16b) into account formula (81) is equivalent to: <maths id="math0180" num="(82)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><mo>=</mo><mi mathvariant="normal">Δ</mi><mfenced><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac></mfenced><mo>+</mo><mi>a</mi><mfenced><mi>k</mi><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>−</mo><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac></mfenced></math><img file="EP4375993A2_D0182.tif" /></maths>
According to embodiments, it may be assumed that the number of samples to be removed (or added) in the complete pitch cycle after the last pulse is given by: <maths id="math0181" num="(83)"><math display="block"><msub><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow></msub><mo>=</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><mi>p</mi><mfenced open="[" close="]"><mi>M</mi><mo>−</mo><mn>1</mn></mfenced></mfenced><mo>=</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced></math><img file="EP4375993A2_D0183.tif" /></maths>
From formula (74) and formula (83), it follows that: <maths id="math0182" num="(84)"><math display="block"><mi mathvariant="normal">Δ</mi><mo>=</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mo>−</mo><mi mathvariant="italic">ka</mi></math><img file="EP4375993A2_D0184.tif" /></maths>
From formula (82) and formula (84), it follows that: <maths id="math0183" num="(85)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><mo>=</mo><mfenced><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mo>−</mo><mi mathvariant="italic">ka</mi></mfenced><mfenced><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac></mfenced><mo>+</mo><mi>a</mi><mfenced><mi>k</mi><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>−</mo><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac></mfenced></math><img file="EP4375993A2_D0185.tif" /></maths>
Formula (85) is equivalent to: <maths id="math0184" num="(86)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><mo>=</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mfenced><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac></mfenced><mo>+</mo><mi>a</mi><mfenced><mo>−</mo><mi>k</mi><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mi>k</mi><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>−</mo><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac></mfenced></math><img file="EP4375993A2_D0186.tif" /></maths>
Moreover, formula (86) is equivalent to: <maths id="math0185" num="(87)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><mo>=</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mfenced><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac></mfenced><mo>+</mo><mi>a</mi><mfenced><mo>−</mo><mi>k</mi><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mi>k</mi></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>−</mo><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac></mfenced></math><img file="EP4375993A2_D0187.tif" /></maths>
Furthermore, formula (87) is equivalent to: <maths id="math0186" num="(88)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><msub><mi>T</mi><mi>r</mi></msub><mo>=</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mfenced><mi>L</mi><mo>−</mo><mi>s</mi></mfenced><mo>+</mo><mi>a</mi><mfenced><mo>−</mo><mi mathvariant="italic">kT</mi><mfenced open="[" close="]"><mi>k</mi></mfenced><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac><msub><mi>T</mi><mi>r</mi></msub></mfenced></math><img file="EP4375993A2_D0188.tif" /></maths>
From formula (16b) and formula (88), it follows that: <maths id="math0187" num="(89)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><msub><mi>T</mi><mi>r</mi></msub><mo>=</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mfenced><mi>L</mi><mo>−</mo><mi>s</mi></mfenced><mo>+</mo><mi>a</mi><mfenced><mo>−</mo><mi mathvariant="italic">kT</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>−</mo><msup><mi>k</mi><mn>2</mn></msup><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>−</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac><msub><mi>T</mi><mi>r</mi></msub></mfenced></math><img file="EP4375993A2_D0189.tif" /></maths>
Formula (89) is equivalent to: <maths id="math0188" num="(90)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><msub><mi>T</mi><mi>r</mi></msub><mo>=</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mfenced><mi>L</mi><mo>−</mo><mi>s</mi></mfenced><mo>+</mo><mi>a</mi><mfenced><mo>−</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>−</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac><msub><mi>T</mi><mi>r</mi></msub></mfenced></math><img file="EP4375993A2_D0190.tif" /></maths>
Moreover, formula (90) is equivalent to: <maths id="math0189" num="(91)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mfenced><mi>L</mi><mo>−</mo><mi>s</mi></mfenced><mo>=</mo><mi>a</mi><mfenced><mo>−</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>−</mo><mfrac><mrow><mi>k</mi><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced></mrow><mn>2</mn></mfrac><msub><mi>T</mi><mi>r</mi></msub></mfenced></math><img file="EP4375993A2_D0191.tif" /></maths>
Furthermore, formula (91) is equivalent to: <maths id="math0190" num="(92)"><math display="block"><mfenced open="|" close="|"><mi>s</mi></mfenced><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mfenced><mi>L</mi><mo>−</mo><mi>s</mi></mfenced><mo>=</mo><mo>−</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mi>a</mi><mfenced><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mfrac><mi>k</mi><mn>2</mn></mfrac><msub><mi>T</mi><mi>r</mi></msub></mfenced></math><img file="EP4375993A2_D0192.tif" /></maths>
Moreover, formula (92) is equivalent to: <maths id="math0191" num="(93)"><math display="block"><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mfenced><mi>L</mi><mo>−</mo><mi>s</mi></mfenced><mo>−</mo><mfenced open="|" close="|"><mi>s</mi></mfenced><msub><mi>T</mi><mi>r</mi></msub><mo>=</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mi>a</mi><mfenced><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mfrac><mi>k</mi><mn>2</mn></mfrac><msub><mi>T</mi><mi>r</mi></msub></mfenced></math><img file="EP4375993A2_D0193.tif" /></maths>
From formula (93), it follows that: <maths id="math0192" num="(94)"><math display="block"><mi>a</mi><mo>=</mo><mfrac><mrow><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mfenced><mi>L</mi><mo>−</mo><mi>s</mi></mfenced><mo>−</mo><mfenced open="|" close="|"><mi>s</mi></mfenced><msub><mi>T</mi><mi>r</mi></msub></mrow><mrow><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mfenced><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mfrac><mi>k</mi><mn>2</mn></mfrac><msub><mi>T</mi><mi>r</mi></msub></mfenced></mrow></mfrac></math><img file="EP4375993A2_D0194.tif" /></maths>
Thus, e.g., based on formula (94), according to embodiments: <ul id="ul0010" list-style="dash"><li>it is calculated how many samples are to be removed and/or added before the first pulse, and/or</li><li>it is calculated how many samples are to be removed and/or added between pulses and/or</li><li>it is calculated how many samples are to be removed and/or added after the last pulse.</li></ul>
According to some embodiments, the samples may, e.g., be removed or added in the minimum energy regions.
From formula (85) and formula (94) follows that: <maths id="math0193" num="(95)"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup><mo>=</mo><mfenced><mi mathvariant="normal">Δ</mi><mo>−</mo><mi>a</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>=</mo><mfenced><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mo>−</mo><mi mathvariant="italic">ka</mi><mo>−</mo><mi>a</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac></math><img file="EP4375993A2_D0195.tif" /></maths>
Formula (95) is equivalent to: <maths id="math0194" num="(96)"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup><mo>=</mo><mfenced><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mo>−</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mi>a</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac></math><img file="EP4375993A2_D0196.tif" /></maths>
Moreover, from formula (84) and formula (94), it follows that: <maths id="math0195" num="(97)"><math display="block"><msub><mi mathvariant="normal">Δ</mi><mi>i</mi></msub><mo>=</mo><mi mathvariant="normal">Δ</mi><mo>+</mo><mfenced><mi>i</mi><mo>−</mo><mn>1</mn></mfenced><mi>a</mi><mo>=</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mo>−</mo><mi mathvariant="italic">ka</mi><mo>+</mo><mfenced><mi>i</mi><mo>−</mo><mn>1</mn></mfenced><mi>a</mi><mo>,</mo><mn>1</mn><mo>≤</mo><mi>i</mi><mo>≤</mo><mi>k</mi></math><img file="EP4375993A2_D0197.tif" /></maths>
Formula (97) is equivalent to: <maths id="math0196" num="(98)"><math display="block"><msub><mi mathvariant="normal">Δ</mi><mi>i</mi></msub><mo>=</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mo>−</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn><mo>−</mo><mi>i</mi></mfenced><mi>a</mi><mo>,</mo><mn>1</mn><mo>≤</mo><mi>i</mi><mo>≤</mo><mi>k</mi></math><img file="EP4375993A2_D0198.tif" /></maths>
According to an embodiment, the number of samples to be removed after the last pulse can be calculated based on formula (97) according to: <maths id="math0197" num="(99)"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mi>p</mi></msubsup><mo>=</mo><mfenced open="|" close="|"><mi>s</mi></mfenced><mo>−</mo><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup><mo>−</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>k</mi></munderover><msub><mi mathvariant="normal">Δ</mi><mi>i</mi></msub></mstyle></math><img file="EP4375993A2_D0199.tif" /></maths>
It should be noted that according to embodiments, <maths id="math0198"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup></math><img file="EP4375993A2_D0200.tif" /></maths>, Δ<i><sub>i</sub></i> and <maths id="math0199"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mi>p</mi></msubsup></math><img file="EP4375993A2_D0201.tif" /></maths> are positive and that the sign of s determines if the samples are to be added or removed.
Due to complexity reasons, in some embodiments, it is desired to add or remove integer number of samples and thus, in such embodiments, <maths id="math0200"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup></math><img file="EP4375993A2_D0202.tif" /></maths>, Δ<i><sub>i</sub></i> and <maths id="math0201"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mi>p</mi></msubsup></math><img file="EP4375993A2_D0203.tif" /></maths> may, e.g., be rounded. In other embodiments, other concepts using waveform interpolation may, e.g., alternatively or additionally be used to avoid the rounding, but with the increased complexity.
In the following, an algorithm for pulse resynchronization according to embodiments is described with reference to formulae (100) - (113).
According to embodiments, input parameters of such an algorithm may, for example, be: <dl id="dl0002"><dt><i>L</i></dt><dd>- Frame length</dd><dt><i>M</i></dt><dd>- Numbe of subframes</dd><dt><i>T<sub>p</sub></i></dt><dd>- Pitch cycle length at the end of the last received frame</dd><dt><i>T<sub>ext</sub></i></dt><dd>- Pitch cycle length at the end of the concealed frame</dd><dt>src_exc</dt><dd>- Input excitation signal that was created copying the low pass filtered last pitch cycle of the excitation signal from the end of the last received frame as described above.</dd><dt>dst_exc</dt><dd>- Output excitation signal created from src_exc using the algorithm described here for the pulse resynchronization</dd></dl><ul id="ul0011" list-style="none" compact="compact"><li>According to embodiments, such an algorithm may comprise, one or more or all of the following steps: <ul id="ul0012" list-style="dash"><li>Calculate pitch change per subframe based on formula (65): <maths id="math0202" num="(100)"><math display="block"><mi>δ</mi><mo>=</mo><mfrac><mrow><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub><mo>−</mo><msub><mi>T</mi><mi>p</mi></msub></mrow><mi>M</mi></mfrac></math><img file="EP4375993A2_D0204.tif" /></maths></li><li>Calculate the rounded starting pitch based on formula (15b): <maths id="math0203" num="(101)"><math display="block"><msub><mi>T</mi><mi>r</mi></msub><mo>=</mo><mrow><mo>⌊</mo><mrow><msub><mi>T</mi><mi>p</mi></msub><mo>+</mo><mn>0.5</mn></mrow><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0205.tif" /></maths></li><li>Calculate number of samples to be added (to be removed if negative) based on formula (69): <maths id="math0204" num="(102)"><math display="block"><mi>s</mi><mo>=</mo><mi>δ</mi><mfrac><mi>L</mi><msub><mi>T</mi><mi>r</mi></msub></mfrac><mfrac><mrow><mi>M</mi><mo>+</mo><mn>1</mn></mrow><mn>2</mn></mfrac><mo>−</mo><mi>L</mi><mfenced><mn>1</mn><mo>−</mo><mfrac><msub><mi>T</mi><mi>p</mi></msub><msub><mi>T</mi><mi>r</mi></msub></mfrac></mfenced></math><img file="EP4375993A2_D0206.tif" /></maths></li><li>Find the location of the first maximum pulse <i>T</i>[0] among first <i>T<sub>r</sub></i> samples in the constructed periodic part of the excitation src_exc.</li><li>Get the index of the last pulse in the resynchronized frame dst_exc based on formula (73): <maths id="math0205" num="(103)"><math display="block"><mi>k</mi><mo>=</mo><mrow><mo>⌈</mo><mrow><mfrac><mrow><mi>L</mi><mo>−</mo><mi>s</mi><mo>−</mo><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac><mo>−</mo><mn>1</mn></mrow><mo>⌉</mo></mrow></math><img file="EP4375993A2_D0207.tif" /></maths></li><li>Calculate <i>a</i> - the delta of the samples to be added or removed between consecutive cycles based on formula (94): <maths id="math0206" num="(104)"><math display="block"><mi>a</mi><mo>=</mo><mfrac><mrow><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mfenced><mi>L</mi><mo>−</mo><mi>s</mi></mfenced><mo>−</mo><mfenced open="|" close="|"><mi>s</mi></mfenced><msub><mi>T</mi><mi>r</mi></msub></mrow><mrow><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mfenced><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced><mo>+</mo><mfrac><mi>k</mi><mn>2</mn></mfrac><msub><mi>T</mi><mi>r</mi></msub></mfenced></mrow></mfrac></math><img file="EP4375993A2_D0208.tif" /></maths></li><li>Calculate the number of samples to be added or removed before the first pulse based on formula (96): <maths id="math0207" num="(105)"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup><mo>=</mo><mfenced><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mo>−</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn></mfenced><mi>a</mi></mfenced><mfrac><mrow><mi>T</mi><mfenced open="[" close="]"><mn>0</mn></mfenced></mrow><msub><mi>T</mi><mi>r</mi></msub></mfrac></math><img file="EP4375993A2_D0209.tif" /></maths></li><li>Round down the number of samples to be added or removed before the first pulse and keep in memory the fractional part: <maths id="math0208" num="(106)"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mo>′</mo></msubsup><mo>=</mo><mrow><mo>⌊</mo><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0210.tif" /></maths><maths id="math0209" num="(107)"><math display="block"><mi>F</mi><mo>=</mo><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mi>p</mi></msubsup><mo>−</mo><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mo>′</mo></msubsup></math><img file="EP4375993A2_D0211.tif" /></maths></li><li>For each region between 2 pulses, calculate the number of samples to be added or removed based on formula (98): <maths id="math0210" num="(108)"><math display="block"><msub><mi mathvariant="normal">Δ</mi><mi>i</mi></msub><mo>=</mo><mfenced open="|" close="|"><msub><mi>T</mi><mi>r</mi></msub><mo>−</mo><msub><mi>T</mi><mi mathvariant="italic">ext</mi></msub></mfenced><mo>−</mo><mfenced><mi>k</mi><mo>+</mo><mn>1</mn><mo>−</mo><mi>i</mi></mfenced><mi>a</mi><mo>,</mo><mn>1</mn><mo>≤</mo><mi>i</mi><mo>≤</mo><mi>k</mi></math><img file="EP4375993A2_D0212.tif" /></maths></li><li>Round down the number of samples to be added or removed between 2 pulses, taking into account the remaining fractional part from the previous rounding: <maths id="math0211" num="(109)"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mi>i</mi><mo>′</mo></msubsup><mo>=</mo><mrow><mo>⌊</mo><mrow><msub><mi mathvariant="normal">Δ</mi><mi>i</mi></msub><mo>+</mo><mi>F</mi></mrow><mo>⌋</mo></mrow></math><img file="EP4375993A2_D0213.tif" /></maths><maths id="math0212" num="(110)"><math display="block"><mi>F</mi><mo>=</mo><msub><mi mathvariant="normal">Δ</mi><mi>i</mi></msub><mo>−</mo><msubsup><mi mathvariant="normal">Δ</mi><mi>i</mi><mo>′</mo></msubsup></math><img file="EP4375993A2_D0214.tif" /></maths></li><li>if due to the added F for some <i>i</i> it happens that <maths id="math0213"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mi>i</mi><mo>′</mo></msubsup><mo>></mo><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>i</mi><mo>−</mo><mn>1</mn></mrow><mo>′</mo></msubsup></math><img file="EP4375993A2_D0215.tif" /></maths>, swap the values for <maths id="math0214"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mi>i</mi><mo>′</mo></msubsup></math><img file="EP4375993A2_D0216.tif" /></maths> and <maths id="math0215"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>i</mi><mo>−</mo><mn>1</mn></mrow><mo>′</mo></msubsup></math><img file="EP4375993A2_D0217.tif" /></maths>.</li><li>Calculate the number of samples to be added or removed after the last pulse based on formula (99): <maths id="math0216" num="(111)"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mo>′</mo></msubsup><mo>=</mo><mfenced open="|" close="|"><mo>⌊</mo><mrow><mi>s</mi><mo>+</mo><mn>0.5</mn></mrow><mo>⌋</mo></mfenced><mo>−</mo><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>0</mn></mrow><mi>k</mi></munderover><msubsup><mi mathvariant="normal">Δ</mi><mi>i</mi><mo>′</mo></msubsup></mstyle></math><img file="EP4375993A2_D0218.tif" /></maths></li><li>Then, calculate the maximum number of samples to be added or removed among the minimum energy regions: <maths id="math0217" num="(112)"><math display="block"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">max</mi><mo>′</mo></msubsup><mo>=</mo><munder><mi>max</mi><mi>i</mi></munder><msubsup><mi mathvariant="normal">Δ</mi><mi>i</mi><mo>′</mo></msubsup><mo>=</mo><mrow><mo>{</mo><mtable><mtr><mtd><mrow><msubsup><mi mathvariant="normal">Δ</mi><mi>k</mi><mo>′</mo></msubsup><mo>,</mo><msubsup><mi mathvariant="normal">Δ</mi><mi>k</mi><mo>′</mo></msubsup><mo>≥</mo><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mo>′</mo></msubsup></mrow></mtd></mtr><mtr><mtd><mrow><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mo>′</mo></msubsup><mo>,</mo><msubsup><mi mathvariant="normal">Δ</mi><mi>k</mi><mo>′</mo></msubsup><mo><</mo><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mo>′</mo></msubsup></mrow></mtd></mtr></mtable></mrow></math><img file="EP4375993A2_D0219.tif" /></maths></li><li>Find the location of the minimum energy segment <i>P<sub>min</sub></i>[1] between the first two pulses in src_exc, that has <maths id="math0218"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mi mathvariant="italic">max</mi><mo>′</mo></msubsup></math><img file="EP4375993A2_D0220.tif" /></maths> length. For every consecutive minimum energy segment between two pulses, the position is calculated by: <maths id="math0219" num="(113)"><math display="block"><msub><mi>P</mi><mi mathvariant="italic">min</mi></msub><mfenced open="[" close="]"><mi>i</mi></mfenced><mo>=</mo><msub><mi>P</mi><mi mathvariant="italic">min</mi></msub><mfenced open="[" close="]"><mn>1</mn></mfenced><mo>+</mo><mfenced><mi>i</mi><mo>−</mo><mn>1</mn></mfenced><msub><mi>T</mi><mi>r</mi></msub><mo>,</mo><mspace width="1ex" /><mn>1</mn><mo><</mo><mi>i</mi><mo>≤</mo><mi>k</mi></math><img file="EP4375993A2_D0221.tif" /></maths></li><li>If <i>P<sub>min</sub></i>[1] > <i>T<sub>r</sub></i> then calculate the location of the minimum energy segment before the first pulse in src_exc using <i>P<sub>min</sub></i>[0] = <i>P<sub>min</sub></i>[1] - <i>T<sub>r</sub></i> . Otherwise find the location of the minimum energy segment <i>P<sub>min</sub></i>[0] before the first pulse in src_exc, that has <maths id="math0220"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mn>0</mn><mo>′</mo></msubsup></math><img file="EP4375993A2_D0222.tif" /></maths> length.</li><li>If <i>P<sub>min</sub></i>[1] + <i>kT<sub>r</sub></i> < <i>L</i> - <i>s</i> then calculate the location of the minimum energy segment after the last pulse in src_exc using <i>P<sub>min</sub></i>[<i>k</i> + 1] = <i>P<sub>min</sub></i>[1] + <i>kT<sub>r</sub> .</i> Otherwise find the location of the minimum energy segment <i>P<sub>min</sub></i>[<i>k</i> + 1] after the last pulse in src_exc, that has <maths id="math0221"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mrow><mi>k</mi><mo>+</mo><mn>1</mn></mrow><mo>′</mo></msubsup></math><img file="EP4375993A2_D0223.tif" /></maths> length.</li><li>If there will be just one pulse in the concealed excitation signal dst_exc, that is if <i>k</i> is equal to 0, limit the search for <i>P<sub>min</sub></i>[1] to <i>L - s. P<sub>min</sub></i>[1] then points to the location of the minimum energy segment after the last pulse in src_exc.</li><li>If <i>s</i> > 0 add <maths id="math0222"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mi>i</mi><mo>′</mo></msubsup></math><img file="EP4375993A2_D0224.tif" /></maths> samples at location <i>P<sub>min</sub></i>[<i>i</i>] for 0 ≤ <i>i</i> ≤ <i>k</i> + 1 to the signal src_exc and store it in dst_exc, otherwise if <i>s</i> < 0 remove <maths id="math0223"><math display="inline"><msubsup><mi mathvariant="normal">Δ</mi><mi>i</mi><mo>′</mo></msubsup></math><img file="EP4375993A2_D0225.tif" /></maths> samples at location <i>P<sub>min</sub></i>[<i>i</i>] for 0 ≤ <i>i</i> ≤ <i>k</i> + 1 from the signal src_exc and store it in dst_exc. There are <i>k</i> + 2 regions where the samples are added or removed.</li></ul></li></ul>
<figref idref="f0004">Fig. 2c</figref> illustrates a system for reconstructing a frame comprising a speech signal according to an embodiment. The system comprises an apparatus 100 for determining an estimated pitch lag according to one of the above-described embodiments, and an apparatus 200 for reconstructing the frame, wherein the apparatus for reconstructing the frame is configured to reconstruct the frame depending on the estimated pitch lag. The estimated pitch lag is a pitch lag of the speech signal.
In an embodiment, the reconstructed frame may, e.g., be associated with one or more available frames, said one or more available frames being at least one of one or more preceding frames of the reconstructed frame and one or more succeeding frames of the reconstructed frame, wherein the one or more available frames comprise one or more pitch cycles as one or more available pitch cycles. The apparatus 200 for reconstructing the frame may, e.g., be an apparatus for reconstructing a frame according to one of the above-described embodiments.
Although some aspects have been described in the context of an apparatus, it is clear that these aspects also represent a description of the corresponding method, where a block or device corresponds to a method step or a feature of a method step. Analogously, aspects described in the context of a method step also represent a description of a corresponding block or item or feature of a corresponding apparatus.
The inventive decomposed signal can be stored on a digital storage medium or can be transmitted on a transmission medium such as a wireless transmission medium or a wired transmission medium such as the Internet.
Depending on certain implementation requirements, embodiments of the invention can be implemented in hardware or in software. The implementation can be performed using a digital storage medium, for example a floppy disk, a DVD, a CD, a ROM, a PROM, an EPROM, an EEPROM or a FLASH memory, having electronically readable control signals stored thereon, which cooperate (or are capable of cooperating) with a programmable computer system such that the respective method is performed.
Some embodiments according to the invention comprise a non-transitory data carrier having electronically readable control signals, which are capable of cooperating with a programmable computer system, such that one of the methods described herein is performed.
Generally, embodiments of the present invention can be implemented as a computer program product with a program code, the program code being operative for performing one of the methods when the computer program product runs on a computer. The program code may for example be stored on a machine readable carrier.
Other embodiments comprise the computer program for performing one of the methods described herein, stored on a machine readable carrier.
In other words, an embodiment of the inventive method is, therefore, a computer program having a program code for performing one of the methods described herein, when the computer program runs on a computer.
A further embodiment of the inventive methods is, therefore, a data carrier (or a digital storage medium, or a computer-readable medium) comprising, recorded thereon, the computer program for performing one of the methods described herein.
A further embodiment of the inventive method is, therefore, a data stream or a sequence of signals representing the computer program for performing one of the methods described herein. The data stream or the sequence of signals may for example be configured to be transferred via a data communication connection, for example via the Internet.
A further embodiment comprises a processing means, for example a computer, or a programmable logic device, configured to or adapted to perform one of the methods described herein.
A further embodiment comprises a computer having installed thereon the computer program for performing one of the methods described herein.
In some embodiments, a programmable logic device (for example a field programmable gate array) may be used to perform some or all of the functionalities of the methods described herein. In some embodiments, a field programmable gate array may cooperate with a microprocessor in order to perform one of the methods described herein. Generally, the methods are preferably performed by any hardware apparatus.
The above described embodiments are merely illustrative for the principles of the present invention. It is understood that modifications and variations of the arrangements and the details described herein will be apparent to others skilled in the art. It is the intent, therefore, to be limited only by the scope of the impending patent claims and not by the specific details presented by way of description and explanation of the embodiments herein.
References
<ul id="ul0013" list-style="none"><li>[3GP09] 3GPP; <nplcit id="ncit0001" npl-type="s"><text>Technical Specification Group Services and System Aspects, Extended adaptive multi-rate - wideband (AMR-WB+) codec, 3GPP TS 26.290, 3rd Generation Partnership Project, 2009</text></nplcit>.</li><li>[3GP12a] , <nplcit id="ncit0002" npl-type="s"><text>Adaptive multi-rate (AMR) speech codec; error concealment of lost frames (release 11), 3GPP TS 26.091, 3rd Generation Partnership Project, Sep 2012</text></nplcit>.</li><li>[3GP12b] ,<nplcit id="ncit0003" npl-type="s"><text> Speech codec speech processing functions; adaptive multi-rate - wideband (AMRWB) speech codec; error concealment of erroneous or lost frames, 3GPP TS 26.191, 3rd Generation Partnership Project, Sep 2012</text></nplcit>.</li><li>[Gao] <patcit id="pcit0001" dnum="EP2002427B1"><text>Yang Gao, Pitch prediction for packet loss concealment, European Patent 2 002 427 B1</text></patcit>.</li><li>[ITU03] <nplcit id="ncit0004" npl-type="s"><text>ITU-T, Wideband coding of speech at around 16 kbit/s using adaptive multi-rate wideband (amr-wb), Recommendation ITU-T G.722.2, Telecommunication Standardization Sector of ITU, Jul 2003</text></nplcit>.</li><li>[ITU06a] , <nplcit id="ncit0005" npl-type="s"><text>G.722 Appendix III: A high-complexity algorithm for packet loss concealment for G.722, ITU-T Recommendation, ITU-T, Nov 2006.</text></nplcit></li><li>[ITU06b] ,<nplcit id="ncit0006" npl-type="s"><text> G.729.1: G.729-based embedded variable bit-rate coder: An 8-32 kbit/s scalable wideband coder bitstream interoperable with g.729, Recommendation ITU-T G.729.1, Telecommunication Standardization Sector of ITU, May 2006</text></nplcit>.</li><li>[ITU07] ,<nplcit id="ncit0007" npl-type="s"><text> G.722 Appendix IV: A low-complexity algorithm for packet loss concealment with G.722, ITU-T Recommendation, ITU-T, Aug 2007</text></nplcit>.</li><li>[ITU08a] , <nplcit id="ncit0008" npl-type="s"><text>G.718: Frame error robust narrow-band and wideband embedded variable bit-rate coding of speech and audio from 8-32 kbit/s, Recommendation ITU-T G.718, Telecommunication Standardization Sector of ITU, Jun 2008</text></nplcit>.</li><li>[ITU08b] , <nplcit id="ncit0009" npl-type="s"><text>G.719: Low-complexity, full-band audio coding for high-quality, conversational applications, Recommendation ITU-T G.719, Telecommunication Standardization Sector of ITU, Jun 2008</text></nplcit>.</li><li>[ITU12] , <nplcit id="ncit0010" npl-type="s"><text>G.729: Coding of speech at 8 kbit/s using conjugate-structure algebraic-code-excited linear prediction (cs-acelp), Recommendation ITU-T G.729, Telecommunication Standardization Sector of ITU, June 2012</text></nplcit>.</li><li>[MCZ11]<nplcit id="ncit0011" npl-type="s"><text> Xinwen Mu, Hexin Chen, and Yan Zhao, A frame erasure concealment method based on pitch and gain linear prediction for AMR-WB codec, Consumer Electronics (ICCE), 2011 IEEE International Conference on, Jan 2011, pp. 815-816</text></nplcit>.</li><li>[MTTA90] <nplcit id="ncit0012" npl-type="s"><text>J.S. Marques, I. Trancoso, J.M. Tribolet, and L.B. Almeida, Improved pitch prediction with fractional delays in celp coding, Acoustics, Speech, and Signal Processing, 1990. ICASSP-90., 1990 International Conference on, 1990, pp. 665-668 vol.2</text></nplcit>.</li><li>[VJGS12] <patcit id="pcit0002" dnum="US8255207B2"><text>Tommy Vaillancourt, Milan Jelinek, Philippe Gournay, and Redwan Salami, Method and device for efficient frame erasure concealment in speech codecs, US 8,255,207 B2, 2012</text></patcit>.</li></ul>
253 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46 Sheet 47 Sheet 48 Sheet 49 Sheet 50 Sheet 51 Sheet 52 Sheet 53 Sheet 54 Sheet 55 Sheet 56 Sheet 57 Sheet 58 Sheet 59 Sheet 60 Sheet 61 Sheet 62 Sheet 63 Sheet 64 Sheet 65 Sheet 66 Sheet 67 Sheet 68 Sheet 69 Sheet 70 Sheet 71 Sheet 72 Sheet 73 Sheet 74 Sheet 75 Sheet 76 Sheet 77 Sheet 78 Sheet 79 Sheet 80 Sheet 81 Sheet 82 Sheet 83 Sheet 84 Sheet 85 Sheet 86 Sheet 87 Sheet 88 Sheet 89 Sheet 90 Sheet 91 Sheet 92 Sheet 93 Sheet 94 Sheet 95 Sheet 96 Sheet 97 Sheet 98 Sheet 99 Sheet 100 Sheet 101 Sheet 102 Sheet 103 Sheet 104 Sheet 105 Sheet 106 Sheet 107 Sheet 108 Sheet 109 Sheet 110 Sheet 111 Sheet 112 Sheet 113 Sheet 114 Sheet 115 Sheet 116 Sheet 117 Sheet 118 Sheet 119 Sheet 120 Sheet 121 Sheet 122 Sheet 123 Sheet 124 Sheet 125 Sheet 126 Sheet 127 Sheet 128 Sheet 129 Sheet 130 Sheet 131 Sheet 132 Sheet 133 Sheet 134 Sheet 135 Sheet 136 Sheet 137 Sheet 138 Sheet 139 Sheet 140 Sheet 141 Sheet 142 Sheet 143 Sheet 144 Sheet 145 Sheet 146 Sheet 147 Sheet 148 Sheet 149 Sheet 150 Sheet 151 Sheet 152 Sheet 153 Sheet 154 Sheet 155 Sheet 156 Sheet 157 Sheet 158 Sheet 159 Sheet 160 Sheet 161 Sheet 162 Sheet 163 Sheet 164 Sheet 165 Sheet 166 Sheet 167 Sheet 168 Sheet 169 Sheet 170 Sheet 171 Sheet 172 Sheet 173 Sheet 174 Sheet 175 Sheet 176 Sheet 177 Sheet 178 Sheet 179 Sheet 180 Sheet 181 Sheet 182 Sheet 183 Sheet 184 Sheet 185 Sheet 186 Sheet 187 Sheet 188 Sheet 189 Sheet 190 Sheet 191 Sheet 192 Sheet 193 Sheet 194 Sheet 195 Sheet 196 Sheet 197 Sheet 198 Sheet 199 Sheet 200 Sheet 201 Sheet 202 Sheet 203 Sheet 204 Sheet 205 Sheet 206 Sheet 207 Sheet 208 Sheet 209 Sheet 210 Sheet 211 Sheet 212 Sheet 213 Sheet 214 Sheet 215 Sheet 216 Sheet 217 Sheet 218 Sheet 219 Sheet 220 Sheet 221 Sheet 222 Sheet 223 Sheet 224 Sheet 225 Sheet 226 Sheet 227 Sheet 228 Sheet 229 Sheet 230 Sheet 231 Sheet 232 Sheet 233 Sheet 234 Sheet 235 Sheet 236 Sheet 237 Sheet 238 Sheet 239 Sheet 240 Sheet 241 Sheet 242 Sheet 243 Sheet 244 Sheet 245 Sheet 246 Sheet 247 Sheet 248 Sheet 249 Sheet 250 Sheet 251 Sheet 252 Sheet 253
Every citation, both waysCites: the store holds 2 of 3
| Document | Relation | Office | Cited during |
|---|---|---|---|
| EP2002427B1 | Cites | European Patent Office (EPO) | Applicant |
| US8255207B2 | Cites | United States of America | Applicant |
| 3GPP: "Technical Specification Group Services and System Aspects, Extended adaptive multi-rate-wideband(AMR-WB+)codec", 3GPP TS 26.290, 3RD GENERATION, 2009 | Non-patent | – | Applicant |
| "Adaptive multi-rate (AMR) speech codec; error concealment of lost frames (release 11", 3GPP TS 26.091, 3RD GENERATION PARTNERSHIP PROJECT, September 2012 (2012-09-01) | Non-patent | – | Applicant |
| "Speech codec speech processing functions; adaptive multi-rate - wideband (AMRWB) speech codec; error concealment of erroneous or lost frames", 3GPP TS 26.191, 3RD GENERATION PARTNERSHIP PROJECT, September 2012 (2012-09-01) | Non-patent | – | Applicant |
| ITU-T: "Wideband coding of speech at around 16 kbit/s using adaptive multi-rate wideband (amr-wb), Recommendation ITU-T G.722.2", TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU, July 2003 (2003-07-01) | Non-patent | – | Applicant |
| "G.722 Appendix III: A high-complexity algorithm for packet loss concealment for G.722", ITU-T RECOMMENDATION, ITU-T, November 2006 (2006-11-01) | Non-patent | – | Applicant |
| "G.729.1: G.729-based embedded variable bit-rate coder: An 8-32 kbit/s scalable wideband coder bitstream interoperable with g.729, Recommendation ITU-T G.729.1", TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU, May 2006 (2006-05-01) | Non-patent | – | Applicant |
| "G.722 Appendix IV: A low-complexity algorithm for packet loss concealment with G.722", ITU-T RECOMMENDATION, ITU-T, August 2007 (2007-08-01) | Non-patent | – | Applicant |
| "G.718: Frame error robust narrow-band and wideband embedded variable bit-rate coding of speech and audio from 8-32 kbit/s, Recommendation ITU-T G.718", TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU, June 2008 (2008-06-01) | Non-patent | – | Applicant |
| "G.719: Low-complexity, full-band audio coding for high-quality, conversational applications, Recommendation ITU-T G.719", TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU, June 2008 (2008-06-01) | Non-patent | – | Applicant |
| G.729: CODING OF SPEECH AT 8 KBIT/S USING CONJUGATE-STRUCTURE ALGEBRAIC-CODE-EXCITED LINEAR PREDICTION (CS-ACELP), RECOMMENDATION : "G.729: Coding of speech at 8 kbit/s using conjugate-structure algebraic-code-excited linear prediction (cs-acelp), Recommendation ITU-T G.729", TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU, June 2012 (2012-06-01) | Non-patent | – | Applicant |
| XINWEN MUHEXIN CHENYAN ZHAO: "A frame erasure concealment method based on pitch and gain linear prediction for AMR-WB codec, Consumer Electronics (ICCE", 2011 IEEE INTERNATIONAL CONFERENCE, January 2011 (2011-01-01), pages 815 - 816 | Non-patent | – | Applicant |
| J.S. MARQUESI. TRANCOSOJ.M. TRIBOLETL.B. ALMEIDA: "Improved pitch prediction with fractional delays in celp coding, Acoustics, Speech, and Signal Processing, 1990. ICASSP-90", 1990 INTERNATIONAL CONFERENCE ON, vol. 2, 1990, pages 665 - 668 | Non-patent | – | Applicant |
92 members in 20 offices
Priority claims7
| Document | Office | Kind | Date |
|---|---|---|---|
| 13173157 | European Patent Office (EPO) | A | |
| 13173157 | European Patent Office (EPO) | – | |
| 14166990 | European Patent Office (EPO) | A | |
| 14166990 | European Patent Office (EPO) | – | |
| 14729939 | European Patent Office (EPO) | A | |
| 19172360 | European Patent Office (EPO) | A | |
| 2014062589 | European Patent Office (EPO) | W |
Members92
| Document | Office | Kind | |
|---|---|---|---|
| CA2915791A1 | Canada | A1 | |
| CA2915805A1 | Canada | A1 | |
| WO2014202535A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2014202539A1 | World Intellectual Property Organization (WIPO) | A1 | |
| TW201506909A | Taiwan Province of China | A | |
| TW201517020A | Taiwan Province of China | A | |
| AR096664A1 | Argentina | A1 | |
| AR096666A1 | Argentina | A1 | |
| SG11201510463WA | Singapore | A | |
| SG11201510506RA | Singapore | A | |
| AU2014283389A1 | Australia | A1 | |
| AU2014283393A1 | Australia | A1 | |
| KR20160022382A | Republic of Korea | A | |
| KR20160024952A | Republic of Korea | A | |
| CN105408954A | China | A | |
| CN105453173A | China | A | |
| MX2015017833A | Mexico | A | |
| US2016111094A1 | United States of America | A1 | |
| EP3011554A1 | European Patent Office (EPO) | A1 | |
| EP3011555A1 | European Patent Office (EPO) | A1 | |
| US2016118053A1 | United States of America | A1 | |
| MX2015017125A | Mexico | A | |
| JP2016523380A | Japan | A | |
| JP2016525220A | Japan | A | |
| JP6153661B2 | Japan | B2 | |
| BR112015031181A2 | Brazil | A2 | |
| BR112015031603A2 | Brazil | A2 | |
| BR112015031824A2 | Brazil | A2 | |
| RU2016101599A | Russian Federation | A | |
| RU2016101601A | Russian Federation | A | |
| HK1224426A | Hong Kong, China | A | |
| HK1224426A1 | Hong Kong, China | A1 | |
| HK1224427A | Hong Kong, China | A | |
| HK1224427A1 | Hong Kong, China | A1 | |
| AU2014283389B2 | Australia | B2 | |
| TWI604438B | Taiwan Province of China | B | |
| MX352092B | Mexico | B | |
| AU2018200208A1 | Australia | A1 | |
| TWI613642B | Taiwan Province of China | B | |
| KR101828186B1 | Republic of Korea | B1 | |
| EP3011555B1 | European Patent Office (EPO) | B1 | |
| TW201812743A | Taiwan Province of China | A | |
| KR20180042468A | Republic of Korea | A | |
| ES2671006T3 | Spain | T3 | |
| US10013988B2 | United States of America | B2 | |
| PT3011555T | Portugal | T | |
| TR2018008890T4 | Türkiye | T4 | |
| TR201808890T4 | Türkiye | T4 | |
| RU2665253C2 | Russian Federation | C2 | |
| RU2666327C2 | Russian Federation | C2 | |
| PL3011555T3 | Poland | T3 | |
| US2018293991A1 | United States of America | A1 | |
| CA2915791C | Canada | C | |
| JP6482540B2 | Japan | B2 | |
| JP2019066867A | Japan | A | |
| EP3011554B1 | European Patent Office (EPO) | B1 | |
| CN105453173B | China | B | |
| US10381011B2 | United States of America | B2 | |
| EP3540731A2 | European Patent Office (EPO) | A2 | |
| US2019304473A1 | United States of America | A1 | |
| PT3011554T | Portugal | T | |
| EP3540731A3 | European Patent Office (EPO) | A3 | |
| PL3011554T3 | Poland | T3 | |
| AU2018200208B2 | Australia | B2 | |
| MX371425B | Mexico | B | |
| ES2746322T3 | Spain | T3 | |
| CN110931025A | China | A | |
| US10643624B2 | United States of America | B2 | |
| KR102120073B1 | Republic of Korea | B1 | |
| CN105408954B | China | B | |
| MY177559A | Malaysia | A | |
| CN111862998A | China | A | |
| TWI711033B | Taiwan Province of China | B | |
| MY181845A | Malaysia | A | |
| JP2021103325A | Japan | A | |
| CA2915805C | Canada | C | |
| BR112015031603B1 | Brazil | B1 | |
| BR112015031824B1 | Brazil | B1 | |
| US11410663B2 | United States of America | B2 | |
| US2022343924A1 | United States of America | A1 | |
| JP7202161B2 | Japan | B2 | |
| JP2023072050A | Japan | A | |
| EP4375993A2This record | European Patent Office (EPO) | A2 | |
| CN110931025B | China | B | |
| EP3540731B1 | European Patent Office (EPO) | B1 | |
| EP3540731C0 | European Patent Office (EPO) | C0 | |
| EP4375993A3 | European Patent Office (EPO) | A3 | |
| PL3540731T3 | Poland | T3 | |
| ES2994065T3 | Spain | T3 | |
| JP7631393B2 | Japan | B2 | |
| CN111862998B | China | B | |
| US12315518B2 | United States of America | B2 |
15 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| First examination report despatched17Q | 17Q | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: EXAMINATION IS IN PROGRESSSTAA | STAA | |
| Request for examination filed17P | 17P | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: REQUEST FOR EXAMINATION WAS MADESTAA | STAA | |
| Designated contracting statesAK | AK | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | |
| Divisional application: reference to earlier applicationAC | AC | |
| Divisional application: reference to earlier applicationAC | AC | |
| Designated contracting statesAK | AK | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: THE APPLICATION HAS BEEN PUBLISHEDSTAA | STAA |
Numbers
- Publication
- 4375993
- Application
- 24167537
Titles3
- German
- VORRICHTUNG UND VERFAHREN ZUR VERBESSERTEN MASKIERUNG DES ADAPTIVEN CODEBUCHS BEI DER ACELP-ARTIGEN MASKIERUNG UNTER VERWENDUNG VERBESSERTER TONHÖHENVERZÖGERUNGSSCHÄTZUNG
- English
- APPARATUS AND METHOD FOR IMPROVED CONCEALMENT OF THE ADAPTIVE CODEBOOK IN ACELP-LIKE CONCEALMENT EMPLOYING IMPROVED PITCH LAG ESTIMATION
- French
- APPAREIL ET PROCÉDÉ POUR UNE DISSIMULATION AMÉLIORÉE DU LIVRE DE CODES ADAPTATIF DANS UNE DISSIMULATION DE TYPE ACELP UTILISANT UNE ESTIMATION DE DÉCALAGE DE HAUTEUR TONALE AMÉLIORÉE
Classification
- CPC, 8
- G10L19/005
- G10L19/107
- G10L19/08
- G10L25/90
- G10L19/125
- G10L2019/0002
- G10L2019/0003
- G10L2019/0008
- IPC, 4
- G10L19 005
- G10L25 90
- G10L19 107
- G10L19 08
Designated states1
- Contracting states, 1
- Türkiye