EP3707705B1

Audio decoder supporting a set of different loss concealment tools

Abstract

This record has no abstract on file.

EP3707705B1, drawing sheet 1
Sheet 1 of 26

Term

12.1 yearsleft in the term

Expires 5 November 2038.

  1. Priority
  2. Filed
  3. Granted
  4. Today
  5. Expires

19 claims: 9 independent, 10 dependent

  1. 1
    Audio decoder for decoding an audio signal (12) from a data stream (14), the audio decoder comprising a set (26) of different loss concealment tools (28) and configured to determine (40) a first measure (42) measuring a spectral position (48) of a spectral centroid of a spectrum (46) of the audio signal, determine (50) a second measure (52) measuring a temporal predictability of the audio signal, wherein the second measure is a measure for self-similarity or autocorrelation or is a long term prediction gain, assign (32) one (62) of the set (26) of different loss concealment tools (28) to a portion (22) of the audio signal (12) affected by loss based on the first and second measures, and recover the portion (22) of the audio signal using the one loss concealment tool (62) assigned to the portion (22), characterized in that the audio decoder is configured to, in assigning one of the set of different loss concealment tools to a portion (22) of the audio signal affected by loss based on the first and second measures, perform a summation over the first and second measures (42, 52) so as to obtain a scalar sum value and subjecting the scalar sum value to thresholding.
  2. 9
    Audio decoder of any of claims 3 to 8, wherein the audio decoder is configured to, in assigning the one of the set of different loss concealment tools to the portion of the audio signal based on the first and second measures, assign the first loss concealment tool to the portion the more likely the lower the spectral position of the spectral centroid is and the higher the temporal predictability is, and assign the second loss concealment tool to the portion the more likely the higher the spectral position of the spectral centroid is and the lower the temporal predictability is.
  3. 10
    Audio decoder any of the previous claims, configured to perform loss detection (36) to detect portions (22) affected by loss, perform the determination of the first and second measures (42;52) for the portion (22) responsive to the loss detection detecting the portion (22) affected by loss, and refrain from performing the determination for portions not affected by loss.
  4. 11
    Audio decoder of any of claims 1 to 10, further configured to determine (84) a tonality indicator (86) indicative of a tonality of the audio signal, assign one of first and second subsets (80, 82) of one or more loss concealment tools out of the set (26) of different loss concealment tools, which are mutually disjoint, to the portion (22) of the audio signal based on the tonality indicator (86), and perform the assignment of the one of the set of different loss concealment tools to the portion of the audio signal based on the first and second measures by assigning (60) the of the set of different loss concealment tools to the portion of the audio signal based on the first and second measures out of the first subset (80) of one or more loss concealment tools if the first subset (80) is assigned to the portion (22) with performing the recovery of the portion (22) of the audio signal using the one loss concealment tool (62) assigned to the portion (22), and perform the recovery of the portion (22) of the audio signal using one out of the second subset (82) of the loss concealment tools if the second subset (82) of the loss concealment tools is assigned to the portion.
  5. 14
    Audio decoder of any of claims 11 to 13, wherein the set (26) of different loss concealment tools comprises a first loss concealment tool (PLC#1) for audio signal recovery by audio signal synthesis using a periodic signal of a periodicity which depends on a pitch value derived from the data stream, and a second loss concealment tool (PLC#2) for audio signal recovery by detecting tonal spectral components of the audio signal, performing phase detection at the tonal spectral components and audio signal synthesis by combining the signals of periodicities which depend on the tonal spectral components with adjusting a mutual phase shift between the signals depending on the phase detection, and a third loss concealment tool (PLC#3) for audio signal recovery by use of frame repetition, with or without replicate modification, wherein the third loss concealment tool is included in the second subset (82) and the second and the first and second loss concealment tools are included in the first subset (80).
  6. 15
    Audio decoder of any of the previous claims, configured to determine (40) the first measure (42) by a weighted sum of spectral component location values, each weighted using the spectrum of the audio signal at the respective spectral component location value.
  7. 16
    Audio decoder of any of the previous claims, configured to determine (50) the second measure (52) by a correlation measure measuring a self-similarity of the audio signal.
  8. 17
    Audio decoder of any of the previous claims, configured to determine (50) the second measure (52) by deriving a pitch from the audio signal and determining the second measure as a correlation measure measuring an autocorrelation of the audio signal at a temporal shift (s) which depends on the pitch.
  9. 18
    Method for performing loss concealment in audio decoding an audio signal (12) from a data stream (14), the method comprising determine (40) a first measure (42) measuring a spectral position (48) of a spectral centroid of a spectrum (46) of the audio signal, determine (50) a second measure (52) measuring a temporal predictability of the audio signal, wherein the second measure is a measure for self-similarity or autocorrelation or is a long term prediction gain, assign (32) one (62) of a set (26) of different loss concealment tools (28) to a portion (22) of the audio signal (12) affected by loss based on the first and second measures, and recover the portion (22) of the audio signal using the one loss concealment tool (62) assigned to the portion (22), characterized in that the assigning one of the set of different loss concealment tools to a portion (22) of the audio signal affected by loss based on the first and second measures, comprises performing a summation over the first and second measures (42, 52) so as to obtain a scalar sum value and subjecting the scalar sum value to thresholding.