Decoding an encoded audio signal using drc profiles
3 claims: 2 independent, 1 dependent
- 1一つまたは複数のプロセッサを有する装置によって実行される、インターフェースを介して前記装置によって受領された エンコードされたオーディオ信号をデコードする方法であって、前記エンコードされたオーディオ信号は、エンコードされたオーディオ・データおよびメタデータを含むフレームのシーケンスを有し、前記メタデータはダイナミックレンジ制御(DRC)利得の複数の異なる集合を含み、前記エンコードされたオーディオ信号は、前記オーディオ信号のラウドネスの指標と、前記フレームのシーケンスの一つまたは複数のフレームにおけるDRC構成メタデータとをさらに含み、前記DRC構成メタデータは、前記エンコードされたオーディオ信号に関連付けられた複数のDRCプロファイルと、各DRCプロファイルについて、そのDRCプロファイルが適用可能な出力参照レベルの範囲とを示し、DRC利得の各集合が前記複数のDRCプロファイルのうちの一つに対応し、当該方法は、・デコードされたオーディオ信号のための所望される出力参照レベルを設定する段階と;・前記DRCプロファイルのうちの、前記適用可能な出力参照レベルの範囲がデコードされたオーディオ信号のための前記所望される出力参照レベルを含む一つまたは複数のDRCプロファイルを識別する段階と;・前記識別されたDRCプロファイルのうちの一つを選択する段階と;・前記エンコードされたオーディオ信号をデコードする段階と;・デコードされたオーディオ信号に選択されたDRCプロファイルに対応するDRC利得を適用することによって、デコードされたオーディオ信号のダイナミックレンジを調整する段階と;・前記オーディオ信号のラウドネスの指標およびデコードされたオーディオ信号のための前記所望される出力参照レベルに応答して、ラウドネス関係利得を決定する段階と;・前記調整されたデコードされたオーディオ信号に前記ラウドネス関係利得を適用して、前記所望される出力参照レベルをもつラウドネス調整されたデコードされたオーディオ信号を得る段階とを含む、方法。
- 2エンコードされたオーディオ信号をデコードするデコーダであって、前記エンコードされたオーディオ信号は、エンコードされたオーディオ・データおよびメタデータを含むフレームのシーケンスを有し、前記メタデータはダイナミックレンジ制御(DRC)利得の複数の異なる集合を含み、前記エンコードされたオーディオ信号は、前記オーディオ信号のラウドネスの指標と、前記フレームのシーケンスの一つまたは複数のフレームにおけるDRC構成メタデータとをさらに含み、前記DRC構成メタデータは、前記エンコードされたオーディオ信号に関連付けられた複数のDRCプロファイルと、各DRCプロファイルについて、そのDRCプロファイルが適用可能な出力参照レベルの範囲とを示し、DRC利得の各集合が前記複数のDRCプロファイルのうちの一つに対応し、当該デコーダは、・デコードされたオーディオ信号のための所望される出力参照レベルを設定する段階と;・前記DRCプロファイルのうちの、前記適用可能な出力参照レベルの範囲がデコードされたオーディオ信号のための前記所望される出力参照レベルを含む一つまたは複数のDRCプロファイルを識別する段階と;・前記識別されたDRCプロファイルのうちの一つを選択する段階と;・前記エンコードされたオーディオ信号をデコードする段階と;・デコードされたオーディオ信号に選択されたDRCプロファイルに対応するDRC利得を適用することによって、デコードされたオーディオ信号のダイナミックレンジを調整する段階と;・前記オーディオ信号のラウドネスの指標およびデコードされたオーディオ信号のための前記所望される出力参照レベルに応答して、ラウドネス関係利得を決定する段階と;・前記調整されたデコードされたオーディオ信号に前記ラウドネス関係利得を適用して、前記所望される出力参照レベルをもつラウドネス調整されたデコードされたオーディオ信号を得る段階とを実行する一つまたは複数のプロセッサを有する、デコーダ。
- 3命令のシーケンスを有する非一時的なコンピュータ可読記憶媒体であって、前記命令のシーケンスは、オーディオ信号処理装置によって実行されると、前記オーディオ信号処理装置に請求項1記載の方法を実行させるものである、コンピュータ可読記憶媒体。
Independent claims3
94 paragraphs, as filed
Cross-reference to related applications This application claims the priority of US Provisional Patent Application No. 62 / 058,228 filed on October 1, 2014. The content of the application is incorporated herein by reference in its entirety.
Technical Field This paper deals with audio signal processing. In particular, this article relates to methods and corresponding systems for transmitting Dynamic Range Control (DRC) profiles in a bandwidth-efficient manner.
The growing popularity of media consumer devices has created new opportunities and challenges for creators and distributors of media content for playback on such devices, as well as for designers and manufacturers of such devices. Many consumer devices can play a wide range of media content types and formats, including those often associated with high quality, wide bandwidth and wide dynamic range audio content for HDTV, Blu-ray or DVD. .. Media processors can be used to play this type of audio content on their own internal acoustic transducers or on external transducers such as headphones or high quality home theater systems. However, all of these playback systems and environments are dynamic for audio signals due to the various noise levels in the environment or due to the limited capabilities of the playback system to reproduce the required sound pressure level without distortion. It imposes significantly different requirements on the range. Environment-dependent limiting dynamic range is to provide high quality and comprehension across a wide range of different rendering devices with different rendering capabilities and listening environments, i.e. across a wide range of rendering modes. It's an approach.
<p> This article addresses the technical challenges of media content creators and distributors with a wide range of different rendering devices with different rendering capabilities, with high bandwidth efficiency to enable playback of audio signals with high quality and comprehension. Deal with it by means.</p>
<p> According to one aspect, a method for producing an encoded audio signal is described. The encoded audio signal has a sequence of frames. The encoded audio signal shows a number of different Dynamic Range Control (DRC) profiles for a number of corresponding different rendering modes. In this method, different subsets of DRC profiles from the plurality of DRC profiles are inserted into different frames of the sequence of frames, and two or more frames of the sequence of frames are combined to form the plurality of DRC profiles. Including to include.</p><p> According to one additional aspect, a method of decoding an encoded audio signal is described. The encoded audio signal has a sequence of frames. In addition, the encoded audio signal exhibits multiple different Dynamic Range Control (DRC) profiles for the corresponding different rendering modes. Different subsets of the DRC profile from the plurality of DRC profiles are contained within different frames of the sequence of frames, and two or more frames of the sequence of frames congruently include the plurality of DRC profiles. .. The method determines the first rendering mode from the plurality of different rendering modes and determines one or more DRC profiles from a subset of the DRC profiles contained within the current frame of said sequence of frames. Including doing. Further, the method includes determining whether at least one of the one or more DRC profiles is applicable to the first rendering mode. Further, the method includes selecting the default DRC profile as the current DRC profile if none of the one or more DRC profiles are applicable to the first rendering mode. Here, the definition data of the default DRC profile is known in the decoder for decoding the encoded audio signal. In addition, the method now involves decoding the current frame using the DRC profile.</p><p> According to a further aspect, a bitstream containing the encoded audio signal is described. The encoded audio signal has a sequence of frames. The encoded audio signal shows a number of different Dynamic Range Control (DRC) profiles for a number of corresponding different rendering modes. The different subsets of DRC profiles from the plurality of DRC profiles are contained within different frames of the sequence of frames, and two or more frames of the sequence of frames are combined to form the plurality of DRC profiles. include.</p><p> According to another aspect, an encoder for producing an encoded audio signal is described. The encoded audio signal has a sequence of frames. The encoded audio signal shows a number of different Dynamic Range Control (DRC) profiles for a number of corresponding different rendering modes. The encoder is configured to insert different subsets of the DRC profile from the plurality of DRC profiles into different frames of the sequence of frames, and two or more frames of the sequence of frames are combined to form the plurality of DRCs. Include a profile.</p><p> According to one further aspect, a decoder is described that decodes the encoded audio signal. The encoded audio signal has a sequence of frames. The encoded audio signal shows a number of different Dynamic Range Control (DRC) profiles for a number of corresponding different rendering modes. The different subsets of the DRC profile from the plurality of DRC profiles are contained within different frames of the sequence of frames, and two or more frames of the sequence of frames are combined to form the plurality of DRC profiles. include. The decoder determines the first rendering mode from the plurality of different rendering modes and determines one or more DRC profiles from a subset of the DRC profiles contained within the current frame of the sequence of frames. Then, it is determined whether at least one of the one or more DRC profiles is applicable to the first rendering mode, and any one of the one or more DRC profiles is said to be the first. The default DRC profile is currently configured to be selected as the DRC profile if it is not applicable to the rendering mode of. Here, the definition data of the default DRC profile is known in the decoder. The decoder is further configured to decode the current frame using the current DRC profile.</p><p> According to one further aspect, software programs are written. The software program may be adapted for execution on a processor and for performing the method steps outlined in this article when executed on a processor.</p><p> According to another aspect, the storage medium is described. The storage medium may have software programs adapted for execution on the processor and for performing the method steps outlined in this article when executed on the processor.</p><p> According to one further aspect, a computer program product is described. A computer program may have executable instructions to perform the method steps outlined in this article when executed on a computer.</p><p> It should be noted that the methods and systems including the preferred embodiments outlined in this patent application may be used alone or in combination with other methods and systems disclosed herein. Moreover, all aspects of the methods and systems outlined in this patent application may be optionally combined. In particular, the features of the claims may be combined with each other in any way.</p>
The present invention will be described below in an exemplary manner with reference to the accompanying drawings.<figref num="1">It is a figure which shows an exemplary audio decoder.</figref><figref num="2">It is a figure which shows an exemplary audio encoder.</figref><figref num="3">It is a figure which shows an exemplary dynamic range compression curve.</figref><figref num="4">It is a figure which shows an exemplary dynamic range compression curve.</figref><figref num="5">It is a figure which shows the sequence of an exemplary frame.</figref><figref num="6a">The first half of the flowchart of an exemplary method for selecting a DRC profile.</figref><figref num="6b">The second half of the flowchart of an exemplary method for selecting a DRC profile.</figref>
As mentioned above, this article addresses the technical challenge of allowing audio content designers and / or distributors to control the quality and comprehension of audio content for various types of rendering modes. An exemplary rendering mode is a home theater rendering mode. Here, the audio content is typically played using a transducer that allows a very wide dynamic range in a quiet environment. Another exemplary rendering mode is the flat panel mode. Here, the audio content is typically played using a transducer in a TV set, which allows a reduced dynamic range compared to a home theater. A further exemplary rendering mode is the portable speaker mode. Here, the audio content is played using the speakers of a portable electronic device (such as a smartphone). The dynamic range of this rendering mode is typically smaller than that of the rendering modes described above, and the environment is often noisy. Another exemplary rendering mode is the portable headphone mode. Here, the audio content is played using headphones associated with portable electronics. The dynamic range is limited, but typically higher than the dynamic range provided by loudspeakers in portable electronics.
Different DRC (Dynamic Range Control) profiles for different rendering modes may be provided with the audio content to allow high quality and high comprehension for different rendering modes. Audio content may be transmitted in a sequence of frames. The sequence of frames may include I (ie, independent) frames that can be decoded independently of the preceding or subsequent frames. In addition, the sequence of frames may typically include other types of frames (eg, P and / or B frames) that indicate dependencies on preceding and / or subsequent frames. At least some of the frames in the sequence may contain different DRC profiles for different rendering modes. In particular, the I-frame of the sequence of frames may include the plurality of DRC profiles.
Inserting multiple different DRC profiles into the sequence of audio frames allows the audio decoder to select the appropriate DRC profile for a particular rendering mode. As a result, it can be ensured that the audio signal to be reddered has high quality (especially without clipping or distortion introduced by the transducer) and high comprehension.
The following describes various aspects of dynamic range control. Without customized dynamic range control, input audio information (eg, PCM samples, time-frequency samples in a QMF matrix, etc.) is often used in a playback device for the playback device's specific playback environment (ie, the device's physical and device). Reproduced at a loudness level that is not appropriate for / or including mechanical regeneration limits). This is because the particular playback environment of the playback device can differ from the target playback environment in which the encoded audio content is encoded in the encoding device.
The techniques described in this article are customized to any of a wide variety of playback environments, while maintaining the perceptual quality of the audio content and the artist's intent to adapt the content to different playback environments. Can be used to support dynamic range control of a wide variety of audio content.
Dynamic Range Control (DRC) modifies the signal (eg, compresses, cuts, decompresses, etc.) to convert the loudness level input dynamic range in audio content to an output dynamic range that is different from the input dynamic range. A level-dependent audio processing operation that changes over time (such as boosting). For example, in a dynamic range control scenario, quiet sounds may be mapped to higher loudness levels (eg boosted) and loud sounds may be mapped to lower loudness values (eg cut). As a result, in the loudness region, the loudness level output range is smaller than the loudness level input range in this example. However, in some embodiments, the dynamic range control may be reversible so that the original range can be restored. For example, the mapped loudness level in the output dynamic range mapped from the original loudness level is less than or equal to the clipping level, and each unique original loudness level is mapped to a unique output loudness level. As long as it is done, the decompression operation can be performed to restore the original range.
The DRC techniques described in this article can be used to provide a better listening experience in certain playback environments or situations. For example, a quiet sound in a noisy environment can be masked by noise that makes the quiet sound inaudible. Conversely, in some situations, such as annoying neighbors (eg, in "midnight" listening mode), loud sounds may not be desired. Many devices, typically with small Scherrer speakers, are unable to reproduce sound at high output levels or without perceptible distortion. In some cases, lower signal levels can be reproduced below the human auditory threshold. The DRC technique outputs the input loudness level based on the DRC gain found using the dynamic range compression curve (for example, scaling factors such as scaling the audio amplitude, boosting the ratio, cutting the ratio, etc.). May perform mapping to loudness level.
A dynamic range compression curve is an output loudness level that determines an individual input loudness level (such as a non-dialogous sound) from an individual audio data frame, and thus the input loudness. A function that maps to individual gains (s) for dynamic range control to convert a level to its corresponding output loudness level (eg, lookup table, curve, multi-segment segmented straight line). .. Each of the individual gains indicates the amount of gain that should be applied to the signal to map the corresponding individual input loudness level to the intended output loudness level. The output loudness level after applying the individual gains represents the target loudness level for the audio content in the individual audio data frames in a particular playback environment.
In addition to specifying the mapping between gain and loudness level, the dynamic range compression curve may or provides specific release and attack times in applying a specific gain. May be done. Attack refers to an increase in signal energy (or loudness) between successive time samples. Release, on the other hand, refers to a decrease in energy (or loudness) between successive time samples. The attack time (eg 10 ms, 20 ms, etc.) is the time constant used to smooth the DRC gain when the corresponding signal is in attack mode. Release time (eg 80 ms, 100 ms, etc.) is the time constant used to smooth the DRC gain when the corresponding signal is in release mode. In some embodiments, additional, optional or alternative, these time constants are used for signal energy (or loudness) smoothing prior to determining the DRC gain.
Different dynamic range compression curves may correspond to different playback environments (ie different rendering modes). For example, the dynamic range compression curve for the playback environment of a flat panel TV may be different from the dynamic range compression curve for the playback environment of a portable device. For example, what is the first dynamic range compression curve for the first playback environment of a portable device with speakers and the second dynamic range compression curve for the second playback environment of the same portable device with a headset? It may be different.
FIG. 1 shows a block diagram of an exemplary component of the audio decoder 100. The audio decoder 100 includes a data extractor 104, a dynamic range controller 106 and an audio renderer 108. The data extractor 104 is configured to receive the encoded input signal 102. The encoded input signal 102 described herein is a bitstream containing encoded (eg, compressed) input audio data frames (particularly a sequence of audio frames) and possibly metadata. May be good. The bitstream may be an AC-4 bitstream. The data extractor 104 is configured to extract / decode input audio data frames and metadata from the encoded input signal 102. Each input audio data frame has a plurality of encoded audio data blocks, each representing a plurality of audio samples. Each frame represents a (eg, constant) time interval that contains a certain number of audio samples. The frame size can vary with the sample rate and the coded data rate. Audio samples are quantized audio data elements that represent spectral content in one, two or more (audio) frequency bands or frequency ranges (eg, input PCM samples, input time-frequency samples in a QMF matrix). Etc.). The quantized audio data element in the input audio data frame can represent a sound pressure wave in the digital (quantized) domain. The quantized audio data element may cover a finite range of loudness levels below the maximum possible value (eg clipping level, maximum loudness level, etc.).
The metadata can be used by the audio decoder 100 to process the input audio data frame. Metadata includes various motion parameters related to one or more actions to be performed by the decoder 100, one or more dynamic range compression curves (ie, one or more DRC profiles), input audio data. It may include normalization parameters related to the dialog loudness level represented in the frame. Dialog loudness level is the whole program (eg movie, TV program, radio broadcast, etc.), part of the program, program dialog, etc., such as dialog loudness, program loudness, average dialog loudness (eg acoustic). It can refer to any psychological or perceptual level.
Even if some or all of the behavior and functionality of the decoder 100 or its modules (eg, data extractor 104, dynamic range controller 106, etc.) is adapted in response to the metadata extracted from the encoded input signal 102. good. For example, metadataincluding, but not limited to, dynamic range compression curves, dialog loudness levels, etc.is output by the decoder 100 in the digital domain for output audio data elements (eg, output PCM samples, output time-frequency in the QMF matrix). It may be used to generate a sample, etc.). The output data element can then be used to drive an audio channel or speaker to achieve a specified loudness or reference playback level during playback in a particular playback environment.
The dynamic range controller 106 receives some or all of the audio data elements and metadata in the input audio data frame and is at least partially based on the metadata extracted from the encoded audio signal 102. It may be configured to perform audio processing operations (eg, dynamic range control operations, gain smoothing operations, gain limiting operations, etc.) on audio data elements in the input audio data frame. ..
In particular, the dynamic range controller 106 may include a selector 110, a loudness calculator 112, and a DRC gain unit 114. The selector 110 is a speaker configuration related to a specific playback environment in the decoder 100 (for example, home theater mode, flat panel mode, portable device mode with speakers, portable device mode with headphones, 5.1 speaker configuration mode, etc. 7.1 Speaker configuration mode, etc.) may be configured to determine. Further, the selector 110 selects a specific dynamic range compression curve (that is, a DRC profile) from various dynamic range compression curves extracted from the metadata of the encoded input signal 102 (that is, from the plurality of DRC profiles). It may be configured to do so.
The loudness calculator 112 may be configured to calculate the loudness level of one or more types represented by the audio data elements in the input audio data frame. Examples of loudness level types are not limited to this, but are limited to individual loudness levels across individual frequency bands across individual channels over individual time intervals, and broadband over a wide (or wide) frequency range across individual channels. (Or wideband) Loudness level, determined from an audio data block or frame or smoothed over an audio data block or frame Loudness level, from two or more audio data blocks or frames Includes any loudness level that is determined or smoothed over two or more audio data blocks or frames, such as a loudness level that is smoothed over one or more time intervals. Zero, one or more of these loudness levels may be modified by the decoder 100 for dynamic range control.
To determine the loudness level, the loudness calculator 112 is one such as the spatial and / or local pressure level at a particular audio frequency represented by the audio data elements in the input audio data frame. One or more time-dependent physical sonic attributes can be determined. The loudness calculator 112 uses the one or more times to derive one or more types of loudness levels based on one or more psychoacoustic functions that model human loudness perception. You can use changing physical wave attributes. Psychoacoustics functions are constructed on the basis of a model of the human auditory system-a non-linear function that transforms / maps a particular spatial pressure level at a particular audio frequency to a particular loudness for that particular audio frequency. -It may be.
Loudness levels across multiple (audio) frequencies or multiple frequency bands (eg, broadband, wideband, etc.) may be derived through the integration of specific loudness levels across multiple (audio) frequencies or multiple frequency bands. .. Time averaging, smoothed loudness levels, etc. over one or more time intervals (eg, longer than represented by audio data elements in an audio data block or frame) are the audio processing in the decoder 100. It may be obtained using one or more smoothing filters implemented as part of the operation. Another exemplary method for determining (broadband) loudness levels is specified in ITU-R BS.1770. The method specified in ITU-R BS.1770 applies time domain filtering to the time domain input audio signal and then calculates the RMS (root mean square) level for each channel of the input audio signal. The resulting loudness level is then integrated and gated across the channels.
Specific loudness levels for different frequency bands may be calculated for each audio data block of a sample (eg 256). Prefix filters to apply frequency weighting (eg, similar to IEC B weighting) to specific loudness levels in integrating specific loudness levels to broadband (or broadband) loudness levels. May be used. The sum of wide loudness levels across two or more channels (eg, front left, front right, center, left surround, right surround, etc.) to provide the overall loudness level for the two or more channels. It may be executed.
The overall loudness level may refer to the broadband loudness level in a single channel (for example, the center) of a speaker configuration. The overall loudness level may refer to the broadband (or broadband) loudness level in multiple channels. The plurality of channels may be all channels in a speaker configuration (ie, for a rendering mode). Additional, optional or alternative, the plurality of channels are a subset of channels in a speaker configuration (eg, a subset of channels including left anterior, right anterior and low frequency effects (LFE), left surround and right. It may include a subset of channels that include surround; a subset of channels that include the center, etc.).
The loudness level (eg broadband, broadband, global, specific) is for finding the corresponding DRC gain (eg static, pre-smoothing, pre-limit, etc.) from the selected dynamic range compression curve. It may be used as an input. The loudness level used as the input to find the DRC gain is first adjusted or adjusted with respect to the dialog loudness level from the metadata extracted from the encoded audio signal 102 and / or the output reference level in rendering mode. It may be normalized. Adjustments and normalizations related to dialog loudness level / output reference level are such that the specific spatial pressure level represented in some part of the audio content in the encoded audio signal 102 is the encoded audio signal. Performed on that portion of the audio signal within the encoded audio signal 102 in a non-loudness region (eg, SPL region) before being converted to a specific loudness level for that portion of the audio content in 102. You may.
The DRC gain unit 114 is configured with a DRC algorithm to generate a gain (for example, for dynamic range control, gain limiting, gain smoothing, etc.) and to apply that gain in the input audio data frame. It is configured to apply to one or more loudness levels in one or more types of loudness levels represented by audio data elements to achieve the target loudness level for that particular playback environment. You may. The application of gains as described in this paper (eg DRC gains) may occur in the loudness region. As an example, the gain is generated based on a loudness calculation (which may be represented by a thorn or simply an SPL compensated for the dialog loudness level without conversion), smoothed, and directly on the input signal. May be applied. Techniques such as those described in this article apply a gain to a signal in the loudness region, then convert the signal from the loudness region to the original (linear) SPL region, and then apply the gain to the signal in the loudness region. By evaluating the signal before and after, the corresponding gain to be applied to the signal may be calculated. The ratio (or difference when expressed in log-dB representation) then determines the corresponding gain for that signal.
The DRC algorithm may work with multiple DRC parameters. The DRC parameters have already been calculated and embedded in the encoded audio signal 102 by the upstream encoder 150 (eg, described in the context of FIG. 2) and in the encoded audio signal 102 by the decoder 100. Contains the dialog loudness level that can be obtained from the metadata of. The dialog loudness level from the upstream encoder 150 indicates the average dialog loudness level (eg, per program, for full-scale 1kHz sine wave energy, for reference square wave energy, etc.). Dialog loudness levels extracted from the encoded audio signal 102 may be used to reduce loudness level differences between programs. The reference dialog loudness level may be set to the same value between different programs in the same particular playback environment in the decoder 100. The output dialog loudness level (or output reference level) averaged across multiple audio data blocks of a program is a preconfigured, system default, user-configurable profile for that program. Based on the dialog loudness level from the metadata so that it can be raised / lowered to the reference dialog loudness level (such as dependency), the DRC gain unit 114 provides the dialog loudness related gain to each audio in the program. It can be applied to data blocks. Dialog loudness levels may be used to calibrate the DRC algorithm. In particular, the null band of the DRC algorithm may be adjusted to the dialog loudness level. Alternatively, when the DRC algorithm is applied to the signal to which the gain has been applied to change the dialog loudness level to be equal to the desired output reference level. The desired output reference level may be used to calibrate the DRC algorithm. The dialog loudness level may correspond to the so-called dialnorm parameter. This is the case when speech gating is applied to determine the dialnorm parameter. In some embodiments, the dialog loudness level corresponds to a dialnorm parameter determined by gating based on the loudness level threshold rather than by using speech gating.
The DRC gain may be used to address differences in loudness levels within a program by boosting or cutting signal portions in soft and / or loud sounds according to a selected dynamic range compression curve. One or more of these DRC gains are selected dynamic range compression curves and (eg broadband, broadband, overall) determined from one or more of the corresponding audio data blocks, audio data frames, etc. , Specific) may be calculated / determined by the DRC algorithm based on the loudness level.
The loudness level used to determine the DRC gain (eg, static, before smoothing, before gain limiting, etc.) by searching the selected dynamic range compression curve is a short interval (eg, about). May be calculated on 5.3 milliseconds, etc.). The integration time of the human auditory system (for example, about 200 milliseconds) can be much longer. The DRC gain obtained from the selected dynamic range compression curve may be smoothed with a time constant to take into account the long integration times of the human auditory system. In order to achieve a fast rate of change (increase or decrease) in loudness level, a short time constant may be used to cause a change in loudness level in a short time interval corresponding to the short time constant. Conversely, in order to implement a slow rate of change (increase or decrease) in loudness level, a long time constant may be used to change the loudness level over a long time interval corresponding to the long time constant. ..
The human auditory system may respond to increasing and decreasing loudness levels with different integration times. Different time constants may be used to smooth the static DRC gains retrieved from the selected dynamic range compression curve, depending on whether the loudness level is increasing or decreasing. .. For example, according to the characteristics of the human auditory system, attack (increased loudness level) is smoothed with a relatively short time constant (eg attack time), while release (decreased loudness level) is. Smoothed with a relatively long time constant (eg release time).
The DRC gain for a portion of the audio content (eg, one or more audio data blocks, audio data frames, etc.) uses the loudness level determined from said portion of the audio content. It may be calculated. The loudness level to be used for searching on the selected dynamic range compression curve is first in the metadata extracted from the encoded audio signal 102 (for example, a program of which that audio content is part). It may be adjusted with respect to the dialog loudness level (for example, in relation to it).
Reference Dialog Loudness Level / Output Reference Level (for example, -31dB in "Line" mode<sub>FS</sub>, -20dB in "RF" mode<sub>FS</sub>Etc.) may be specified or established for a particular playback environment in Decoder 100. Additional, alternative or optionally, in some embodiments, the user may be given control over setting or changing the reference dialog loudness level in the decoder 100.
The DRC gain unit 114 is configured to determine the dialog loudness-related gain for audio content to cause a change from the input dialog loudness level to the reference dialog loudness level as the output dialog loudness level. You may.
The audio renderer 108 applies gains determined based on DRC, gain limiting, gain smoothing, etc. to the input audio data extracted from the encoded audio signal 102 and then for that particular speaker configuration. It may be configured to generate channel-specific audio data 116 (for example, multi-channel). The channel-specific audio data 116 may be used to drive the speakers, headphones, etc. represented in the speaker configuration.
Additional and / or optionally, the decoder 100 is configured to perform one or more other operations related to processing, rendering, downmixing, resampling, etc. related to the input audio data. Can be done.
The techniques described in this article include a variety of speaker configurations that support a wide variety of different surround sound configurations (eg, 2.0, 3.0, 4.0, 4.1, 4.1, 5.1, 6.1, 7.1, 7.2, 10.2, 10-60 speaker configurations, Can be used with 60+ speaker configurations, object signals or combinations of object signals, and a variety of different rendering environment configurations (eg cinemas, parks, opera, concert halls, bars, homes, auditoriums, etc.) can.
FIG. 2 shows an exemplary encoder 150. The encoder 150 may include an audio content interface 152, a dialog loudness analyzer 154, a DRC reference reservoir 156 and an audio signal encoder 158. The encoder 150 may be part of a broadcast system, an internet-based content server, an over-the-air network operator system, a movie production system, and the like.
The audio content interface 152 receives the audio content 160 and the audio content control input 162 and is encoded, at least in part, based on some or all of the audio content 160 and the audio content control input 162. It may be configured to generate the audio signal 102. For example, the audio content interface 152 may be used to receive audio content 160 and audio content control inputs 162 from content creators, content providers, and so on.
The audio content 160 may be part or all of the overall media data, including audio only, audiovisual, and the like. The audio content 160 may include one or more of parts of a program, a program, some programs, one or more commercials, and the like.
Dialog Loudness Analyzer 154 determines one or more dialog loudness levels for one or more parts of audio content 152 (eg, one or more programs, one or more commercials, etc.) It may be configured to establish. Audio content may be represented by one or more sets of audio tracks. The audio content dialog audio content may be on separate audio tracks, and / or at least some of the audio content dialog audio content is audio that includes non-dialog audio content. It may be on the track.
The audio content control input 162 includes some or all of a user control input, a control input provided by a system / device external to the encoder 150, a control input from the content creator, a control input from the content provider, and the like. You may be. A user, such as a mixing engineer, can provide / specify one or more dynamic range compression curve identifiers. These identifiers may be used to extract one or more dynamic range compression curves that best fit audio content 160 from a data store such as the DRC reference store (156).
The DRC reference storage unit 156 may be configured to store a set of DRC reference parameters and the like. The set of DRC reference parameters may include definition data for one or more dynamic range compression curves and the like. The encoder 150 may encode two or more dynamic range compression curves (eg, in parallel) into the encoded audio signal 102. Zero, one or more of those dynamic range compression curves may be standard-based, proprietary, customized, decoder-modifiable, and so on. As an example, the dynamic range compression curves of FIGS. 3 and 4 may be encoded (eg, in parallel) in the encoded audio signal 102.
The audio signal encoder 158 receives the audio content from the audio content interface 152, the dialog loudness level from the dialog loudness analyzer 154, and one or more DRC reference parameter sets from the DRC reference reservoir 156. Takes (ie, the DRC profile), formats the audio content into audio data blocks / frames, and sets the dialog loudness level, DRC reference parameter set, etc. in the metadata (eg, metadata container, metadata field). , Metadata structure, etc.) and the audio data blocks / frames and metadata may be configured to encode into the encoded audio signal 102. The encoded audio signal as described in this article. The audio content to be encoded in is one or more of the various source audio formats, one or more of the various methods, such as wirelessly, over a wired connection, through a file, via an internet download, etc. Can be received in multiples.
The encoded audio signal 102 described herein is part of the overall media data bitstream (for example, for audio broadcasts, audio programs, audiovisual programs, audiovisual broadcasts, etc.). Can be done. Media data bitstreams can be accessed from servers, computers, media storage devices, media databases, media files, and more. Media data bitstreams may be broadcast, transmitted or received over one or more wireless or wired network links. Media data bitstreams can be delivered through one or more intermediaries such as network connections, USB connections, wide area networks, local area networks, wireless connections, optical connections, buses, crossbar connections, serial connections, etc. It may be communicated.
Any of the components depicted (eg in Figures 1 and 2) can be hardware, software, or hardware-software combinations, with one or more processes and / or one or more IC circuits (for example). For example, it may be implemented as an ASIC, FPGA, etc.).
3 and 4 show an exemplary dynamic range compression curve that can be used by the DRC gain unit 104 in the decoder 100 to derive the DRC gain from the input loudness level. As shown, the dynamic range compression curve may be centered on the reference loudness level (eg, the output reference level) in the program to provide the appropriate overall gain for a particular playback environment. Illustrative definition data for dynamic range compression curves (eg, in the metadata of the encoded audio signal 102) (eg, but not limited to, including, but not limited to, boost ratio, cut ratio, attack time, release time, etc.) Is shown in the table below. Different profiles (eg film standard, film light, music standard, music light, speech, etc.) play differently (eg in decoder 100) Represents the environment.
<tables num="1"><img file="JP6834049B2_D0001.tif" /></tables> dB<sub>SPL</sub>Or dB<sub>FS</sub>Loudness level and dB represented by<sub>SPL</sub>One or more compression curves described using the gain expressed in dB with respect to may be received. On the other hand, the DRC gain calculation is dB.<sub>SPL</sub>It is performed with a different loudness representation (eg, thorn) that has a non-linear relationship with the loudness level. The compression curve used in the DRC gain calculation may then be transformed to be described using the different loudness representation (eg, thorn).
FIG. 5 shows an exemplary encoded audio signal 102 containing a sequence of frames (numbered from n + 1 to n + 30 as n is an integer). In the illustrated example, every fifth frame is an I frame. In the illustrated example, the I-frame (n + 1) has multiple DRC profiles (identified as home theater AVRs (audio / video receivers), flat panels, portable HP (headphones) and portable SPs (speakers)). Have. Each DRC profile has a dynamic range compression curve as shown in FIGS. 3 and 4.
The plurality of DRC profiles can be repeatedly inserted within an I frame of a sequence of frames. This means that the decoder 100 will provide the appropriate DRC profile for the encoded audio signal 102 and for the current rendering mode at startup of the decoded audio signal 102 and at tune-in to the audio program being broadcast. And / or after the junction, allow decisions. On the other hand, iterative transmission of a complete set of DRC profiles leads to relatively high bitstream overhead. In view of this, it is proposed to transmit a varying subset of the DRC profile within the I-frame of the encoded audio signal 102.
Figure 5 shows an example for inserting a DRC profile within a sequence of frames. In the illustrated example, only a single DRC profile from the complete set of DRC profiles is inserted in the I frame. The DRC profile inserted into an I-frame varies from I-frame to I-frame, so that after N I-frames (N = 4 in the example shown), the decoder 100 receives a complete set of N DRC profiles. It will be. By doing so, the data rate for transmitting the complete set of DRC profiles can be reduced while ensuring that the decoder 100 receives the complete set of DRC profiles in a reasonable amount of time.
Figures 6a and 6b show a flowchart of the exemplary method 600 for determining the DRC profile for decoding the frame of the encoded audio signal 102. Method 600 may be performed by decoder 100 (particularly selector 110). The DRC profile used by the decoder 100 may be initialized at the start of receipt of the encoded audio signal 102. The DRC profile used to decode the current frame of the encoded audio signal 102 may now be referred to as the DRC profile. Therefore, at startup, the DRC profile may now be initialized. In particular, the default DRC profile (available in Decoder 100) may be set to be the current DRC profile currently used to render the frame (method step 601). Therefore, the variable "profile" may be set to the default DRC profile (profile = default DRC profile). In addition, the decoder 100 may track previously used profiles. Previously used profiles may be set to undefined (prev_profile = undefined).
Method 600 may further include step 602 to fetch a new frame (ie, the current frame) to be decoded from the encoded audio signal 102. In step 603, it is verified whether the new frame is an I frame that may contain a DRC profile. If the new frame is not an I frame, method 600 proceeds to step 604 and currently processes the new frame using the DRC profile. In addition, in method stage 605, the previously used profile is now set to the DRC profile (prev_profile = profile).
If the new frame is an I-frame, it may be checked in method step 606 to see if the I-frame contains DRC data. As an example, the metadata of an I-frame may include a flag indicating whether the I-frame contains DRC data. In the absence of DRC data, method 300 may proceed to steps 604, 605. Otherwise, the method may proceed to method step 607.
In method step 607, it may be verified whether the new frame is the first frame of the encoded audio signal 102 to be decoded. As can be seen from the flowcharts in Figures 6a and 6b, this can be verified by inspecting the prev_profile variable. If the prev_profile variable is undefined, the new frame is the first frame to be decoded. If the new frame is the first frame to be decoded, the decoder 100 may use a predefined DRC profile other than the default DRC profile. For this purpose, the new frame metadata may include an identifier (ID) for such a predefined DRC profile. Such a predefined DRC profile may be stored in the database in the decoder 100. The use of a predefined DRC profile may provide a bitrate efficient means for signaling the DRC profile to be used to the decoder 100. This is because only the ID of the predefined profile needs to be transmitted (method step 608). The predefined DRC profiles signaled using the ID may be referred to as the implied DRC profile.
In some cases it may be beneficial to just use a single predefined DRC profile other than the default DRC profile. In such cases, the decoder 100 is configured to set the profile variable to its predefined (ie implied) DRC profile without receiving any ID in the metadata of the new frame. May be good.
Method 600 may further include verifying whether the new frame's metadata contains one or more explicit DRC profiles (step 609). The explicit DRC profile contains an ID for identifying the explicit DRC profile. In addition, the explicit DRC profile typically contains definitional data for the dynamic range compression curve as shown in FIGS. 3 and 4. The dynamic range compression curve may be defined as a piecewise linear function. In addition, the explicit DRC profile may indicate the range of output reference levels (ORLs) to which the explicit DRC profile is applicable. As an example, the default DRC profile and / or the predefined (implicit) DRC profile may be applicable for output reference levels in the range -31 dB FS to 0 dB FS.
The ORL of the renderer may indicate the dynamic range function of the renderer. Typically, the dynamic range function decreases with increasing ORL. For high ORLs, compression curves with a high degree of compression should be used to render the audio signal in an understandable way without clipping. On the other hand, for low ORLs, compression may be reduced to render the audio signal with high dynamic range. The high dynamic range capabilities of the renderer still guarantee the comprehension of the audio signal.
If the metadata of the new frame contains at least one explicit DRC profile, the profile data of the first DRC profile is read (step 610). In addition, it is verified whether the ORL range of the first DRC profile is applicable to the rendering equipment currently in use (step 611). If not, method 600 proceeds to look for another explicit DRC profile in the metadata of the new frame. On the other hand, if an explicit DRC profile is applicable to the renderer, this explicit DRC profile may be set to the current DRC profile to be used to process the new frame (steps). 614).
Method 600 may further include verifying whether the headphone rendering mode is used and whether an explicit DRC profile is applicable to the headphone rendering mode (step 612). In addition, Method 600 may include verifying whether the explicit DRC profile is an updated profile compared to a previously used profile (step 613). For this purpose, the ID of the explicit DRC profile may be compared to the ID of the profile currently in use. This ensures that the decoder 100 always uses the latest current DRC profile.
Using method 600, the decoder 100 always captures frames of the encoded audio signal 102, even if the data has not yet received a DRC profile for the current rendering mode (ie, for the current rendering device). It can be guaranteed to identify the DRC profile for rendering. In addition, the DRC profile for the current rendering mode is guaranteed to be applied as soon as the decoder 100 receives the corresponding DRC profile.
Therefore, a method 600 for decoding the encoded audio signal 102 is described. The encoded audio signal 102 has a sequence of frames. In addition, the encoded audio signal 102 exhibits a number of different Dynamic Range Control (DRC) profiles for a number of corresponding different rendering modes. Examples for different rendering modes (or different playback environments) are the first DRC profile for use in home theater rendering mode; the second DRC profile for use in flat panel rendering mode; portable device speakers. A third DRC profile for use in render mode; and / or a fourth DRC profile for use in headphone render mode. The DRC profile defines specific DRC behavior. The DRC behavior may be described by the compression curve (and time constant) and / or by the DRC gain. The DRC gains may be temporally equidistant gains that can be applied to the encoded audio signal 102 to deploy the DRC. The compression curves may be accompanied by time constants that together form the DRC algorithm. The DRC typically reduces the volume of loud sounds and amplifies the quiet sounds, thereby compressing the dynamic range of the audio signal for improved experience in non-ideal playback environments.
A sequence of frames typically includes multiple successive frames that make up an audio signal. An audio program (eg, a broadcast television or radio program) may include multiple audio signals concatenated at a junction. As an example, the main audio program may be repeatedly interrupted by commercial breaks. The sequence of frames may correspond to a complete audio program. Alternatively, the sequence of frames may correspond to one of the plurality of audio signals forming a complete audio program.
Different subsets of DRC profiles from the plurality of DRC profiles may be contained within different frames of the frame sequence. Thereby, two or more frames of the sequence of frames congruently include the plurality of DRC profiles. As described above, the delivery of DRC profiles across multiple frames in a sequence of frames leads to a reduction in bitstream overhead for signaling the plurality of DRC profiles.
Method 600 may include determining a first rendering mode from the plurality of different rendering modes. In particular, it may be determined which rendering mode is used to render the encoded audio signal 102. In addition, method 600 may include 609, 610 determining one or more DRC profiles from said plurality of DRC profiles contained within the current frame of said sequence of frames. In other words, one or more DRC profiles may be determined from a subset of the DRC profiles currently contained within the frame. In addition, it may be determined whether at least one of the one or more DRC profiles is applicable to the first rendering mode 611. The determination 611 whether at least one of the one or more DRC profiles is applicable to the first rendering mode determines the first output reference level for the first rendering mode. Then, the range of the output reference level to which the DRC profile from the one or more DRC profiles is applicable is determined, and it is determined whether or not the first output reference level is within the range of the output reference level. May include.
Method 600 may further include selecting the default DRC profile as the current DRC profile if none of the one or more DRC profiles is applicable to the first rendering mode. .. The definition data of the default DRC profile is typically known in the decoder for decoding the encoded audio signal 102. In addition, method 600 may include decoding (and / or rendering) the current frame using the current DRC profile. Thus, it can be guaranteed that the decoder 100 utilizes the DRC profile (and dynamic range compression curve) even if the decoder 100 has not yet received the DRC profile specific to the encoded audio signal 102.
Alternatively or additionally, Method 600 determines that the first DRC profile from the one or more DRC profiles is applicable to the first rendering mode. If so, it may include 604, which is currently selected as the DRC profile. As a result, the decoder 100 is configured to use the optimal first DRC profile for the encoded audio signal 102 and for the first rendering mode as soon as the decoder 100 receives the first DRC profile. NS.
Method 600 further determines whether the current frame of the sequence of frames contains one or more DRC profiles from said plurality of DRC profiles, i.e. whether the current frame contains a subset of DRC profiles. , 606 may be included. As outlined in the context of Figure 5, a subset of the DRC profile is typically contained within the I frame of the sequence of frames. Thus, determining whether the current frame contains one or more DRC profiles from the plurality of DRC profiles, or whether the current frame contains a subset of the DRC profiles 603, 606 indicates that the current frame is It may include determining if it is an I-frame 603. As mentioned above, an I-frame may be a frame that can be decoded independently of any other frame from the sequence of frames. This may be due to the fact that the data contained in such an I frame is transmitted in a way that does not depend on the data from previous or subsequent frames. In particular, the data in the I frame is not differentially encoded with respect to the data contained in the previous or subsequent frame.
Further determining whether the current frame contains one or more DRC profiles from said plurality of DRC profiles, or whether the current frame contains a subset of DRC profiles 603, 606 is in the current frame. Validating the included DRC profile flag may include 606. The DRC profile flag in the bitstream of the encoded audio signal provides a bandwidth-efficient and computationally efficient means for identifying the frame that carries the DRC profile.
Method 600 may further include determining whether the current frame indicates an implied DRC profile from a plurality of implied DRC profiles. The implied DRC profile may include a predefined legacy compression curve and time constant that can be used to transcode to E-AC-3. As mentioned above, the definition data of the implied DRC profile may be known in the decoder 100 for decoding the input audio signal 102. In contrast to the default DRC profile, the implied DRC profile may be specific to various types of audio signals (eg, as shown in Table 1). The current frame of the sequence of frames may indicate a particular implicit DRC profile (using, for example, an identifier ID). This may provide a bandwidth efficient means for signaling the appropriate DRC profile for the encoded audio signal 102. The implied DRC profile may be selected as the current DRC profile if the current frame is determined to represent an implied DRC profile profile 608.
Decoding the current frame may include leveling the sequence of frames to the first output reference level of the first rendering mode. In addition, decoding the current frame may include adapting the loudness level of the current frame using the dynamic range compression curve currently specified in the DRC profile. Loudness level adaptation may be performed as outlined in the context of Figure 1.
Depending on the number of frames from the sequence of frames, the current DRC profile is the default DRC profile (which is typically independent of the input audio signal 102), the implicit DRC profile (which is in a limited way). It may correspond to the input audio signal 102) or the first explicit DRC profile (which may be designed for the input audio signal 102 and / or the first rendering mode). good.
Typically, only a subset of frames contains a DRC profile. Once the current DRC profile is selected, the current DRC profile may be maintained to decode the frames in the sequence of frames that do not contain any DRC profile. In addition, even if a frame with a DRC profile is received, the current DRC profile is maintained unless a more relevant DRC profile is received for the audio signal 102 that is newer and / or encoded than the current DRC profile. (Here, the selected first explicit DRC profile is more relevant than the selected implicit DRC profile, and the selected implicit DRC profile is more relevant than the default DRC profile. high). This ensures the continuity and optimality of the DRC profile used.
As a complement to method 600 for decoding the encoded audio signal 102, a method for generating or encoding the encoded audio signal 102 is described. The encoded audio signal 102 has a sequence of frames. In addition, the encoded audio signal 102 exhibits a number of different Dynamic Range Control (DRC) profiles for a number of corresponding different rendering modes. In this method, different subsets of DRC profiles from the plurality of DRC profiles are inserted into different frames of the sequence of frames, and two or more frames of the sequence of frames are combined to form the plurality of DRC profiles. Including to include. In other words, subsets of the DRC profile, which is less than the total number of DRC profiles, may be provided with the various frames in the sequence of frames. This can reduce the overhead of the encoded audio signal 102 while providing the corresponding decoder 100 with a complete set of DRC profiles. In other words, the advantage of this approach is that the encoder 150 has an increased degree of freedom in how to transmit DRC data. This degree of freedom can be used to reduce the bit rate.
The sequence of frames may include a partial sequence consisting of I frames (for example, every Xth frame of the sequence of frames may be an I frame). Various subsets of the DRC profile may be inserted into various (eg, successive) I-frames of a subsequence of the I-frame. I-frames may be skipped to further reduce bandwidth. That is, some I-frames do not have to contain DRC profile data.
A subset of DRC profiles (eg, each subset) may contain only a single DRC profile. In particular, the plurality of DRC profiles may include N DRC profiles. Where N is an integer and N> 1. N DRC profiles may be inserted into N different frames from said sequence of frames. By doing so, the bit rate required for the transmission of the DRC profile can be minimized.
The method further comprises inserting all of the plurality of DRC profiles into a first frame of the sequence of frames (eg, into the first frame of the sequence of frames of an audio signal). good. As a result, rendering of the encoded audio signal 102 can be initiated directly with the correct explicit DRC profile. As mentioned above, the audio program may be divided into a plurality of partial audio programs. For example, the main audio program is interrupted by a commercial pause. It may be beneficial to insert all of the plurality of DRC profiles in the first frame of each partial audio program. In other words, it may be beneficial to insert all of the plurality of DRC profiles immediately after the one or more junctions of an audio program that includes the plurality of partial audio programs.
Various subsets of the DRC profile from the plurality of DRC profiles may be inserted into different frames of the sequence of frames. Thereby, each of the M directly contiguous subsequences from the sequence of frames concomitantly includes the plurality of DRC profiles. Where M is an integer and M> 1. In other words, the plurality of DRC profiles may be repeatedly transmitted within a block of M frames. As a result, the decoder 100 must wait up to M frames to obtain the optimal explicit DRC profile for the encoded audio signal 102.
The method may further include inserting a flag into the frame of the sequence of frames. Here, the flag indicates whether or not the frame contains a DRC profile. By providing such a flag, the corresponding decoder 100 can efficiently identify the frame containing the DRC profile data.
The DRC profile of the plurality of DRC profiles may be an explicit DRC profile containing (ie, supporting) definition data for defining a dynamic range compression curve.
As outlined in this article, the dynamic range compression curve gives the mapping between input loudness and output loudness and / or the gain to be applied to the audio signal. In particular, the definition data is: Boost gain for boosting input loudness; Boost gain range indicating the range of input loudness to which the boost gain is applicable; Null band range indicating the range of input loudness to which 0 dB gain is applicable. Cut gain to attenuate input loudness; Cut gain range indicating the range of input loudness to which the cut gain is applicable; Boost gain ratio indicating the transition between null gain and said boost gain; and / or said null It may include one or more of the cut gain ratios indicating the transition between the gain and the cut gain.
The method may further include inserting implied DRC profile instructions (eg, identifiers, IDs). Here, the definition data of the implied DRC profile is typically known to the decoder 100 of the encoded audio signal 102. Implied DRC profile indications can provide a bandwidth-efficient means for signaling a DRC profile that is (in a limited way) compliant with the encoded audio signal 102.
As outlined above, frames in the sequence of frames typically include audio data and metadata. A subset of the DRC profile is typically inserted as metadata.
The DRC profile may include definition data that defines the range of output reference levels to which the DRC profile is applicable. The output reference level typically indicates the dynamic range of a rendering mode. In particular, the dynamic range of the rendering mode may decrease as the output reference level increases, and vice versa. In addition, the maximum boost gain and maximum cut gain of the dynamic range compression curve of the DRC profile may increase with increasing output reference level and vice versa. Thus, the output reference level provides an efficient means for selecting the appropriate DRC profile (with the appropriate dynamic range compression curve) for a particular rendering mode.
The method may further include generating a bitstream containing the encoded audio signal 102. The bitstream may be an AC4 bitstream. That is, the bitstream may conform to the AC4 bitstream format.
The method may further include inserting an explicit DRC gain for the encoded audio signal 102 into the frame of said sequence of frames. In particular, a DRC gain applicable to a particular frame of said sequence of frames may be inserted into that particular frame. Thus, each frame of said sequence of frames may include a DRC data component containing one or more explicit DRC gains to be applied to each frame. In particular, each frame may contain different explicit DRC gains for different rendering modes. For this purpose, DRC algorithms for different rendering modes may be applied within the encoder 150, and different DRC gains for different rendering modes may be determined in the encoder 150. Different DRC gains may then be explicitly inserted within said sequence of frames. As a result, the corresponding decoder 100 can directly apply explicit DRC gain using the dynamic range compression curve without running the DRC algorithm.
Thus, a sequence of frames may include multiple explicit DRC profiles to signal dynamic range compression curves for multiple corresponding rendering modes, or may indicate such DRC profiles. good. The plurality of DRC profiles may be inserted in a part (but not all) (for example, I frame) of a frame in a sequence of frames. In addition, the sequence of frames may include one or more DRC profiles for the corresponding one or more rendering modes, or may indicate such DRC profiles. Here, the one or more DRC profiles indicate that explicit DRC gains for one or more rendering modes are inserted into the frames of the sequence of frames. As an example, the one or more DRC profiles for signaling an explicit DRC gain may include a flag indicating whether the frames of the sequence of frames contain an explicit DRC gain. .. The DRC gain may be inserted into each frame of the sequence of frames. In particular, each frame may contain the one or more DRC gains that should be used to decode that frame.
The method may include inserting a DRC profile for explicit DRC gain into a subset of frames from said sequence of frames. As an example, a DRC profile carrying the DRC gain for it may show DRC configuration data for explicit gain. In particular, the DRC profile to which the DRC gain for it is transmitted may be included in all said subsets of the DRC profile. The DRC configuration data (eg, flags) may indicate that the sequence of frames contains an explicit DRC gain for a particular rendering mode. By doing so, the decoder 100 is informed of the fact that for that particular rendering mode, the explicit DRC gain is derived directly from the frame of said sequence of frames.
Thus, the method may further include determining the explicit DRC gain for the encoded audio signal 102 for a particular rendering mode. Further, the method may include inserting the explicit DRC gain into the frame of the sequence of frames. The explicit DRC gain may be inserted into a frame from said sequence of frames to which the explicit DRC gain is applicable. In addition, frames from said sequence of frames may include said one or more explicit DRC gains required to decode the frame within that particular rendering mode.
The method may further include inserting a DRC profile showing DRC configuration data for the particular rendering mode into a subset of frames from said sequence of frames (eg, in an I frame). The DRC configuration data (including, for example, flags) may indicate the fact that for that particular rendering mode an explicit DRC gain is contained within the frame of said sequence of frames. Thus, the decoder 100 can efficiently determine whether to use compression curves from multiple DRC profiles or to use explicit DRC gains to signal the dynamic range compression curves.
The DRC profile for signaling a dynamic range compression curve and the one or more DRC profiles pointing to an explicit DRC gain are dedicated syntax elements for the I frame of the sequence of frames (eg, the DRC profile. It may be contained within (referred to as a syntax element).
The methods and systems described in this article may be implemented as software, firmware and / or hardware. Certain components may be implemented, for example, as software running on a digital signal processor or microprocessor. Other components may be implemented, for example, as hardware and / or application-specific integrated circuits. The signals encountered in the methods and systems described may be stored on media such as random access memory or optical storage media and transferred over radio networks, satellite networks, wireless or wired networks, such as the Internet. May be done. Typical devices that utilize the methods and systems described in this article are portable electronic devices or other consumer equipment used to store and / or render audio signals.
Some aspects are described. [Aspect 1] A method for generating an encoded audio signal, wherein the encoded audio signal has a sequence of frames, and the encoded audio signal is for a plurality of corresponding different rendering modes. To show a plurality of different Dynamic Range Control (DRC) profiles, the method: Insert different subsets of the DRC profile from the plurality of DRC profiles into different frames of the sequence of the frame and the sequence of the frame. A method comprising combining two or more frames of the above to include the plurality of DRC profiles. [Aspect 2] The method of aspect 1, wherein the sequence of frames comprises a subsequence consisting of I frames; the different subset of the DRC profile is inserted into different I frames of the subsequence consisting of I frames. [Aspect 3] The method of aspect 1 or 2, wherein the subset of DRC profiles includes only a single DRC profile. [Aspect 4] -The plurality of DRC profiles include N DRC profiles, N is an integer and N> 1; -The N DRC profiles are N different frames from the sequence of frames. The method according to any one of aspects 1 to 3, which is inserted into. [Aspect 5] The method according to any one of aspects 1 to 4, further comprising inserting all of the plurality of DRC profiles into the first frame of the sequence of frames. [Aspect 6] -The different subsets of DRC profiles from the plurality of DRC profiles include the plurality of DRC profiles in which each subsequence consisting of M consecutive frames from the sequence of frames is congruent. The method according to any one of aspects 1 to 5, wherein M is an integer and M> 1. [Aspect 7] The method of any one of aspects 1-6, further comprising inserting a flag into a frame of said sequence of frames, wherein the flag indicates whether or not the frame contains a DRC profile. [Aspect 8] -A DRC profile among the plurality of DRC profiles is an explicit DRC profile containing definition data that defines a dynamic range compression curve; -The dynamic range compression curve is applied to an input loudness and a signal. The method of any one of aspects 1-7, which provides a mapping between the gains to be expected. [Aspect 9] The method according to Aspect 8, wherein all of the plurality of DRC profiles are explicit DRC profiles. [Aspect 10] The defined data are: Boost gain for boosting the input loudness; Boost gain range indicating the range for the input loudness to which the boost gain is applicable; Range of the input loudness to which a gain of 0 dB is applicable. Null band range indicating; Cut gain for attenuating the input loudness; Cut gain range indicating the range of the input loudness to which the cut gain is applicable; Transition between the null gain and the boost gain A method according to aspect 8 or 9, comprising one or more of the boost gain ratios shown; and / or a cut gain ratio indicating a transition between the null gain and the cut gain. [Aspect 11] The method of any one of aspects 8-10, further comprising inserting an implied DRC profile indication, wherein the implied DRC profile definition data is known to the decoder of the encoded audio signal. [Aspect 12] The method according to any one of aspects 1 to 11, wherein the frame of the sequence of frames includes audio data and metadata; and a subset of the DRC profile is inserted as metadata. [Aspect 13] The DRC profile contains definition data that defines a range of output reference levels to which the DRC profile can be applied; The output reference level indicates the dynamic range of a rendering mode, aspects 1-12. The method described in any one of the items. [Aspect 14] The method according to aspect 13, wherein the dynamic range of the rendering mode may decrease as the output reference level increases, and vice versa. [Aspect 15] The method of aspect 13 or 14, wherein the maximum boost gain and maximum cut gain of the dynamic range compression curve of the DRC profile may increase with increasing output reference level and vice versa. [Aspect 16] The multiple DRC profiles are: First DRC profile for use in home theater rendering mode; Second DRC profile for use in flat panel rendering mode; Used in portable device speaker rendering mode A method according to any one of aspects 1 to 15, comprising one or more of a third DRC profile for use in and / or a fourth DRC profile for use in a headphone rendering mode. [Aspect 17] The method according to any one of aspects 1 to 16, further comprising generating a bitstream containing the encoded audio signal, wherein the bitstream is an AC4 bitstream. [Aspect 18] Determining the explicit DRC gain for the encoded audio signal for a particular rendering mode; further comprising inserting the explicit DRC gain into the frame of the sequence of frames. The method according to any one of aspects 1 to 17. [Aspect 19] The DRC configuration data further comprises inserting a DRC profile having DRC configuration data for the particular rendering mode into a subset of the frames of the sequence of frames, the DRC configuration data for the particular rendering mode. , The method of aspect 18, wherein the frame of said sequence of frames comprises the fact that an explicit DRC gain is included. [Aspect 20] -The explicit DRC gain is inserted into a frame from the sequence of frames to which the explicit DRC gain is applicable; Aspects 18 or 19 including said one or more explicit DRC gains in which a frame from said sequence of frames is required to decode that frame within that particular rendering mode. The method described. [Aspect 21] A bitstream containing an encoded audio signal, wherein the encoded audio signal has a sequence of frames, and the encoded audio signal is a plurality of corresponding different rendering modes. Demonstrate different Dynamic Range Control (DRC) profiles, different subsets of DRC profiles from said multiple DRC profiles are contained within different frames of said sequence of frames, and two or more of said sequences of frames. A bitstream in which the frames are congruent and contain the plurality of DRC profiles. [Aspect 22] A method of decoding an encoded audio signal, wherein the encoded audio signal has a sequence of frames, and the encoded audio signal is a plurality of corresponding different rendering modes. Demonstrate different dynamic range control (DRC) profiles of, and different subsets of DRC profiles from said multiple DRC profiles are contained within different frames of said sequence of frames, and two or more of said sequences of frames. The frames congruently include the plurality of DRC profiles, and the method is: -Determining the first rendering mode from the plurality of different rendering modes; -Contained within the current frame of the sequence of frames. The stage of determining one or more DRC profiles from a subset of the DRC profiles that are in; Whether at least one of the one or more DRC profiles is applicable to the first rendering mode. And the stage to judge; -If none of the one or more DRC profiles is applicable to the first rendering mode, the default DRC profile is currently being selected as the DRC profile, and the definition data of the default DRC profile. Is a method known in the decoder for decoding the encoded audio signal, including a step of decoding the current frame using the current DRC profile. [Aspect 23] A step (611) of determining whether at least one of the one or more DRC profiles is applicable to the first rendering mode is: -For the first rendering mode Determine the first output reference level of; Determine the range of output reference levels to which the DRC profile can be applied from the one or more DRC profiles; The first output reference level is of the output reference level. 22. The method of aspect 22, comprising determining if the range is within the range. [Aspect 24] A first DRC profile from the one or more DRC profiles is currently a DRC profile when it is determined that the first DRC profile is applicable to the first rendering mode. 22 or 23. The method of aspect 22 or 23, further comprising step (604) of selection as. [Aspect 25] The method according to any one of aspects 22 to 24, further comprising a step of determining whether the current frame in the sequence of frames contains a subset of the DRC profile. [Aspect 26] -A subset of the DRC profile is contained within the I frame of the sequence of frames; 25. The method of aspect 25, wherein the step of determining whether the current frame contains a subset of the DRC profile comprises determining whether the current frame is an I frame (603). [Aspect 27] Aspect 25 or 26, wherein the step of determining whether the current frame contains a subset of the DRC profile comprises verifying the DRC profile flag contained within the current frame (606). the method of. [Aspect 28] -At the stage of determining whether or not the current frame indicates an implied DRC profile from a plurality of implied DRC profiles, the definition data of the implied DRC profile is known in the decoder that decodes the input audio signal. Is the stage and; The method according to any one of aspects 22 to 27, further comprising the step (608) of selecting the implied DRC profile as the current DRC profile when the current frame is determined to exhibit an implied DRC profile. .. [Aspect 29] Any one of aspects 22-28, wherein the decoding step of the current frame comprises leveling the sequence of frames to a first output reference level in said first rendering mode. The method described. [Aspect 30] Any of aspects 22 to 29, wherein the decoding step of the current frame comprises adapting the loudness level of the current frame using the dynamic range compression curve currently specified in the DRC profile. The method described in paragraph 1. [Aspect 31] An encoder for generating an encoded audio signal, wherein the encoded audio signal has a sequence of frames, and the encoded audio signal is for a plurality of corresponding different rendering modes. Demonstrating a plurality of different Dynamic Range Control (DRC) profiles, the encoder inserts different subsets of the DRC profile from the plurality of DRC profiles into different frames of the sequence of the frame and the sequence of the frame. An encoder configured so that two or more frames are combined to include the plurality of DRC profiles. [Aspect 32]
8 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| WO2014113471A1 | Cites | World Intellectual Property Organization (WIPO) |
65 members in 6 offices
Members65
| Document | Office | Kind | |
|---|---|---|---|
| WO2016050740A1 | World Intellectual Property Organization (WIPO) | A1 | |
| CN106796799A | China | A | |
| EP3201915A1 | European Patent Office (EPO) | A1 | |
| US2017249950A1 | United States of America | A1 | |
| JP2017534903A | Japan | A | |
| US10020001B2 | United States of America | B2 | |
| EP3201915B1 | European Patent Office (EPO) | B1 | |
| EP3467827A1 | European Patent Office (EPO) | A1 | |
| US2019139561A1 | United States of America | A1 | |
| US10354670B2 | United States of America | B2 | |
| US2019279652A1 | United States of America | A1 | |
| JP6727194B2 | Japan | B2 | |
| EP3467827B1 | European Patent Office (EPO) | B1 | |
| US10783897B2 | United States of America | B2 | |
| JP2020171041A | Japan | A | |
| EP3736809A1 | European Patent Office (EPO) | A1 | |
| JP6834049B2This record | Japan | B2 | |
| US2021065728A1 | United States of America | A1 | |
| ES2814900T3 | Spain | T3 | |
| JP2021073814A | Japan | A | |
| CN106796799B | China | B | |
| CN113257273A | China | A | |
| CN113257274A | China | A | |
| CN113257275A | China | A | |
| JP6945092B2 | Japan | B2 | |
| JP2021193817A | Japan | A | |
| US11250868B2 | United States of America | B2 | |
| EP3736809B1 | European Patent Office (EPO) | B1 | |
| ES2912586T3 | Spain | T3 | |
| US2022254362A1 | United States of America | A1 | |
| EP4044180A1 | European Patent Office (EPO) | A1 | |
| JP7273914B2 | Japan | B2 | |
| JP2023099123A | Japan | A | |
| US11727948B2 | United States of America | B2 | |
| US2024029748A1 | United States of America | A1 | |
| JP7544324B2 | Japan | B2 | |
| CN113257273B | China | B | |
| CN113257274B | China | B | |
| CN113257275B | China | B | |
| US12112766B2 | United States of America | B2 | |
| JP7567093B1 | Japan | B1 | |
| EP4044180B1 | European Patent Office (EPO) | B1 | |
| JP2024156955A | Japan | A | |
| US2024395270A1 | United States of America | A1 | |
| EP4472073A2 | European Patent Office (EPO) | A2 | |
| EP4472074A2 | European Patent Office (EPO) | A2 | |
| EP4472075A2 | European Patent Office (EPO) | A2 | |
| EP4472073A3 | European Patent Office (EPO) | A3 | |
| EP4472074A3 | European Patent Office (EPO) | A3 | |
| CN119132316A | China | A | |
| CN119132317A | China | A | |
| EP4472075A3 | European Patent Office (EPO) | A3 | |
| JP2025000911A | Japan | A | |
| CN119314498A | China | A | |
| ES3005218T3 | Spain | T3 | |
| EP4472073B1 | European Patent Office (EPO) | B1 | |
| EP4472074B1 | European Patent Office (EPO) | B1 | |
| ES3033221T3 | Spain | T3 | |
| US12387735B2 | United States of America | B2 | |
| ES3034665T3 | Spain | T3 | |
| US2025356868A1 | United States of America | A1 | |
| EP4472075B1 | European Patent Office (EPO) | B1 | |
| EP4472075C0 | European Patent Office (EPO) | C0 | |
| EP4697598A2 | European Patent Office (EPO) | A2 | |
| JP7821857B2 | Japan | B2 |
11 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Report on accelerated examinationJAPANESE INTERMEDIATE CODE: A971005A975 | A975 | |
| Explanation of circumstances concerning accelerated examinationJAPANESE INTERMEDIATE CODE: A871A871 | A871 | |
| Written request for application examinationJAPANESE INTERMEDIATE CODE: A621A621 | A621 |
Numbers
- Publication
- 6834049
- Application
- 112665
Titles2
- Japanese
- 効率的なDRCプロファイル伝送
- English
- Efficient DRC profile transmission
Classification
- CPC, 7
- G10L19/167
- H03G7/007
- H03G7/002
- G10L21/0364
- G10L19/26
- H03G9/005
- H04N21/233
- IPC, 4
- G10L19 00
- G10L25 27
- G10L25 21
- G10L19 16
