Method and apparatus for encoding multi-channel signals

BACKGROUND OF THE INVENTION

0001The present invention relates to a method, and an apparatus to perform the method, of encoding and/or decoding multi-channel signals, and, more particularly, to a method, and an apparatus to perform the method, of encoding multi-channel signals according to the similarity among multi-channel signals, and a decoding method and apparatus therefor.

0002In modern telecommunication technologies, most products and processes are changing from analog to digital technologies. In line with this trend, digital transmission has become essential in a vast majority of audio apparatuses and/or audio transmission. The transmission of digital audio signals is more robust against environment noise than that of conventional analog signals. Thus, transmitted digital audio signals can be reproduced with sound quality as clear as digital audio signals reproduced from a compact disc (CD). However, since the amount of data required to be transmitted has constantly increased, many problems, such as the storage capacity of a medium to store data and transmission lines, have arisen.

0003Data compression is one technology that can be used to alleviate these problems. In an audio compression received after an original audio signal is compressed and transmitted, the quality of the reproduced audio signal is almost the same as that of the original audio signal. That is, audio compression enables the transmission of a smaller amount of information per time unit while ensuring nearly the same quality level of a reproduced audio signal that is not compressed.

0004Compared to a mono audio signal, which is provided through one channel, a stereo audio signal, which is a combination of audio signals respectively provided through a plurality of channels, enables listeners to enjoy stereo sound.

0005However, since the stereo audio signal is a combination of mono audio signals obtained from a plurality of channels, storing or transmission of stereo audio signals is more difficult and expensive than that of mono audio signals. This is because when each channel signal of mono audio signals respectively obtained from a plurality of channels is independently encoded, the amount of data increases by a factor of the number of channels. The amount of data can be reduced by reducing the sampling rate or employing lossy encoding, but the sampling rate directly affects the sound quality, and the lossy encoding may also be a factor for the degradation of sound quality.

0006Accordingly, a method of encoding and decoding multi-channel signals by effectively removing redundant information among channels without directly affecting the sound quality is needed.

SUMMARY OF THE INVENTION

0007The present invention provides a method and apparatus by which multi-channel signals are encoded and decoded, and in order to effectively remove redundant information among channels, the multi-channel signals are encoded into a first signal having information regarding one channel signal and a second signal having information regarding two channel signals including the first channel signal according to the similarity between the channel signals.

0008The present invention also provides a method of decoding the first signal and second signal encoded into multi-channel signals, and an apparatus to perform the method.

0009Additional aspects and/or advantages of the invention will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the invention.

0010According to an aspect of the present invention, there is provided a method of encoding multi-channel signals having two or more channels into a first signal and a second signal, the method including: generating the first signal by performing a first operation using a first channel signal from the multi-channel signals; and generating the second signal by combining the first channel signal and a second channel signal from multi-channel signals.

0011The first signal may comprise the first channel signal, and the second signal may comprise a difference signal of the first channel signal and the second channel signal.

0012The first channel signal and the second channel signal may comprise a left channel signal and a right channel signal, respectively. The first signal may comprise the left channel signal or the right channel signal, and the second signal may comprise a difference signal of the left channel signal and the right channel signal.

0013According to another aspect of the present invention, there is provided a method of encoding multi-channel signals formed with a left channel signal and a right channel signal, the method including: calculating a similarity between the left channel signal and the right channel signal; and encoding the multi-channel signals into a first signal and a second signal in response to the similarity being equal to or greater than a predetermined value, wherein the first signal is calculated using the left channel signal or the right channel signal, and the second signal is calculated using a combination of the left channel signal and the right channel signal.

0014The first signal may comprise the left channel signal or the right channel signal, and the second signal may comprise a difference signal of the left channel signal and the right channel signal.

0015The calculating of the similarity may comprise calculating a ratio of a mean power of the left channel signal and a mean power of the right channel signal, or a ratio of a scale factor of the left channel signal and a scale factor of the right channel signal, or a ratio of a masking threshold of the left channel signal and a masking threshold of the right channel signal.

0016The multi-channel signals may be encoded into the first signal and the second signal in response to the calculated ratio being a value in a predetermined range with respect to 1.

0017The multi-channel signals may be encoded into a first signal that is a sum signal of the left channel signal and the right channel signal, and a second signal that is a difference signal of the left channel signal and the right channel signal, in response to the similarity being less than a predetermined value.

0018According to another aspect of the present invention, there is provided a method of decoding a first signal and a second signal into multi-channel signals formed with two or more channels, the method including: decoding a first channel signal among the multi-channel signals by performing a first operation with the first signal; and decoding a second channel signal among the multi-channel signals by performing a second operation with a combination of the first signal and the second signal.

0019The first channel signal may comprise the first signal.

0020The first channel signal and the second channel signal may comprise a left channel signal and a right channel signal, respectively, and the left channel signal or the right channel signal may be the first signal.

0021According to another aspect of the present invention, there is provided an apparatus to encode multi-channel signals formed with a left channel signal and a right channel signal, including: a similarity calculation unit to calculate a similarity between the left channel signal and the right channel signal; and an encoder to encode the multi-channel signals into a first signal and a second signal in response to the similarity being equal to or greater than a predetermined value; wherein the encoder generates the first signal by performing a first operation with the left channel signal or the right channel signal, and generates the second signal by performing a second operation with a combination of the left channel signal and the right channel signal.

0022The first signal may comprise the left channel signal or the right channel signal. The second signal may be generated by performing a differential operation of the left channel signal and the right channel signal.

0023The similarity calculation unit may calculate a ratio of a mean power of the left channel signal and a mean power of the right channel signal, or a ratio of a scale factor of the left channel signal and a scale factor of the right channel signal, or a ratio of a masking threshold of the left channel signal and a masking threshold of the right channel signal.

0024The encoder may encode the multi-channel signals into the first signal and the second signal in response to the calculated ratio being a value in a predetermined range with respect to 1.

0025The methods of encoding and decoding multi-channel signals may be implemented as computer programs on a computer readable recording medium.

0026According to a another aspect of the present invention, there is provided an apparatus to decode a first signal and a second signal into multi-channel signals formed with two or more channels, including: a first decoding unit to receive the first signal and decode a first channel signal among the multi-channel signals by performing a first operation with the first signal; and a second decoding unit to receive the first signal and the second signal and decode a second channel signal among the multi-channel signals by performing a second operation with a combination of the first signal and the second signal.

0027The first channel signal may comprise the first signal. The first channel signal and the second channel signal may comprise a left channel signal and a right channel signal, respectively.

0028The left channel signal or the right channel signal may comprise the first signal.

BRIEF DESCRIPTION OF THE DRAWINGS

0029These and/or other aspects and advantages of the invention will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which: <ul id="ul0001" list-style="none" compact="compact"><li>FIG. 1 is a block diagram illustrating the structure of an apparatus to encode multi-channel signals according to an embodiment of the present invention;</li><li>FIG. 2 illustrates a Left/Side (US) encoding method;</li><li>FIG. 3 illustrates a Mid/Side (M/S) encoding method;</li><li>FIG. 4 is a graph illustrating an embodiment of the ratio of mean powers between a left audio signal and a right audio signal;</li><li>FIG. 5 is a graph illustrating another embodiment of the ratio of mean powers between a left audio signal and a right audio signal;</li><li>FIG. 6 is a graph illustrating distribution changes of a left audio signal and a first signal according to Left/Side (L/S) encoding;</li><li>FIG. 7 is a graph illustrating distribution changes of a right audio signal and a second signal according to the US encoding; and</li><li>FIG. 8 is a flowchart illustrating the operations of a method of encoding multi-channel signals according to an embodiment of the present invention.</li></ul>

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

0030Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments are described below to explain the present invention by referring to the figures.

0031Referring to FIG. 1, an apparatus to encode multi-channel signals according to an embodiment of the present invention includes a similarity calculation unit 100 and an encoder 110. The operation of the encoding apparatus shown in FIG. 1 will now be explained with reference to the flowchart illustrating an encoding method shown in FIG. 8.

0032The similarity calculation unit 100 calculates the similarity between a left audio signal and a right audio signal of a stereo signal in operation 800. Preferably, though not necessarily, the left audio signal and the right audio signal are divided into a preset number of frequency bands, and the similarity calculation unit 100 calculates the similarity between the left audio signal and the right audio signal in each of the respective divided frequency bands.

0033Preferably, though not necessarily, the similarity between the left audio signal and the right audio signal is calculated as the ratio of the mean powers, or the ratio of scale factors, or the ratio of masking threshold values of the two audio signals. The mean power is the mean power of samples included in each respective frequency band of an audio signal. The scale factor is a value having a representative characteristic in each respective frequency band. As a method to calculate the scale factor, preferably, though not necessarily, a value of a sample having the largest absolute value among samples included in each respective frequency band is obtained.

0034The masking threshold value is the maximum size of a signal that a human being cannot perceive due to interactions of audio signals. The masking threshold value relates to a masking phenomenon occurring when a signal masks another signal by mutual interference of audio signals in a psychoacoustic model, which is normally used to encode an audio signal, and thusly a human being cannot perceive the masked signal. Preferably, though not necessarily, the masking threshold value is obtained in each respective frequency band.

0035As the calculated ratio of the mean powers, the scale factors, or the masking threshold values of the left audio signal and the right audio signal approaches a value of 1, the similarity between the two channels is higher.

0036The similarity calculation unit 100 determines whether or not the calculated similarity is equal to or greater than a predetermined similarity (A), and if it is equal to or greater than (A), generates and outputs a signal so that the encoder 110 performs Left/Side (L/S) encoding of the stereo signals in operation 810. Preferably, though not necessarily, in a case in which the calculated ratio of the mean powers, the scale factors, or the masking threshold values of the left audio signal and the right audio signal is included in a predetermined range with respect to 1, the encoder 110 performs encoding. For example, in the case in which the value of the calculated ratio is in a range of ± 0.1 with respect to 1, that is, the calculated ratio is included in a range from 0.9 to 1.1, the encoder 110 performs encoding.

0037The encoder 110 receives the signal input indicating to perform encoding from the similarity calculation unit 100, performs US encoding of the left audio signal and the right audio signal, and outputs a first signal and a second signal in operation 820.

0038FIG. 2 illustrates an embodiment of the US encoding method, and the left audio signal (L) and the right audio signal (R) can be encoded into a first signal and a second signal by using equation 1: <maths id="math0001" num="(1)"><math display="block"><mrow><mrow><mo>[</mo><mrow><mtable columnalign="left"><mtr columnalign="left"><mtd columnalign="left"><mrow><mi mathvariant="italic">first signal</mi></mrow></mtd></mtr><mtr columnalign="left"><mtd columnalign="left"><mrow><mi mathvariant="italic">second signal</mi></mrow></mtd></mtr></mtable></mrow><mo>]</mo></mrow><mo>=</mo><mrow><mo>[</mo><mrow><mtable><mtr><mtd><mi>x</mi></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mi>y</mi></mtd><mtd><mi>z</mi></mtd></mtr></mtable></mrow><mo>]</mo></mrow><mrow><mo>[</mo><mrow><mtable columnalign="left"><mtr columnalign="left"><mtd columnalign="left"><mi>L</mi></mtd></mtr><mtr columnalign="left"><mtd columnalign="left"><mi>R</mi></mtd></mtr></mtable></mrow><mo>]</mo></mrow></mrow></math><img file="EP1686562A2_D0001.tif" /></maths>

0039In equation 1, x, y, and z are constant numbers. According to equation 1, the first signal is calculated by using only the left audio signal (L), and includes information regarding only the left audio signal, and the second signal is calculated as a combination of the left audio signal (L) and the right audio signal (R), and includes information regarding the left signal (L) and the right audio signal (R). More specifically, preferably, though not necessarily, the stereo signals may be encoded into the first signal and the second signal according to the following equation 2: <maths id="math0002" num="(2)"><math display="block"><mrow><mrow><mo>[</mo><mrow><mtable columnalign="left"><mtr columnalign="left"><mtd columnalign="left"><mrow><mi mathvariant="italic">first signal</mi></mrow></mtd></mtr><mtr columnalign="left"><mtd columnalign="left"><mrow><mi mathvariant="italic">second signal</mi></mrow></mtd></mtr></mtable></mrow><mo>]</mo></mrow><mo>=</mo><mrow><mo>[</mo><mrow><mtable><mtr><mtd><mn>1</mn></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mrow><mn>0.5</mn></mrow></mtd><mtd><mrow><mo>−</mo><mn>0.5</mn></mrow></mtd></mtr></mtable></mrow><mo>]</mo></mrow><mrow><mo>[</mo><mrow><mtable columnalign="left"><mtr columnalign="left"><mtd columnalign="left"><mi mathvariant="italic">L</mi></mtd></mtr><mtr columnalign="left"><mtd columnalign="left"><mi mathvariant="italic">R</mi></mtd></mtr></mtable></mrow><mo>]</mo></mrow></mrow></math><img file="EP1686562A2_D0002.tif" /></maths>

0040According to equation 2, the first signal encoded by the US encoder 110 is the same as the left audio signal (L), and the second signal is obtained by dividing the difference signal of the left signal (L) and the right signal (R) by 2.

0041When the similarity of the left signal (L) and the right signal (R) is equal to or less than the predetermined value (A), that is, in a case in which it is determined that the two signals are not similar, preferably, though not necessarily, the two signals are not encoded, and quantization is performed for each channel, or Mid/Side (M/S) encoding is performed. FIG. 3 illustrates the M/S encoding method. In the M/S encoding, the left signal (L) and the right signal (R) can be encoded into a first signal and a second signal according to the following equation 3: <maths id="math0003" num="(3)"><math display="block"><mrow><mrow><mo>[</mo><mrow><mtable columnalign="left"><mtr columnalign="left"><mtd columnalign="left"><mrow><mi mathvariant="italic">first signal</mi></mrow></mtd></mtr><mtr columnalign="left"><mtd columnalign="left"><mrow><mi mathvariant="italic">second signal</mi></mrow></mtd></mtr></mtable></mrow><mo>]</mo></mrow><mo>=</mo><mrow><mo>[</mo><mrow><mtable><mtr><mtd><mn>1</mn></mtd><mtd><mn>1</mn></mtd></mtr><mtr><mtd><mn>1</mn></mtd><mtd><mrow><mo>−</mo><mn>1</mn></mrow></mtd></mtr></mtable></mrow><mo>]</mo></mrow><mrow><mo>[</mo><mrow><mtable columnalign="left"><mtr columnalign="left"><mtd columnalign="left"><mi mathvariant="italic">L</mi></mtd></mtr><mtr columnalign="left"><mtd columnalign="left"><mi>R</mi></mtd></mtr></mtable></mrow><mo>]</mo></mrow></mrow></math><img file="EP1686562A2_D0003.tif" /></maths>

0042According to equation 3, in the M/S encoding, the sum signal and the difference signal of the left signal (L) and the right signal (R) are generated such that the stereo signals are encoded.

0043FIG. 4 is a graph illustrating an embodiment of the ratio of mean powers between a left audio signal and a right audio signal. Since the ratios of the mean powers between the two channels, illustrated in FIG. 4, include values close to 0 and 8, which are distant from 1, it can be seen that the similarity between the left audio signal and the right audio signal is low. Accordingly, because the illustrated stereo signals include such dissimilar stereo components, it is preferable, though not necessary, that each channel of the left audio signal and the right audio signal is quantized.

0044FIG. 5 is a graph illustrating another embodiment of the ratio of mean powers between a left audio signal and a right audio signal. Since the ratios of the mean powers between the two channels, illustrated in FIG. 5, include values that are very close to 1, it can be seen that the similarity between the left audio signal and the right audio signal is high. Accordingly, because the shown stereo signals include such similar components that they are similar to mono components, it is preferable, though not necessary, that the left audio signal and the right audio signal are encoded into a first signal and a second signal according to the US encoding method described above in order to remove redundant components, and then quantized.

0045FIG. 6 is a graph illustrating distribution changes of a left audio signal and a first signal according to the US encoding, and illustrates the obtained SR_Index of the first signal and the left audio signal relative to one frequency band. The bigger the obtained SR_Index is, the less weight a signal included in the corresponding frequency band has in the entire signal. Accordingly, it can be seen that in the case in which the left audio signal is L/S encoded into a first signal, the weight of the corresponding frequency band increases.

0046FIG. 7 is a graph illustrating distribution changes of a right audio signal and a second signal according to the US encoding, and illustrates the obtained SR_Index of the second signal and the right audio signal relative to one frequency band. According to the graph, it can be seen that in the case in which the combination of the right audio signal and the left audio signal is US encoded into a second signal, the weight of the frequency band of the second signal is reduced much more than that of the right audio signal.

0047According to FIGS. 6 and 7, in the case in which the similarity of the left audio signal and the right audio signal is high, by performing US encoding, redundant information between channels is removed such that the number of bits for the signal can be reduced.

0048A method of decoding multi-channel signals encoded by the encoding method described above will now be explained. The stereo signals encoded by using equation 1 can be decoded into the left audio signal (L) and the right audio signal (R) by using equation 4: <maths id="math0004" num="(4)"><math display="block"><mrow><mrow><mo>[</mo><mrow><mtable columnalign="left"><mtr columnalign="left"><mtd columnalign="left"><mi>L</mi></mtd></mtr><mtr columnalign="left"><mtd columnalign="left"><mi>R</mi></mtd></mtr></mtable></mrow><mo>]</mo></mrow><mo>=</mo><mfrac><mrow><mn>1</mn></mrow><mrow><mi>x</mi><mi>z</mi></mrow></mfrac><mrow><mo>[</mo><mrow><mtable><mtr><mtd><mi>z</mi></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mrow><mo>−</mo><mi>y</mi></mrow></mtd><mtd><mi>x</mi></mtd></mtr></mtable></mrow><mo>]</mo></mrow><mrow><mo>[</mo><mrow><mtable columnalign="left"><mtr columnalign="left"><mtd columnalign="left"><mrow><mi mathvariant="italic">first signal</mi></mrow></mtd></mtr><mtr columnalign="left"><mtd columnalign="left"><mrow><mi mathvariant="italic">second signal</mi></mrow></mtd></mtr></mtable></mrow><mo>]</mo></mrow></mrow></math><img file="EP1686562A2_D0004.tif" /></maths>

0049The stereo signals encoded by using equation 2 can be decoded into the left audio signal (L) and the right audio signal (R) by using equation 5: <maths id="math0005" num="(5)"><math display="block"><mrow><mrow><mo>[</mo><mrow><mtable columnalign="left"><mtr columnalign="left"><mtd columnalign="left"><mi>L</mi></mtd></mtr><mtr columnalign="left"><mtd columnalign="left"><mi>R</mi></mtd></mtr></mtable></mrow><mo>]</mo></mrow><mo>=</mo><mrow><mo>[</mo><mrow><mtable><mtr><mtd><mn>1</mn></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>1</mn></mtd><mtd><mrow><mo>−</mo><mn>2</mn></mrow></mtd></mtr></mtable></mrow><mo>]</mo></mrow><mrow><mo>[</mo><mrow><mtable columnalign="left"><mtr columnalign="left"><mtd columnalign="left"><mrow><mi mathvariant="italic">first signal</mi></mrow></mtd></mtr><mtr columnalign="left"><mtd columnalign="left"><mrow><mi mathvariant="italic">second signal</mi></mrow></mtd></mtr></mtable></mrow><mo>]</mo></mrow></mrow></math><img file="EP1686562A2_D0005.tif" /></maths>

0050The stereo signals encoded by using equation 3 can be decoded into the left audio signal (L) and the right audio signal (R) by using equation 6: <maths id="math0006" num="(6)"><math display="block"><mrow><mrow><mo>[</mo><mrow><mtable columnalign="left"><mtr columnalign="left"><mtd columnalign="left"><mi>L</mi></mtd></mtr><mtr columnalign="left"><mtd columnalign="left"><mi>R</mi></mtd></mtr></mtable></mrow><mo>]</mo></mrow><mo>=</mo><mrow><mo>[</mo><mrow><mtable><mtr><mtd><mrow><mn>0.5</mn></mrow></mtd><mtd><mrow><mn>0.5</mn></mrow></mtd></mtr><mtr><mtd><mrow><mn>0.5</mn></mrow></mtd><mtd><mrow><mo>−</mo><mn>0.5</mn></mrow></mtd></mtr></mtable></mrow><mo>]</mo></mrow><mrow><mo>[</mo><mrow><mtable columnalign="left"><mtr columnalign="left"><mtd columnalign="left"><mrow><mi mathvariant="italic">first signal</mi></mrow></mtd></mtr><mtr columnalign="left"><mtd columnalign="left"><mrow><mi mathvariant="italic">second signal</mi></mrow></mtd></mtr></mtable></mrow><mo>]</mo></mrow></mrow></math><img file="EP1686562A2_D0006.tif" /></maths>

0051Though the method of encoding stereo signals formed with the left audio signal and the right audio signal is explained above, the present invention can also be applied to multi-channel signals from three or more channels. In the case in which multi-channel signals having 3 or more channels are encoded, it is preferable, though not necessary, that the signals are encoded into a first signal having information regarding only a first channel signal preset among the multi-channel signals, and a second signal having information regarding the first channel signal and a second channel signal preset among the signals.

0052Also, though the methods of encoding and/or decoding multi-channel audio signals are explained above, the present invention can also be applied to a method of encoding and/or decoding multi-channel video signals.

0053In addition to the above-described embodiments, the method of the present invention can also be implemented by executing computer readable code/instructions in/on a medium, e.g., a computer readable medium. The medium can correspond to any medium/media permitting the storing and/or transmission of the computer readable code. The code/instructions may form a computer program.

0054The computer readable code/instructions can be recorded/transferred on a medium in a variety of ways, with examples of the medium including magnetic storage media (e.g., ROM, floppy disks, hard disks, etc.), optical recording media (e.g., CD-ROMs, or DVDs), and storage/transmission media such as carrier waves, as well as through the Internet, for example. The medium may also be a distributed network, so that the computer readable code/instructions is stored/transferred and executed in a distributed fashion. The computer readable code/instructions may be executed by one or more processors.

0055According to the method, and apparatus to perform the method, of encoding and/or decoding multi-channel signals as described above, when multi-channel signals are encoded, by encoding the multi-channel signals according to the similarity between a right channel signal and a left channel signal, redundant information between channels can be removed, and the signal can be encoded with less bits.

0056Although the similarity can be calculated based on whether the ratio of masking thresholds, mean power, or scale factor falls within the predetermined range, it is also possible to directly encode the first and second signals using the first channel signal for the first signal and a combination of the first and second channel signals for the second channels when the respective ratio falls in the respective range without calculating the similarity.

0057Although a few embodiments of the present invention have been shown and described, it would be appreciated by those skilled in the art that changes may be made in these embodiments without departing from the principles of the invention, the scope of which is defined in the claims and their equivalents.