Signal analysis device, signal control device, its system, method, and program

APPLICABLE FIELD IN THE INDUSTRY

0001The present invention relates to a signal analysis device, a signal control device, a system thereof, a method thereof, and a program thereof.

BACKGROUND ART

0002As a system for suppressing background noise of an input signal having a plurality of sound sources each of which is configured of desired sound and background noise, a noise suppression system (hereinafter, referred to as a noise suppressor) is known. The noise suppressor is a system for suppressing noise superposed upon a desired sound signal. The noise suppressor, as a rule, estimates a power spectrum of a noise component by employing an input signal converted in a frequency region, and subtracts the estimated power spectrum of the noise component from the input signal. With this, the noise coexisting in the desired sound signal is suppressed. In addition, these noise suppressors are applied also for the suppression of non-constant noise by successively estimating the power spectrum of the noise component. There exists, for example, the technique described in Patent document 1 as a prior art related to these noise suppressors (hereinafter, referred to as a first related prior art).

0003Normally, the noise suppressor of the first related prior art, which is utilized for communication, fulfils a function as a pretreatment of an encoder. An output of the noise suppressor is encoded, and is transmitted to a communication path. In a receiving unit, the signal is decoded, and an audible signal is generated. In a one-input noise suppression system employing the noise suppressor of the first related prior art, as a rule, residual noise that stays as a result of being not suppressed, and distortion of emphasized sound that is outputted are in a relation of trade-off. Reducing the residual noise leads to an increase in the distortion, and reducing the distortion leads to an increase in the residual noise. The best status of a balance between the residual noise and the distortion differs dependent upon individual users. However, with a configuration in which the noise suppressor exists in the upstream side of the encoder, namely, exists in a transmission unit, the user cannot adjust a balance between the residual noise and the distortion to its own taste.

0004As a noise suppressor assuming a configuration capable of solving this problem, a receiving side noise suppressor shown in <figref idref="DRAWINGS">FIG. 58</figref> disclosed in Non-patent document 1 is known (hereinafter, referred to as a second related prior art). In the configuration of the second related prior art, a noise suppression unit <b>9501</b> is included not in the transmission unit, but in the receiving unit. The noise suppression unit <b>9501</b> performs a process of suppressing the noise of the signal inputted from a decoder. This enables the user to adjust a balance between the residual noise and the distortion to its own taste.

0005Patent document 1: JP-P2002-204175A

0006Non-patent document 1: IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, 6.1-4, January 2007

DISCLOSURE OF THE INVENTION

Problems to be Solved by the Invention

0007The foregoing first related prior art causes a problem that the user cannot adjust a balance between the residual noise and the distortion to its own taste. The foregoing second related prior art exists as a means for solving this problem.

0008However, the second related prior art causes a problem that an arithmetic quantity of the receiving unit is augmented because the receiving unit performs an arithmetic operation of the noise suppressor, which the transmission unit performs in the first related prior art. In addition, the second related prior art causes a problem that a noise suppression function cannot be incorporated when an important function other than the function of the noise suppressor exists in the receiving unit, or a problem that the other functions cannot be incorporated due to the incorporation of the noise suppression function. Further, the arithmetic quantity of the receiving unit (or a reproduction unit) is much, which incurs a decline in a sound quality and in convenience due to a limit put to a receiver function. In addition, there is a problem that the configurations as well of the first related prior art and the second related prior art cannot be applied for general separation of the signal because they aim for separating the sound from the background noise.

0009Thereupon, the present invention has been accomplished in consideration of the above-mentioned problems, and an object thereof is to provide a signal analysis device, a signal control device, a system thereof, a method thereof, and a program thereof that are capable of configuring the receiving unit with a small arithmetic quantity, and of controlling the input signal for each component element.

Means to Solve the Problem

0010The present invention for solving the above-mentioned problem is a signal analysis device, comprising: a signal receiving unit for receiving an input signal including a plurality of component elements; and a signal analysis unit for generating analysis information indicative of a relation between said plurality of component elements from said input signal.

0011In addition, the present invention for solving the above-mentioned problem is a signal control device, comprising: a signal receiving unit for receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements; and a signal control unit for controlling a relation between said plurality of component elements based upon said analysis information.

0012In addition, the present invention for solving the above-mentioned problem is a signal control device, comprising: a signal receiving unit for receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements; and a signal control unit for receiving signal control information for controlling a specific component element, and controlling said plurality of component elements based upon said analysis information and said signal control information.

0013In addition, the present invention for solving the above-mentioned problem is a signal control device, comprising: a signal receiving unit for receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements; and an output signal generation unit for receiving component element rendering information for controlling an output of said component element, controlling said component element based upon said analysis information and said component element rendering information, and generating an output signal.

0014In addition, the present invention for solving the above-mentioned problem is a signal analysis method, comprising generating analysis information from an input signal including a plurality of component elements, said analysis information indicating a relation between said plurality of component elements.

0015In addition, the present invention for solving the above-mentioned problem is a signal control method, comprising: receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements; and controlling a relation between said plurality of component elements based upon said analysis information.

0016In addition, the present invention for solving the above-mentioned problem is a signal control method, comprising receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements, and signal control information for controlling a specific component element, and controlling said plurality of component elements based upon said analysis information and said signal control information.

0017In addition, the present invention for solving the above-mentioned problem is a signal control method, comprising: receiving a signal including a plurality of component elements, analysis information indicative of a relation between said plurality of component elements, and component element rendering information for controlling an output of said component element; and controlling said component element based upon said analysis information and said component element rendering information, and generating an output signal.

0018In addition, the present invention for solving the above-mentioned problem is a system, comprising: a signal receiving unit for receiving a signal including a plurality of component elements; a signal analysis unit for generating analysis information indicative of a relation between said plurality of component elements from said signal; a signal receiving unit for receiving said signal including said plurality of component elements, and said analysis information; and a signal control unit for controlling a relation between said plurality of component elements based upon said analysis information.

0019In addition, the present invention for solving the above-mentioned problem is a system, comprising: a signal receiving unit for receiving a signal including a plurality of component elements; a signal analysis unit for generating analysis information indicative of a relation between said plurality of component elements from said signal; a signal receiving unit for receiving said signal including said plurality of component elements, and said analysis information; and a signal control unit for receiving signal control information for controlling a specific component element, and controlling said plurality of component elements based upon said analysis information and said signal control information.

0020In addition, the present invention for solving the above-mentioned problem is a system, comprising: a signal receiving unit for receiving a signal including a plurality of component elements; a signal analysis unit for generating analysis information indicative of a relation between said plurality of component elements from said signal; a signal receiving unit for receiving said signal including said plurality of component elements, and said analysis information; and an output signal generation unit for receiving component element rendering information for controlling an output of said component element, controlling said component element based upon said analysis information and said component element rendering information, and generating an output signal.

0021In addition, the present invention for solving the above-mentioned problem is a signal analysis program, said program causing an information processing device to execute: a signal receiving process of receiving an input signal including a plurality of component elements; and a signal analysis process of generating analysis information indicative of a relation between said plurality of component elements from said input signal.

0022In addition, the present invention for solving the above-mentioned problem is a signal control program, comprising: a signal receiving process of receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements; and a signal control process of controlling a relation between said plurality of component elements based upon said analysis information.

0023In addition, the present invention for solving the above-mentioned problem is a signal control program, said program causing an information processing device to execute: a signal receiving process of receiving a signal including a plurality of component elements and analysis information indicative of a relation between said plurality of component elements; and a signal control process of receiving signal control information for controlling a specific component element, and controlling said plurality of component elements based upon said analysis information and said signal control information.

0024In addition, the present invention for solving the above-mentioned problem is a signal control program, comprising: a signal receiving process of receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements; and an output signal generation process of receiving component element rendering information for controlling an output of said component element, controlling said component element based upon said analysis information and said component element rendering information, and generating an output signal.

AN ADVANTAGEOUS EFFECT OF THE INVENTION

0025With the foregoing means, the present invention enables the receiving unit to reduce the arithmetic quantity relating to a signal analysis because the transmission unit analyzes the signal.

0026In addition, the present invention enables the receiving unit to control the input signal, which is configured of a plurality of the sound sources, for each component element corresponding to each sound source base upon signal analysis information coming from the transmission unit.

BRIEF DESCRIPTION OF THE DRAWINGS

0027<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram illustrating a first embodiment of the present invention.

0028<figref idref="DRAWINGS">FIG. 2</figref> shows a configuration example of an encoding unit <b>100</b>.

0029<figref idref="DRAWINGS">FIG. 3</figref> shows a configuration example of a decoding unit <b>150</b>.

0030<figref idref="DRAWINGS">FIG. 4</figref> shows a configuration example of a signal analysis unit <b>101</b>.

0031<figref idref="DRAWINGS">FIG. 5</figref> shows a configuration example of a signal control unit <b>151</b>.

0032<figref idref="DRAWINGS">FIG. 6</figref> shows a configuration example of an analysis information generation unit <b>121</b>.

0033<figref idref="DRAWINGS">FIG. 7</figref> shows a configuration example of a background sound information generation unit <b>202</b>.

0034<figref idref="DRAWINGS">FIG. 8</figref> shows a configuration example of a signal processing unit <b>172</b>.

0035<figref idref="DRAWINGS">FIG. 9</figref> shows a configuration example of a suppression coefficient re-configuration unit <b>250</b>.

0036<figref idref="DRAWINGS">FIG. 10</figref> shows a second configuration example of the background sound information generation unit <b>202</b>.

0037<figref idref="DRAWINGS">FIG. 11</figref> shows a second configuration example of the suppression coefficient re-configuration unit <b>250</b>.

0038<figref idref="DRAWINGS">FIG. 12</figref> shows a third configuration example of the background sound information generation unit <b>202</b>.

0039<figref idref="DRAWINGS">FIG. 13</figref> shows a second configuration example of the analysis information generation unit <b>121</b>.

0040<figref idref="DRAWINGS">FIG. 14</figref> shows a second configuration example of the signal processing unit <b>172</b>.

0041<figref idref="DRAWINGS">FIG. 15</figref> shows a configuration example of a suppression coefficient calculation unit <b>252</b>.

0042<figref idref="DRAWINGS">FIG. 16</figref> shows a third configuration example of the signal processing unit <b>172</b>.

0043<figref idref="DRAWINGS">FIG. 17</figref> is a block diagram illustrating a third embodiment of the present invention.

0044<figref idref="DRAWINGS">FIG. 18</figref> shows a configuration example of a signal control unit <b>350</b>.

0045<figref idref="DRAWINGS">FIG. 19</figref> shows a configuration example of a signal processing unit <b>360</b>.

0046<figref idref="DRAWINGS">FIG. 20</figref> shows a configuration example of a suppression coefficient re-configuration unit <b>450</b>.

0047<figref idref="DRAWINGS">FIG. 21</figref> shows a configuration example of a suppression coefficient modification unit <b>460</b>.

0048<figref idref="DRAWINGS">FIG. 22</figref> shows a second configuration example of a suppression coefficient modification unit <b>460</b>.

0049<figref idref="DRAWINGS">FIG. 23</figref> shows a third configuration example of a suppression coefficient modification unit <b>460</b>.

0050<figref idref="DRAWINGS">FIG. 24</figref> shows a second configuration example of the suppression coefficient re-configuration unit <b>450</b>.

0051<figref idref="DRAWINGS">FIG. 25</figref> shows a third configuration example of the suppression coefficient re-configuration unit <b>450</b>.

0052<figref idref="DRAWINGS">FIG. 26</figref> shows a second configuration example of the signal processing unit <b>360</b>.

0053<figref idref="DRAWINGS">FIG. 27</figref> shows a configuration example of a suppression coefficient calculation unit <b>452</b>.

0054<figref idref="DRAWINGS">FIG. 28</figref> shows a third configuration example of the signal processing unit <b>360</b>.

0055<figref idref="DRAWINGS">FIG. 29</figref> shows a second configuration example of the suppression coefficient calculation unit <b>452</b>.

0056<figref idref="DRAWINGS">FIG. 30</figref> is a block diagram illustrating a fifth embodiment of the present invention.

0057<figref idref="DRAWINGS">FIG. 31</figref> shows a configuration example of an output signal generation unit <b>550</b>.

0058<figref idref="DRAWINGS">FIG. 32</figref> shows a second configuration example of the output signal generation unit <b>550</b>.

0059<figref idref="DRAWINGS">FIG. 33</figref> shows a third configuration example of the output signal generation unit <b>550</b>.

0060<figref idref="DRAWINGS">FIG. 34</figref> shows a configuration example of a component element information conversion unit <b>563</b>.

0061<figref idref="DRAWINGS">FIG. 35</figref> shows a fourth configuration example of the output signal generation unit <b>550</b>.

0062<figref idref="DRAWINGS">FIG. 36</figref> shows a configuration example of a component element information conversion unit <b>655</b>.

0063<figref idref="DRAWINGS">FIG. 37</figref> is a block diagram illustrating a seventh embodiment of the present invention.

0064<figref idref="DRAWINGS">FIG. 38</figref> shows a configuration example of an output signal generation unit <b>750</b>.

0065<figref idref="DRAWINGS">FIG. 39</figref> shows a configuration example of a component element information conversion unit <b>760</b>.

0066<figref idref="DRAWINGS">FIG. 40</figref> shows a second configuration example of the output signal generation unit <b>750</b>.

0067<figref idref="DRAWINGS">FIG. 41</figref> shows a configuration example of a component element information conversion unit <b>761</b>.

0068<figref idref="DRAWINGS">FIG. 42</figref> is a block diagram illustrating a ninth embodiment of the present invention.

0069<figref idref="DRAWINGS">FIG. 43</figref> shows a configuration example of a signal analysis unit <b>900</b>.

0070<figref idref="DRAWINGS">FIG. 44</figref> shows a second configuration example of the signal analysis unit <b>900</b>.

0071<figref idref="DRAWINGS">FIG. 45</figref> shows a configuration example of an analysis information generation unit <b>911</b>.

0072<figref idref="DRAWINGS">FIG. 46</figref> shows a second configuration example of the analysis information generation unit <b>911</b>.

0073<figref idref="DRAWINGS">FIG. 47</figref> is a block diagram illustrating an eleventh embodiment of the present invention.

0074<figref idref="DRAWINGS">FIG. 48</figref> shows a configuration example of an encoding unit <b>1100</b>.

0075<figref idref="DRAWINGS">FIG. 49</figref> shows a configuration example of a signal analysis unit <b>1101</b>.

0076<figref idref="DRAWINGS">FIG. 50</figref> shows a configuration example of a decoding unit <b>1150</b>.

0077<figref idref="DRAWINGS">FIG. 51</figref> shows a configuration example of a signal control unit <b>1151</b>.

0078<figref idref="DRAWINGS">FIG. 52</figref> shows a second configuration example of the signal analysis unit <b>101</b>.

0079<figref idref="DRAWINGS">FIG. 53</figref> shows a second configuration example of the signal control unit <b>151</b>.

0080<figref idref="DRAWINGS">FIG. 54</figref> shows a third configuration example of the signal analysis unit <b>101</b>.

0081<figref idref="DRAWINGS">FIG. 55</figref> shows a third configuration example of the signal control unit <b>151</b>.

0082<figref idref="DRAWINGS">FIG. 56</figref> is a block diagram illustrating a twelfth embodiment of the present invention.

0083<figref idref="DRAWINGS">FIG. 57</figref> s a block diagram illustrating a thirteenth embodiment of the present invention.

0084<figref idref="DRAWINGS">FIG. 58</figref> is a block diagram illustrating the conventional example.

DESCRIPTION OF NUMERALS

0000<ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0000"><ul id="ul0002" list-style="none"><li id="ul0002-0001" num="0085"><b>1</b> transmission/receiving unit</li><li id="ul0002-0002" num="0086"><b>10</b>, <b>13</b> and <b>90</b> transmission units</li><li id="ul0002-0003" num="0087"><b>15</b>, <b>18</b>, <b>35</b>, <b>55</b>, and <b>75</b> receiving units</li><li id="ul0002-0004" num="0088"><b>100</b> and <b>1100</b> encoding units</li><li id="ul0002-0005" num="0089"><b>101</b>, <b>900</b>, and <b>1101</b> signal analysis units</li><li id="ul0002-0006" num="0090"><b>102</b> multiplexing unit</li><li id="ul0002-0007" num="0091"><b>110</b>, <b>120</b>, <b>171</b>, and <b>920</b> conversion units</li><li id="ul0002-0008" num="0092"><b>111</b> quantization unit</li><li id="ul0002-0009" num="0093"><b>121</b>, <b>911</b>, and <b>912</b> analysis information generation units</li><li id="ul0002-0010" num="0094"><b>150</b> and <b>1150</b> decoding units</li><li id="ul0002-0011" num="0095"><b>151</b>, <b>350</b>, and <b>1151</b> signal control units</li><li id="ul0002-0012" num="0096"><b>152</b> separation unit</li><li id="ul0002-0013" num="0097"><b>160</b> inverse quantization unit</li><li id="ul0002-0014" num="0098"><b>161</b> and <b>173</b> inverse conversion units</li><li id="ul0002-0015" num="0099"><b>172</b> and <b>360</b> signal processing units</li><li id="ul0002-0016" num="0100"><b>200</b> and <b>1020</b> background sound estimation units</li><li id="ul0002-0017" num="0101"><b>201</b>, <b>252</b>, and <b>452</b> suppression coefficient calculation units</li><li id="ul0002-0018" num="0102"><b>202</b> background sound information generation unit</li><li id="ul0002-0019" num="0103"><b>203</b> and <b>207</b> signal versus background sound ratio calculation units</li><li id="ul0002-0020" num="0104"><b>204</b> signal versus background sound ratio encoding unit</li><li id="ul0002-0021" num="0105"><b>205</b> background sound encoding unit</li><li id="ul0002-0022" num="0106"><b>250</b> and <b>450</b> suppression coefficient re-configuration units</li><li id="ul0002-0023" num="0107"><b>251</b>, <b>451</b>, and <b>470</b> multipliers</li><li id="ul0002-0024" num="0108"><b>253</b> subtractor</li><li id="ul0002-0025" num="0109"><b>260</b> suppression coefficient decoding unit</li><li id="ul0002-0026" num="0110"><b>261</b> signal versus background sound ratio decoding unit</li><li id="ul0002-0027" num="0111"><b>262</b> suppression coefficient conversion unit</li><li id="ul0002-0028" num="0112"><b>263</b> background sound decoding unit</li><li id="ul0002-0029" num="0113"><b>264</b> suppression coefficient generation unit</li><li id="ul0002-0030" num="0114"><b>460</b> suppression coefficient modification unit</li><li id="ul0002-0031" num="0115"><b>461</b> signal versus background sound ratio modification unit</li><li id="ul0002-0032" num="0116"><b>464</b> background sound modification unit</li><li id="ul0002-0033" num="0117"><b>471</b> comparison unit</li><li id="ul0002-0034" num="0118"><b>472</b> designated suppression coefficient control unit</li><li id="ul0002-0035" num="0119"><b>473</b> switch</li><li id="ul0002-0036" num="0120"><b>550</b> and <b>750</b> output signal generation units</li><li id="ul0002-0037" num="0121"><b>560</b> and <b>565</b> signal control units</li><li id="ul0002-0038" num="0122"><b>561</b>, <b>563</b>, <b>564</b>, <b>655</b>, <b>760</b>, and <b>761</b> component element information conversion units</li><li id="ul0002-0039" num="0123"><b>562</b> rendering unit</li><li id="ul0002-0040" num="0124"><b>651</b>, <b>653</b>, <b>851</b>, and <b>853</b> component element parameter generation units</li><li id="ul0002-0041" num="0125"><b>652</b> rendering information generation unit</li><li id="ul0002-0042" num="0126"><b>910</b> quantizing distortion calculation unit</li><li id="ul0002-0043" num="0127"><b>1200</b> signal separation analysis unit</li><li id="ul0002-0044" num="0128"><b>1201</b> separation filter encoding unit</li><li id="ul0002-0045" num="0129"><b>1202</b> separation filter decoding unit</li><li id="ul0002-0046" num="0130"><b>1203</b> filter</li><li id="ul0002-0047" num="0131"><b>1210</b> sound environment analysis unit</li><li id="ul0002-0048" num="0132"><b>1211</b> sound environment information encoding unit</li><li id="ul0002-0049" num="0133"><b>1212</b> sound environment information decoding unit</li><li id="ul0002-0050" num="0134"><b>1213</b> sound environment information processing unit</li><li id="ul0002-0051" num="0135"><b>1300</b> and <b>1301</b> computers</li><li id="ul0002-0052" num="0136"><b>2021</b> suppression coefficient encoding unit</li></ul></li></ul>

BEST MODE FOR CARRYING OUT THE INVENTION

0137Embodiments of the signal analysis control system of the present invention will be explained in details by making a reference to the accompanied drawings.

0138A first embodiment of the signal analysis control system of the present invention will be explained by making a reference to <figref idref="DRAWINGS">FIG. 1</figref>. The signal analysis control system of the present invention assumes a configuration in which a transmission unit <b>10</b> and a receiving unit <b>15</b> are connected via a transmission path. The transmission unit <b>10</b> receives an input signal that is configured of a plurality of the sound sources, and outputs a transmission signal. The transmission signal is inputted into the receiving unit <b>15</b> via the transmission path. The receiving unit <b>15</b> receives the transmission signal, and outputs an output signal. Further, the transmission unit, the transmission path, and the receiving unit could be a recording unit, a storage medium, and a reproduction unit, respectively.

0139The transmission unit <b>10</b> is configured of an encoding unit <b>100</b>, a signal analysis unit <b>101</b>, and a multiplexing unit <b>102</b>. The input signal is inputted into the encoding unit <b>100</b> and the signal analysis unit <b>101</b>. The signal analysis unit <b>101</b> calculates analysis information indicative of a relation of a component element that corresponds to each sound source being included in the input signal. The signal analysis unit <b>101</b> outputs the analysis information to the multiplexing unit <b>102</b>. The encoding unit <b>100</b> encodes the input signal. The encoding unit <b>100</b> outputs the encoded signal to the multiplexing unit <b>102</b>. The multiplexing unit <b>102</b> multiplexes the encoded signal being inputted from the encoding unit <b>100</b>, and the analysis information being inputted from the signal analysis unit <b>101</b>. The multiplexing unit <b>102</b> outputs the multiplexed signal to the transmission path as a transmission signal.

0140The receiving unit <b>15</b> is configured of a decoding unit <b>150</b>, a signal control unit <b>151</b>, and a separation unit <b>152</b>. At first, the transmission signal is inputted into the separation unit <b>152</b>. The separation unit <b>152</b> separates the transmission signal into a main signal and the analysis information. Continuously, the separation unit <b>152</b> outputs the main signal to the decoding unit <b>150</b>, and outputs the analysis information to the signal control unit <b>151</b>, respectively. The decoding unit <b>150</b> decodes the main signal, and generates the decoded signal. And, the decoding unit <b>150</b> outputs the decoded signal to the signal control unit <b>151</b>. Herein, the decoded signal is configured of general plural sound sources. The signal control unit <b>151</b> manipulates the decoded signal received from the decoding unit <b>150</b> for each component element that corresponds to each sound source, based upon the analysis information received from the separation unit <b>152</b>. The signal control unit <b>151</b> outputs the manipulated signal as an output signal. The signal control unit <b>151</b> may manipulate the decoded signal with the component element group, which is configured of a plurality of the component elements, defined as a unit instead of the component element that corresponds to each sound source.

0141Continuously, a configuration example of the encoding unit <b>100</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 2</figref>. The encoding unit <b>100</b> receives the input signal, and outputs the encoded signal. The encoding unit <b>100</b> is configured of a conversion unit <b>110</b> and a quantization unit <b>111</b>. At first, the input signal is inputted into the conversion unit <b>110</b>. Next, the conversion unit <b>110</b> decomposes the input signal into frequency components, and generates a first converted signal. The conversion unit <b>110</b> outputs the first converted signal to the quantization unit <b>111</b>. And, the quantization unit <b>111</b> quantizes the first converted signal, and outputs it as an encoded signal.

0142The conversion unit <b>110</b> configures one block by collecting a plurality of input signal samples, and applies a frequency conversion for this block. As an example of the frequency conversion, a Fourier transform, a cosine transform, a KL (Karhunen Loeve) transform, etc. are known. The technology related to a specific arithmetic operation of these transforms, and its properties are disclosed in Non-patent document 2 (DIGITAL CODING OF WAVEFORMS, PRINCIPLES AND APPLICATIONS TO SPEECH AND VIDEO, PRENTICE-HALL, 1990).

0143The conversion unit <b>110</b> also can apply the foregoing transforms for a result obtained by weighting one block of the input signal samples with a window function. As such a window function, the window functions such as a Hamming window, a Hanning (Hann) window, a Kaiser window, and a Blackman window are known. Further, more complicated window functions can be employed. The technology related to these window functions is disclosed in Non-patent document 3 (DIGITAL SIGNAL PROCESSING, PRENTICE-HALL, 1975) and Non-patent document 4 (MULTIRATE SYSTEMS AND FILTER BANKS, PRENTICE-HALL, 1993).

0144An overlap of each block may be permitted at the moment that the conversion unit <b>110</b> configures one block from a plurality of the input signal samples. For example, with the case of applying an overlap of 30% of a block length, the last 30% of the signal sample belonging to a certain block is repeatedly employed in a plurality of the blocks as the first 30% of the signal sample belonging to the next block. The technology relating to the blocking involving the overlap and the conversion is disclosed in the Non-patent document 2.

0145In addition, the conversion unit <b>110</b> may be configured of a band-division filter bank. The band-division filter bank is configured of a plurality of band-pass filters. The band-division filter bank divides the received input signal into a plurality of frequency bands, and outputs them to the quantization unit <b>111</b>. An interval of each frequency band of the band-division filter bank could be equal in some cases, and unequal in some cases. Band-dividing the input signal at an unequal interval makes it possible to lower/raise a time resolution, that is, the time resolution can be lowered by dividing the input signal into narrows bands with regard to a low-frequency area, and the time resolution can be raised by dividing the input signal into wide bands with regard to a high-frequency area. As a typified example of the unequal-interval division, there exists an octave division in which the band gradually halves toward the low-frequency area, a critical band division that corresponds to an auditory feature of a human being, or the like. The technology relating to the band-division filter bank and its design method is disclosed in the Non-patent document 4.

0146The quantization unit <b>111</b> removes redundancy of the inputted signal, and outputs the encoded signal. As a method of removing redundancy, there exists the method of taking a control such that a correlation between the inputted signals is minimized. In addition, the signal component that is not auditorily recognized may be removed by utilizing the auditory feature such as a masking effect. As a quantization method, the quantization methods such as a linear quantization method and a non-linear quantization method are known. The redundancy of the quantized signal can be furthermore removed by employing Huffman coding etc.

0147A configuration example of the decoding unit <b>150</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 3</figref>. The decoding unit <b>150</b> receives the main signal, and outputs the decoded signal. The decoding unit <b>150</b> is configured of an inverse quantization unit <b>160</b> and an inverse conversion unit <b>161</b>. The inverse quantization unit <b>160</b> inverse-quantizes the received main signal of each frequency, and generates the first converted signal that is configured of a plurality of the frequency components. And, the inverse quantization unit <b>160</b> outputs the first converted signal to the inverse conversion unit <b>161</b>. The inverse conversion unit <b>161</b> inverse-converts the first converted signal, and generates the decoded signal. And, the inverse conversion unit <b>161</b> outputs the decoded signal.

0148As an inverse conversion that the inverse conversion unit <b>161</b> applies, the inverse conversion corresponding to the conversion that the conversion unit <b>110</b> applies is preferably selected. For example, when the conversion unit <b>110</b> configures one block by collecting a plurality of the input signal samples, and applies the frequency conversion for this block, the inverse conversion unit <b>161</b> applies the corresponding inverse conversion for the samples of which number is identical. Further, when an overlap of each block is permitted at the moment that the conversion unit <b>110</b> configures one block by collecting a plurality of the input signal samples, the inverse conversion unit <b>161</b>, responding to this, applies an identical overlap for the inverse-converted signal. In addition, when the conversion unit <b>110</b> is configured of the band-division filter bank, the inverse conversion unit <b>161</b> is configured of a band-synthesis filter bank. The technology relating to the band-synthesis filter bank and its design method is disclosed in the Non-patent document 4.

0149While the encoding unit <b>100</b> of <figref idref="DRAWINGS">FIG. 2</figref> and the decoding unit <b>150</b> of <figref idref="DRAWINGS">FIG. 3</figref> were explained on the assumption that conversion/encoding having the conversion unit included therein was applied, a pulse code modulation (PCM), an adaptive differential pulse code modulation (ADPCM), and analysis-by-synthesis coding, which is typified by CELP etc., in addition hereto may be applied. The technology relating to the PCM/ADPCM is disclosed in the Non-patent document 2. Further, the technology relating to the CELP is disclosed in Non-patent document 5 (IEEE INTERNATIONAL CONFERENCE ON ACOUSTIC, SPEECH, AND SIGNAL PROCESSING, 25.1.1, March 1985, pp. 937-940)

0150Further, the encoding unit <b>100</b> may output the input signal as it stands to the multiplexing unit <b>102</b> without performing the encoding process therefor, and the decoding unit <b>150</b> may input the main signal as it stands into the signal control unit <b>151</b> without performing the decoding process therefor. This configuration makes it possible to eliminate the distortion of the signal accompanied by the encoding/decoding process. In addition, a configuration may be made so that the encoding unit <b>100</b> and the decoding unit <b>150</b> perform a distortion-less compression/expansion process. This configuration enables the signal control unit <b>151</b> to receive the decoded signal without distorting the input signal.

0151A configuration example of the signal analysis unit <b>101</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 4</figref>. The signal analysis unit <b>101</b> receives the input signal, and outputs the analysis information. The signal analysis unit <b>101</b> is configured of a conversion unit <b>120</b> and an analysis information generation unit <b>121</b>. The conversion unit <b>120</b> decomposes the received input signal into the frequency components, and generates the second converted signal. The conversion unit <b>120</b> outputs the second converted signal to the analysis information generation unit <b>121</b>. The analysis information generation unit <b>121</b> decomposes the second converted signal into the component elements that correspond to the sound source, and generates the analysis information indicative of a relation between a plurality of the component elements. And, the analysis information generation unit <b>121</b> outputs the analysis information. Further, the analysis information generation unit <b>121</b> may decompose the second converted signal into component element groups each of which is configured of a plurality of the component elements, and calculate the analysis information. The signal analysis unit <b>101</b> may encode the analysis information when the redundancy exists in the analysis information. This makes it possible to minimize the redundancy of the analysis information. The technique of the conversion in the conversion unit <b>110</b> may be employed for the technique of the conversion in the conversion unit <b>120</b>.

0152A configuration example of the signal control unit <b>151</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 5</figref>. The signal control unit <b>151</b> receives the decoded signal and the analysis information, and outputs the output signal. The signal control unit <b>151</b> is configured of a conversion unit <b>171</b>, a signal processing unit <b>172</b>, and an inverse conversion unit <b>173</b>. The conversion unit <b>171</b> decomposes the received decoded signal into the frequency components, and generates the second converted signal. The signal control unit <b>151</b> outputs the second converted signal to the signal processing unit <b>172</b>. The signal processing unit <b>172</b> decomposes the second converted signal into the component elements that correspond to the sound source by employing the analysis information, changes a relation between a plurality of the component elements, and generates the modified decoded signal. And, the signal processing unit <b>172</b> outputs the modified decoded signal to the inverse conversion unit <b>173</b>. Further, the signal processing unit <b>172</b> may decompose the second converted signal into component element groups each of which is configured of a plurality of the component elements, and change a relation between a plurality of the component elements. The signal processing unit <b>172</b> performs the above-mentioned process after finishing the decoding process in the case that the analysis information has been encoded in the analysis information generation unit <b>121</b>. The inverse conversion unit <b>173</b> inverse-converts the modified decoded signal, and generates the output signal. And, the inverse conversion unit <b>173</b> outputs the output signal. The technique of the inverse conversion in the inverse conversion unit <b>161</b> can be employed for the technique of the inverse conversion in the inverse conversion unit <b>173</b>.

0153As explained above, the first embodiment of the present invention enables the receiving unit to control the input signal, which is configured of a plurality of the sound sources, for each component element corresponding to each sound source based upon the analysis information of the input signal being outputted from the transmission unit. In addition, the receiving unit can curtail the arithmetic quantity relating to the signal analysis because the transmission unit analyses the signal.

0154Continuously, a second embodiment of the present invention will be explained in details. The second embodiment of the present invention is for controlling the input signal that is configured of objective sound and background sound as a sound source. A configuration of the second embodiment is represented in <figref idref="DRAWINGS">FIG. 1</figref>. The second embodiment differs from the first embodiment in the configurations of the signal analysis unit <b>101</b> and the signal control unit <b>151</b>. The signal analysis unit <b>101</b> of the second embodiment receives the input signal that is configured of the objective sound and the background sound, and outputs the information indicative of a relation between the objective sound and the background sound as analysis information to the multiplexing unit <b>102</b>. Further, the signal control unit <b>151</b> receives the decoded signal and the analysis information, generates the output signal by controlling the objective sound and the background sound, and outputs it.

0155In a first example, the signal analysis unit <b>101</b> calculates a suppression coefficient as analysis information. The suppression coefficient is a coefficient for suppressing the background sound, which is caused to act upon the input signal that is configured of the objective sound and the background sound. The signal control unit <b>151</b> controls the decoded signal by employing the suppression coefficient. A configuration of the signal analysis unit <b>101</b> is represented in <figref idref="DRAWINGS">FIG. 4</figref>. A configuration of the analysis information calculation unit <b>121</b> of this example differs from that of the analysis information calculation unit <b>121</b> of the first embodiment. Further, the signal control unit <b>151</b> of this embodiment is represented in <figref idref="DRAWINGS">FIG. 5</figref>. A configuration of the signal control unit <b>151</b> of this example differs from that of the signal control unit <b>151</b> of the first embodiment.

0156A configuration example of the analysis information generation unit <b>121</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 6</figref>. The analysis information generation unit <b>121</b> receives the second converted signal, and outputs the suppression coefficient as analysis information. The analysis information generation unit <b>121</b> is configured of a background sound estimation unit <b>200</b> and a background sound information generation unit <b>202</b>. The background sound estimation unit <b>200</b> receives the second converted signal, estimates the background sound, and generates information of the background sound. The background sound estimation unit <b>200</b> outputs the information of the background sound to the background sound information generation unit <b>202</b>. As information of the background sound, there exist an amplitude absolute value and an energy value of the background sound, an amplitude ratio and an energy ratio of the background sound and the input signal, an average value thereof, and so on. The background sound information generation unit <b>202</b> receives the second converted signal and the information of the background sound. The background sound information generation unit <b>202</b> calculates the suppression coefficient based upon the second converted signal and the information of the background sound. And, the background sound information generation unit <b>202</b> outputs the suppression coefficient or the encoded suppression coefficient as analysis information.

0157A configuration example of the background sound information generation unit <b>202</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 7</figref>. The background sound information generation unit <b>202</b> receives the second converted signal and the information of the background sound, and outputs the suppression coefficient as analysis information. The background sound information generation unit <b>202</b> is configured of a suppression coefficient calculation unit <b>201</b> and a suppression coefficient encoding unit <b>2021</b>. The suppression coefficient calculation unit <b>201</b> calculates an appropriate suppression coefficient for suppressing the background sound by employing the second converted signal and the information of the background sound. And, the suppression coefficient calculation unit <b>201</b> outputs the suppression coefficient to the suppression coefficient encoding unit <b>2021</b>. As a technology relating to the method of calculating the suppression coefficient, the method founded upon minimum mean square error short-time spectral amplitude (MMSE STSA) is disclosed in Non-patent document 6 (IEEE TRANSACTIONS ON ACOUSTIC, SPEECH, AND SIGNAL PROCESSING, VOL. 32, NO. 6, pp. 1109-1121, December 1984), the method founded upon minimum mean square error log spectral amplitude (MMSE LSA) is disclosed in Non-patent document 7 (IEEE TRANSACTIONS ON ACOUSTIC, SPEECH, AND SIGNAL PROCESSING, VOL. 33, NO. 2, pp. 443-445, April 1985, and the method founded upon minimum mean square error short-time spectral amplitude (MMSE STSA), or the like is disclosed in Non-patent document 8 (EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, VOLUME 2005, Issue 7, July 2005, pp. 1110-1126).

0158The suppression coefficient encoding unit <b>2021</b> receives and encodes the suppression coefficient. The suppression coefficient encoding unit <b>2021</b> outputs the encoded suppression coefficient as analysis information. The suppression coefficient encoding unit <b>2021</b> subjects the suppression coefficient to the quantization such as linear quantization and non-linear quantization, and outputs the suppression coefficient encoded with the Huffman coding etc. This makes it possible to remove the redundancy of the suppression coefficient. Further, when the information quantity does not need to be curtailed, the suppression coefficient encoding unit <b>2021</b> may output the suppression coefficient as analysis information without performing these encoding processes.

0159Next, a configuration example of the signal processing unit <b>172</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 8</figref>. The signal processing unit <b>172</b> receives the second converted signal and the analysis information, and outputs the modified decoded signal. The signal processing unit <b>172</b> is configured of a suppression coefficient re-configuration unit <b>250</b> and a multiplier <b>251</b>. The second converted signal is inputted into the multiplier <b>251</b>, and the analysis information is inputted into the suppression coefficient re-configuration unit <b>250</b>. The suppression coefficient re-configuration unit <b>250</b> re-configures the suppression coefficient by employing the inputted analysis information, and outputs the suppression coefficient to the multiplier <b>251</b>. The multiplier <b>251</b> multiplies the second converted signal by the suppression coefficient, and generates the modified decoded signal. The multiplier <b>251</b> outputs the modified decoded signal to the inverse conversion unit <b>173</b>.

0160A configuration example of the suppression coefficient re-configuration unit <b>250</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 9</figref>. The suppression coefficient re-configuration unit <b>250</b> receives the encoded suppression coefficient as analysis information, and outputs the suppression coefficient. The suppression coefficient re-configuration unit <b>250</b> is configured of a suppression coefficient decoding unit <b>260</b>. The suppression coefficient decoding unit <b>260</b> decodes the received suppression coefficient. The suppression coefficient decoding unit <b>260</b> outputs the suppression coefficient without performing the decoding process when the suppression coefficient has not been encoded.

0161In a second example, the signal analysis unit <b>101</b> calculates a signal versus background sound ratio as analysis information. The signal control unit <b>151</b>, responding to this, calculates the suppression coefficient based upon the signal versus background sound ratio. The signal control unit <b>151</b> controls the decoded signal by employing this suppression coefficient. With this, the signal of which the background sound has been suppressed can be obtained from the input signal that is configured of the objective sound and the background sound.

0162At first, the signal analysis unit <b>101</b> will be explained. The signal analysis unit <b>101</b>, similarly to the case of the first example, is represented in <figref idref="DRAWINGS">FIG. 4</figref>. Upon comparing this example with the first example, the former differs from the latter in a configuration of the background sound information generation unit <b>202</b> being included in the analysis information generation unit <b>121</b> shown in <figref idref="DRAWINGS">FIG. 6</figref>.

0163A configuration example of the background sound information generation unit <b>202</b> of this example will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 10</figref>. The background sound information generation unit <b>202</b> receives the second converted signal and the information of the background sound, and outputs the encoded signal versus background sound ratio as analysis information. The background sound information generation unit <b>202</b> is configured of a suppression coefficient calculation unit <b>201</b>, a signal versus background sound ratio calculation unit <b>203</b>, and a signal versus background sound ratio encoding unit <b>204</b>. The suppression coefficient calculation unit <b>201</b> calculates an appropriate suppression coefficient for suppressing the background sound by employing the second converted signal and the information of the background sound. And, the suppression coefficient calculation unit <b>201</b> outputs the suppression coefficient to the signal versus background sound ratio calculation unit <b>203</b>. As a method of calculating the suppression coefficient, the calculation method of the suppression coefficient calculation unit <b>201</b> of the first example shown in <figref idref="DRAWINGS">FIG. 7</figref> can be employed. The signal versus background sound ratio calculation unit <b>203</b> calculates a signal versus background sound ratio R by employing an inputted suppression coefficient G. Upon defining the input signal as X, the objective sound as S, and the background sound as N, the following relation holds.

0000<maths id="MATH-US-00001" num="00001"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>X</mi><mo>=</mo><mrow><mi>S</mi><mo>+</mo><mi>N</mi></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>]</mo></mrow></mtd></mtr><mtr><mtd><mrow><mi>S</mi><mo>=</mo><mrow><mi>G</mi><mo>×</mo><mi>X</mi></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>2</mn></mrow><mo>]</mo></mrow></mtd></mtr><mtr><mtd><mrow><mi>R</mi><mo>=</mo><mfrac><msup><mi>S</mi><mn>2</mn></msup><msup><mi>N</mi><mn>2</mn></msup></mfrac></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>3</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0001.tif" />

0164R based upon this definition is known as a prior signal-to noise ratio (prior SNR) when the background sound is noise. Upon substituting [Numerical equation 1] and [Numerical equation 2] into [Numerical equation 3], the following equation is yielded.

0000<maths id="MATH-US-00002" num="00002"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>R</mi><mo>=</mo><mrow><mfrac><msup><mi>S</mi><mn>2</mn></msup><msup><mrow><mo>(</mo><mrow><mi>X</mi><mo>-</mo><mi>S</mi></mrow><mo>)</mo></mrow><mn>2</mn></msup></mfrac><mo>=</mo><mfrac><msup><mi>G</mi><mn>2</mn></msup><mrow><mn>1</mn><mo>-</mo><msup><mi>G</mi><mn>2</mn></msup></mrow></mfrac></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>4</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0002.tif" />

0165The signal versus background sound ratio calculation unit <b>203</b> outputs the calculated signal versus background sound ratio R to the signal versus background sound ratio encoding unit <b>204</b>. The signal versus background sound ratio encoding unit <b>204</b> encodes the inputted signal versus background sound ratio R. The signal versus background sound ratio encoding unit <b>204</b> outputs the encoded signal versus background sound ratio R as analysis information. With regard to the details of the encoding process, an encoding process similar to the encoding process being performed in the suppression coefficient encoding unit <b>2021</b> can be employed. This makes it possible to remove the redundancy of the signal versus background sound ratio R. Further, when the information quantity does not need to be curtailed, the signal versus background sound ratio encoding unit <b>204</b> may output the signal versus background sound ratio as analysis information without performing the encoding process for the signal versus background sound ratio R.

0166Next, the signal control unit <b>151</b> of this example will be explained in details. The signal control unit <b>151</b>, similarly to the case of the first example, is represented in <figref idref="DRAWINGS">FIG. 5</figref>. This example differs from the first example in a configuration of the suppression coefficient re-configuration unit <b>250</b> being included in the signal processing unit <b>172</b> shown in <figref idref="DRAWINGS">FIG. 8</figref>.

0167A configuration example of the suppression coefficient re-configuration unit <b>250</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 11</figref>. The suppression coefficient re-configuration unit <b>250</b> receives the encoded signal versus background sound ratio R as analysis information, and outputs the suppression coefficient G. The suppression coefficient re-configuration unit <b>250</b> is configured of a signal versus background sound ratio decoding unit <b>261</b> and a suppression coefficient conversion unit <b>262</b>. The signal versus background sound ratio decoding unit <b>261</b> decodes the encoded signal versus background sound ratio R that has been received, and outputs the signal versus background sound ratio R to the suppression coefficient conversion unit <b>262</b>. The signal versus background sound ratio decoding unit <b>261</b> outputs the signal versus background sound ratio without performing the decoding operation when the signal versus background sound ratio R has not been encoded. The suppression coefficient conversion unit <b>262</b> converts the signal versus background sound ratio R into the suppression coefficient G. And, the suppression coefficient conversion unit <b>262</b> has the suppression coefficient G as an output. The conversion from R to G is made based upon [Numerical equation 4]. Upon solving [Numerical equation 4] for G, the following equation is yielded.

0000<maths id="MATH-US-00003" num="00003"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>G</mi><mo>=</mo><msqrt><mfrac><mi>R</mi><mrow><mn>1</mn><mo>+</mo><mi>R</mi></mrow></mfrac></msqrt></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>5</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0003.tif" />

0168Further, another configuration example of the background sound information generation unit <b>202</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 12</figref>. Upon making a comparison with the background sound information generation unit <b>202</b> shown in <figref idref="DRAWINGS">FIG. 10</figref>, the background sound information generation unit <b>202</b> of this configuration example differs in a point of not including the suppression coefficient calculation unit <b>201</b>. In the configuration of the background sound information generation unit <b>202</b> shown in <figref idref="DRAWINGS">FIG. 12</figref>, [Numerical equation 6] is employed as a definition of the signal versus background sound ratio R instead of [Numerical equation 3]. R based upon this definition is known as a posterior signal-to noise ratio (posterior SNR) when the background sound is noise.

0000<maths id="MATH-US-00004" num="00004"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>R</mi><mo>=</mo><mfrac><msup><mi>X</mi><mn>2</mn></msup><msup><mi>N</mi><mn>2</mn></msup></mfrac></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>6</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0004.tif" />

0169That is, this example is configured to employ the posterior SNR as analysis information instead of the prior SNR when the background sound is noise. R of [Numerical equation 6], which does not demand the suppression coefficient G, is calculated from the input signal and the background sound. This enables the signal versus background sound ratio calculation unit <b>207</b> to calculate the signal versus background sound ratio based upon the second converted signal and the information of the background sound. And, the signal versus background sound ratio calculation unit <b>207</b> outputs the signal versus background sound ratio to the signal versus background sound ratio encoding unit <b>204</b>. An operation of the signal versus background sound ratio encoding unit <b>204</b> is similar to that of the signal versus background sound ratio encoding unit <b>204</b> shown in <figref idref="DRAWINGS">FIG. 10</figref>, so its explanation is omitted.

0170On the other hand, [Numerical equation 1] and [Numerical equation 2] are substituted into [Numerical equation 6], and upon assuming that S and N have no correlation to each other, the following equation is yielded.

0000<maths id="MATH-US-00005" num="00005"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>R</mi><mo>=</mo><mfrac><mn>1</mn><mrow><mn>1</mn><mo>-</mo><msup><mi>G</mi><mn>2</mn></msup></mrow></mfrac></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>7</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0005.tif" />

0171That is, the signal versus background sound ratio calculation unit <b>203</b> may calculate the signal versus background sound ratio R by employing [Numerical equation 7].

0172In this configuration example, the suppression coefficient re-configuration unit <b>250</b> shown in <figref idref="DRAWINGS">FIG. 8</figref> of the receiving side is represented in <figref idref="DRAWINGS">FIG. 11</figref> similarly to the case of the foregoing configuration example. The signal versus background sound ratio decoding unit <b>261</b> decodes the encoded signal versus background sound ratio R received from the signal versus background sound ratio encoding unit <b>204</b>, and outputs the signal versus background sound ratio R to the suppression coefficient conversion unit <b>262</b>. The suppression coefficient conversion unit <b>262</b> converts the signal versus background sound ratio R into the suppression coefficient G, and outputs the suppression coefficient G. The conversion from R to G is made based upon [Numerical equation 8]. That is, upon solving [Numerical equation 7] for G, the following equation is yielded.

0000<maths id="MATH-US-00006" num="00006"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>G</mi><mo>=</mo><msqrt><mfrac><mrow><mi>R</mi><mo>-</mo><mn>1</mn></mrow><mi>R</mi></mfrac></msqrt></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>8</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0006.tif" />

0173Continuously, a third example will be explained. In the third example, the signal analysis unit <b>101</b> outputs the background sound itself as analysis information. The signal control unit <b>151</b>, responding to this, controls the decoded signal by employing the background sound.

0174At first, the signal analysis unit <b>101</b> will be explained. The signal analysis unit <b>101</b>, similarly to the case of the first example, is represented in <figref idref="DRAWINGS">FIG. 4</figref>. A configuration of the analysis information generation unit <b>121</b> of this example differs from that of the analysis information generation unit <b>121</b> of the first example shown in <figref idref="DRAWINGS">FIG. 6</figref>.

0175A configuration example of the analysis information generation unit <b>121</b> of this example will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 13</figref>. Upon making a comparison with the configuration example of the analysis information generation unit <b>121</b> of the first embodiment shown in <figref idref="DRAWINGS">FIG. 6</figref>, the background sound information generation unit <b>202</b> is replaced with a background sound encoding unit <b>205</b>. The analysis information generation unit <b>121</b> of this configuration example receives the second converted signal, and outputs the encoded background sound as analysis information. The analysis information generation unit <b>121</b> of this configuration example is configured of a background sound estimation unit <b>200</b> and the background sound encoding unit <b>205</b>. The background sound estimation unit <b>200</b> of this configuration example outputs the background sound itself to the background sound encoding unit <b>205</b>. The background sound encoding unit <b>205</b> encodes and outputs the inputted background sound. This makes it possible to remove the redundancy of the background sound. Further, when the information quantity does not need to be curtailed, the background sound encoding unit <b>205</b> may output the background sound as analysis information without performing the encoding process for the background sound.

0176With regard to the encoding process, an encoding process similar to that of the suppression coefficient encoding unit <b>2021</b> can be employed.

0177Next, the signal control unit <b>151</b> will be explained. The signal control unit <b>151</b>, similarly to the case of the first example, is represented in <figref idref="DRAWINGS">FIG. 5</figref>. A configuration of the signal processing unit <b>172</b> of this example differs from that of the signal processing unit <b>172</b> of the first example shown in <figref idref="DRAWINGS">FIG. 8</figref>.

0178A configuration example of the signal processing unit <b>172</b> of this example will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 14</figref>. Upon making a comparison with the configuration example of the signal processing unit <b>172</b> of the first example shown in <figref idref="DRAWINGS">FIG. 8</figref>, the suppression coefficient re-configuration unit <b>250</b> is replaced with a suppression coefficient calculation unit <b>252</b>. The signal processing unit <b>172</b> receives the second converted signal and the encoded background sound as analysis information, and outputs the modified decoded signal. The signal processing unit <b>172</b> is configured of the suppression coefficient calculation unit <b>252</b> and an multiplier <b>251</b>. The second converted signal is inputted into the suppression coefficient calculation unit <b>252</b> and the multiplier <b>251</b>, and the encoded background sound is inputted as analysis information into the suppression coefficient calculation unit <b>252</b>. The suppression coefficient calculation unit <b>252</b> calculates the suppression coefficient based upon the background sound and the second converted signal. And, the suppression coefficient calculation unit <b>252</b> outputs the suppression coefficient to the multiplier <b>251</b>. The multiplier <b>251</b> multiplies the second converted signal by the suppression coefficient, and outputs the modified decoded signal to the inverse conversion unit <b>173</b>.

0179In addition, a configuration example of the suppression coefficient calculation unit <b>252</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 15</figref>. The suppression coefficient calculation unit <b>252</b> is configured of a background sound decoding unit <b>263</b> and a suppression coefficient generation unit <b>264</b>. The background sound decoding unit <b>263</b> receives the encoded background sound as analysis information. And, the background sound decoding unit <b>263</b> decodes the encoded background sound, and outputs the background sound to the suppression coefficient generation unit <b>264</b>. The background sound decoding unit <b>263</b> outputs the background sound without performing the decoding operation when the background sound has not been encoded. The suppression coefficient generation unit <b>264</b> receives the background sound and the second converted signal. And, the suppression coefficient generation unit <b>264</b> calculates an appropriate suppression coefficient for suppressing the background sound based upon the background sound and the second converted signal. A calculation method similar to that of the suppression coefficient calculation unit <b>201</b> shown in <figref idref="DRAWINGS">FIG. 10</figref> may be employed for to calculating this suppression coefficient. The suppression coefficient generation unit <b>264</b> outputs the suppression coefficient. As a technology related to the method of calculating the suppression coefficient, there exists the technology disclosed in the foregoing Non-patent document 6, Non-patent document 7, or Non-patent document 8.

0180In addition, another configuration example of the signal processing unit <b>172</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 16</figref>. The signal processing unit <b>172</b> receives the second converted signal and the encoded background sound, and outputs the signal of which the background sound has been removed as a modified decoded signal. The signal processing unit <b>172</b> of this configuration example is configured of a background sound decoding unit <b>263</b> and a subtractor <b>253</b>. The second converted signal is inputted into the subtractor <b>253</b>, and the encoded background sound is inputted into the background sound decoding unit <b>263</b> as analysis information. The background sound decoding unit <b>263</b> decodes the encoded background sound, and outputs the background sound to the subtractor <b>253</b>. The background sound decoding unit <b>263</b> is useless when the analysis information is not-encoded background sound. The subtractor <b>253</b> subtracts the background sound from the second converted signal. And, the subtractor <b>253</b> outputs the signal of which the background sound has been removed as a modified decoded signal. This subtraction is known as spectral subtraction when the background sound is noise. The technology relating to the spectral subtraction is disclosed in Non-patent document 9 (IEEE TRANSACTION ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL. 27, NO. 2, pp. 113-120, April 1979).

0181Further, an addition function besides the subtraction can be incorporated into the subtractor <b>253</b>. For example, as an addition function, the function of, when the subtraction result indicates a negative value, correcting this value to zero or a minute positive value, a limiter function of setting a minimum value of the subtraction result to a positive value, or the function of, after correcting the subtraction result by multiplying the background sound information by the coefficient or adding a constant hereto, subtracting the background sound can be listed.

0182In addition, in this embodiment, the transmission unit <b>10</b> may calculate the analysis information of the above-mentioned first to third examples independently channel by channel when the input signal is configured of a plurality of channels. Further, the transmission unit <b>10</b> may calculate a sum of all channels of the input signal, and calculate the analysis information common to all channels from the summed signals. Or, the transmission unit <b>10</b> may divide the input signal into a plurality of groups, calculate a sum of the input signals of respective groups, and calculate the analysis information common to the group from the above summed signals. The receiving unit <b>15</b>, responding to this, controls the decoded signal by employing the analysis information corresponding to each channel.

0183Further, the analysis information explained in the above-mentioned first to third examples may be calculated as analysis information common to a plurality of the frequency bands. For example, the transmission unit <b>10</b> may divide the frequency band at an equal interval, and calculate the analysis information for each divided frequency band. In addition, the transmission unit <b>10</b> may divide the input signal into fine frequency bands to an auditory feature of a human being with regard to the low-frequency area, divide the input signal into rough frequency bands with regard to the high-frequency area, and calculate the analysis information in a divided unit. This makes it possible to curtail the information quantity of the analysis information.

0184As explained above, the second embodiment of the present invention makes it possible to control the input signal, which is configured of the objective sound and the background sound, because the transmission unit analyzes the signal. In addition, the receiving unit can curtail the arithmetic quantity relating to the calculation of the analysis information because the transmission unit calculates the analysis information such as the suppression coefficient and the signal versus background sound ratio.

0185Continuously, a third embodiment of the present invention will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 17</figref>. In the third embodiment of the present invention, a receiving unit <b>35</b>, which assumes a configuration in which the signal control information can be received, can control a specific sound source independently. Upon comparing the third embodiment shown in <figref idref="DRAWINGS">FIG. 17</figref> with the first embodiment shown in <figref idref="DRAWINGS">FIG. 1</figref>, while the receiving unit <b>15</b> is configured of the signal control unit <b>151</b>, the receiving unit <b>35</b> is configured of a signal control unit <b>350</b>. Further, in this example, the transmission unit, the transmission path, and the receiving unit could be a recoding unit, a storage medium, and a reproduction unit, respectively. From now on, explanation of the portion which overlaps <figref idref="DRAWINGS">FIG. 1</figref> is omitted.

0186A configuration example of the signal control unit <b>350</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 18</figref>. The signal control unit <b>350</b> is configured of a conversion unit <b>171</b>, a signal processing unit <b>360</b> and an inverse conversion unit <b>173</b>. Upon making a comparison with the first embodiment, while the signal control unit <b>151</b> is configured of the signal processing unit <b>172</b>, the signal control unit <b>151</b> is configured of a signal processing unit <b>360</b> in this embodiment. The signal control unit <b>350</b> receives the analysis information and the signal control information, and outputs the output signal. The signal control unit <b>350</b> manipulates the decoded signal received from the decoding unit <b>150</b> for each component element corresponding to each sound source, based upon the signal control information and the analysis information. Further, the signal control unit <b>350</b> also can manipulate the decoded signal with the component element group, which is configured of a plurality of the component elements, defined as a unit instead of the component element corresponding to each sound source. The signal processing unit <b>360</b> receives the second converted signal coming from the conversion unit <b>171</b> and the signal control information. The signal processing unit <b>360</b> controls the component element of the frequency component of the second converted signal based upon the analysis information and the signal control information, and generates the modified decoded signal. The signal processing unit <b>360</b> outputs the modified decoded signal to the inverse conversion unit <b>173</b>.

0187In addition, specifically, the signal processing unit <b>360</b> derives a by-frequency analysis parameter based upon the analysis information. And, the signal processing unit <b>360</b> decomposes the second converted signal into the component elements corresponding to the sound resources based upon the analysis parameter. In addition, the signal processing unit <b>360</b> prepares the modified decoded signal in which a relation between of a plurality of the component elements has been changed, responding to the by-frequency analysis parameter based upon the signal control information. The signal processing unit <b>360</b> outputs the modified decoded signal to the inverse conversion unit <b>173</b>. Further, the signal processing unit <b>360</b> may decompose the second converted signal based upon the analysis parameter for each component element groups that is configured of a plurality of the component elements.

0188Continuously, the method of preparing the modified decoded signal will be specifically explained.

0189Upon defining the frequency component of the decoded signal (namely, the second converted signal) in a certain frequency band f as X_k(f), k=1, 2, . . . , P (P is the number of the channels of the decoded signal), the frequency component of the component element as Y_j(f), j=1, 2, . . . , M (M is the number of the component elements), the frequency component of the component element modified based upon the signal control information as Y′_j(f), and the modified decoded signal as X′_k(f), the following relation holds by employing a conversion function F₅₀₁being specified with the analysis parameter, and a conversion function F₅₀₂being specified with the signal control information.

0000<br /><i>Y</i>_j(<i>f</i>)=<i>F</i>₅₀₁(<i>X</i>₁(<i>f</i>), . . . , X_p(<i>f</i>))  [Numerical equation 9]

0000<br /><i>Y′</i>_j(<i>f</i>)=<i>F</i>₅₀₂(<i>Y</i>_j(<i>f</i>))  [Numerical equation 10]

0000<br /><i>X′</i>_k(<i>f</i>)=<i>F</i>₅₀₃(<i>Y′</i>_j(<i>f</i>))  [Numerical equation 11]

0190Where, the conversion function F₅₀₃is a function for converting the modified component element into the modified decoded signal.

0191Further, integration of the conversion functions F₅₀₀, F₅₀₁, F₅₀₂, and F₅₀₃can lead to the following equation.

0000<br /><i>X</i>′(<i>f</i>)=<i>F</i>₅₀₄(<i>X</i>(<i>f</i>))  [Numerical equation 12]

0192At this time, the conversion function F₅₀₄is specified with the analysis parameter and the signal control information.

0193As a specific example of the above-mentioned conversion function, upon expressing an analysis parameter B(f) of the frequency band f by the following equation 13, and a by-frequency parameter A(f), which is governed responding to the signal control information, by the following equation 14, [Numerical equation 9] to [Numerical equation 12] can be expressed by the following [Numerical equation 15].

0000<maths id="MATH-US-00007" num="00007"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>B</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>C</mi><mn>11</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msub><mi>C</mi><mn>12</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>C</mi><mrow><mn>1</mn><mo></mo><mi>P</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>C</mi><mn>21</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msub><mi>C</mi><mn>22</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>C</mi><mrow><mn>2</mn><mo></mo><mi>P</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mi>⋮</mi></mtd><mtd><mi>⋮</mi></mtd><mtd><mi>⋱</mi></mtd><mtd><mi>⋮</mi></mtd></mtr><mtr><mtd><mrow><msub><mi>C</mi><mrow><mi>M</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msub><mi>C</mi><mrow><mi>M</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>2</mn></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>C</mi><mi>MP</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>13</mn></mrow><mo>]</mo></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mi>A</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>A</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mn>0</mn></mtd><mtd><mi>…</mi></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mrow><msub><mi>A</mi><mn>2</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mi>⋮</mi></mtd><mtd><mi>⋮</mi></mtd><mtd><mi>⋱</mi></mtd><mtd><mi>⋮</mi></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>A</mi><mi>M</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>14</mn></mrow><mo>]</mo></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mrow><mi>X</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>X</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>X</mi><mn>2</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mi>⋮</mi></mtd></mtr><mtr><mtd><mrow><msub><mi>X</mi><mi>P</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow><mo></mo><mstyle><mtext></mtext></mstyle><mo></mo><mrow><mrow><mrow><mi>Y</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><mi>B</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><mi>X</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mrow><mo>,</mo><mstyle><mtext></mtext></mstyle><mo></mo><mtable><mtr><mtd><mrow><mrow><msup><mi>Y</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mi /><mo></mo><mrow><mrow><mi>A</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><mi>Y</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mo>=</mo><mi /><mo></mo><mrow><mi>A</mi><mo></mo><mrow><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow><mo>·</mo><mrow><mi>B</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>X</mi></mrow><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow><mo>,</mo></mrow></mtd></mtr></mtable></mrow><mo></mo><mstyle><mtext></mtext></mstyle><mo></mo><mtable><mtr><mtd><mrow><mrow><msup><mi>X</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mi /><mo></mo><mrow><mrow><mi>D</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msup><mi>Y</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mi /><mo></mo><mrow><mrow><mi>D</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><mi>A</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><mi>B</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><mi>X</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mrow></mtd></mtr></mtable></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>15</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0007.tif" />

0194That is, a matrix for converting the decoded signal into the modified decoded signal can be calculated as D(f)×A(f)×B(f). Where, D(f) is an arbitrary P-row and M-column matrix, and for example, an inverse matrix of B(f) can be employed as D(f). Additionally, as apparent from [Numerical equation 15], it is appropriate as a manipulation of converting the modified component element into the modified decoded signal to employ the inverse matrix of B(f) as D(f).

0195A configuration may be made so that the signal control information is inputted from the outside by a user. For example, as signal control information being inputted from the outside, there exists personal information such as a taste of the user pre-registered into the receiving unit, an operational status of the receiving unit (including external environment information such as a switched-off loudspeaker), a format or a kind of the receiving unit, a use status of a power source and a cell or its residual quantity, and a kind and a status of an antenna (a shape of being folded in, its direction, etc.). Further, a configuration may be made so that the signal control information is automatically captured in the other formats. A configuration may be made so that the signal control information is automatically captured via a sensor installed inside or near to the receiving unit. For example, as signal control information being automatically captured, there exists a quantity of the external noise, brightness, a time band, a geometric position, a temperature, information synchronous with video, barcode information captured through a camera, and so on.

0196The third embodiment of the present invention makes it possible to control a specific sound source independently based upon the signal control information received by the receiving unit. Further, the transmission unit can analyze the signal, and the receiving unit can control the input signal, which is configured of a plurality of the sound sources, for each component element corresponding to each sound source. In addition, the arithmetic quantity relating to the signal analysis by the receiving unit can be curtailed because the transmission unit analyzes the signal.

0197The fourth embodiment of the present invention is for controlling the input signal, which is configured of the objective sound and the background sound, based upon the signal control information being inputted into the receiving unit in such a manner that the objective sound and the background sound are controlled independently from each other. This embodiment will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 17</figref>. Upon comparing this embodiment with the second embodiment, while the receiving unit <b>15</b> shown in <figref idref="DRAWINGS">FIG. 1</figref> is configured of the signal control unit <b>151</b>, the receiving unit <b>35</b> shown in <figref idref="DRAWINGS">FIG. 17</figref> is configured of a signal control unit <b>350</b>. Further, in this embodiment, the signal control information is inputted into the signal control unit <b>350</b>. Signal control information is similar to the signal control information employed in the third embodiment, so its explanation is omitted. In addition, a configuration of the signal control unit <b>350</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 18</figref>. The signal control unit <b>350</b> is configured of a conversion unit <b>171</b>, a signal processing unit <b>360</b>, and an inverse conversion unit <b>173</b>. Upon making a comparison with the second embodiment, while signal control unit <b>151</b> shown in <figref idref="DRAWINGS">FIG. 5</figref> is configured of the signal processing unit <b>172</b>, the signal control unit <b>350</b> is configured of the signal processing unit <b>360</b> in this embodiment.

0198Continuously, a first example will be explained. In the first example, the suppression coefficient is employed as analysis information.

0199A configuration example of the signal processing unit <b>360</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 19</figref>. Upon making a comparison with the second embodiment, while the signal processing unit <b>172</b> shown in <figref idref="DRAWINGS">FIG. 8</figref> is configured of the suppression coefficient re-configuration unit <b>250</b>, the signal processing unit <b>360</b> is configured of a suppression coefficient re-configuration unit <b>450</b>. The suppression coefficient re-configuration unit <b>450</b> receives the signal control information from the outside. The above signal control information is similar to the signal control information employed in the third embodiment, so its explanation is omitted.

0200The signal processing unit <b>360</b> receives the second converted signal, the analysis information, and the signal control information, and outputs the modified decoded signal. The signal processing unit <b>360</b> is configured of a suppression coefficient re-configuration unit <b>450</b> and a multiplier <b>451</b>. The second converted signal is inputted into the multiplier <b>451</b>, and the analysis information and the signal control information are inputted into the suppression coefficient re-configuration unit <b>450</b>. The suppression coefficient re-configuration unit <b>450</b> generates the modified suppression coefficient by employing the inputted analysis information and signal control information. The modified suppression coefficient is one obtained by modifying the suppression coefficient received as analysis information by employing the signal control information. The suppression coefficient re-configuration unit <b>450</b> outputs the modified suppression coefficient to the multiplier <b>451</b>. The multiplier <b>451</b> multiplies the second converted signal by the modified suppression coefficient, and generates the modified decoded signal. The multiplier <b>451</b> outputs the modified decoded signal to the inverse conversion unit <b>173</b>.

0201A configuration of the suppression coefficient re-configuration unit <b>450</b> of the first example will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 20</figref>. The suppression coefficient re-configuration unit <b>450</b> includes a suppression coefficient modification unit <b>460</b>.

0202The suppression coefficient re-configuration unit <b>250</b> of the second embodiment shown in <figref idref="DRAWINGS">FIG. 9</figref> does not include the suppression coefficient modification unit <b>460</b>. The suppression coefficient modification unit <b>460</b> modifies the suppression coefficient by employing the signal control information inputted from the outside. This signal control information is similar to the signal control information already employed in the third embodiment, so its explanation is omitted.

0203The suppression coefficient re-configuration unit <b>450</b> receives the encoded suppression coefficient as analysis information, and the signal control information, and outputs the modified suppression coefficient. The suppression coefficient re-configuration unit <b>450</b> is configured of a suppression coefficient decoding unit <b>260</b> and a suppression coefficient modification unit <b>460</b>. The suppression coefficient decoding unit <b>260</b> decodes the received suppression coefficient. The suppression coefficient decoding unit <b>260</b> outputs the suppression coefficient to the suppression coefficient modification unit <b>460</b> without performing the decoding operation when the suppression coefficient has not been encoded. The suppression coefficient modification unit <b>460</b> modifies the inputted suppression coefficient by employing the signal control information inputted from the outside. The suppression coefficient modification unit <b>460</b> outputs the modified suppression coefficient.

0204A first configuration example of the suppression coefficient modification unit <b>460</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 21</figref>. The suppression coefficient modification unit <b>460</b> receives the suppression coefficient and the signal control information, and outputs the modified suppression coefficient. The suppression coefficient modification unit <b>460</b> of this configuration example is configured of a multiplier <b>470</b>. The multiplier <b>470</b> calculates a product of the suppression coefficient and the signal control information, and outputs the modified suppression coefficient. In this configuration example, a magnification for the suppression coefficient is inputted as the signal control information. Such a configuration makes it possible to control the suppression coefficient with the simple signal control information.

0205A second configuration example of the suppression coefficient modification unit <b>460</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 22</figref>. The suppression coefficient modification unit <b>460</b> receives the suppression coefficient and the signal control information, and outputs the modified suppression coefficient. The suppression coefficient modification unit <b>460</b> of this configuration example is configured of a comparison unit <b>471</b>. The comparison unit <b>471</b> compares the suppression coefficient with the signal control information, and outputs the signal responding to its comparison result. For example, the comparison unit <b>471</b> outputs the suppression coefficient or the signal control information, which is larger, when making a maximum comparison. Further, the comparison unit <b>471</b> may make a minimum comparison. In these cases, the maximum value or the minimum value of the suppression coefficient is inputted as the signal control information. Such a configuration makes it possible to pre-specify a range of the output signal, and to avoid a decline in the sound quality due to the output of the unexpected signal.

0206A third configuration example of the suppression coefficient modification unit <b>460</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 23</figref>. The third configuration example of the suppression coefficient modification unit <b>460</b> is one obtained by combining the foregoing first configuration example and second configuration example. The suppression coefficient modification unit <b>460</b> receives the suppression coefficient and the signal control information, and outputs the modified suppression coefficient. The suppression coefficient modification unit <b>460</b> of this configuration example is configured of a multiplier <b>470</b>, a comparison unit <b>471</b>, a designated suppression coefficient control unit <b>472</b>, and a switch <b>473</b>. The designated suppression coefficient control unit <b>472</b> outputs the signal control information to the multiplier <b>470</b>, the comparison unit <b>471</b>, or the switch <b>473</b>. Herein, the signal control information includes at least a magnification of the suppression coefficient being used in the multiplier <b>470</b> and the maximum value or the minimum value of the suppression coefficient being used in the comparison unit <b>471</b>. In addition, the signal control information may include the control information for selection being made by the switch <b>473</b>. The designated suppression coefficient control unit <b>472</b> outputs a magnification of the suppression coefficient to the multiplier <b>470</b> when receiving a magnification of the suppression coefficient as signal control information. The multiplier <b>470</b> calculates a product of the suppression coefficient and a magnification of the suppression coefficient, and outputs the modified suppression coefficient to the switch <b>473</b>. The designated suppression coefficient control unit <b>472</b> outputs the maximum value or the minimum value of the suppression coefficient to the comparison unit <b>471</b> when receiving the maximum value or the minimum value of the suppression coefficient as signal control information. The comparison unit <b>471</b> compares the suppression coefficient with the maximum value or the minimum value of the suppression coefficient, and outputs the signal responding to its comparison result as a modified suppression coefficient to the switch <b>473</b>. The designated suppression coefficient control unit <b>472</b> outputs the control information to the switch <b>473</b> when receiving the control information for the selection. When the control information is inputted from the designated suppression coefficient control unit <b>472</b>, the switch <b>473</b> selects and outputs one of an output of the multiplier <b>470</b> and an output of the comparison unit <b>471</b> responding to the above signal control information.

0207Next, a second example will be explained. In the second example, the signal versus background sound ratio, being a configuration ratio of the objective sound and the background sound, is employed as analysis information. The signal processing unit <b>360</b> of the second example, which is similar to the signal processing unit of the first example shown in <figref idref="DRAWINGS">FIG. 19</figref>, differs in a configuration of a suppression coefficient re-configuration unit <b>450</b>.

0208A configuration example of the suppression coefficient re-configuration unit <b>450</b> of the second example will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 24</figref>. Upon making a comparison with the suppression coefficient re-configuration unit <b>250</b> of the second embodiment shown in <figref idref="DRAWINGS">FIG. 11</figref>, the suppression coefficient re-configuration unit <b>450</b> of this configuration example further includes a signal versus background sound ratio modification unit <b>461</b>.

0209The suppression coefficient re-configuration unit <b>450</b> receives the encoded signal versus background sound ratio and the signal control information, and outputs the modified suppression coefficient. The suppression coefficient re-configuration unit <b>450</b> is configured of a signal versus background sound ratio decoding unit <b>261</b>, the signal versus background sound ratio modification unit <b>461</b>, and a suppression coefficient conversion unit <b>262</b>. The signal versus background sound ratio decoding unit <b>261</b> decodes the received signal versus background sound ratio, which has been encoded, and outputs the signal versus background sound ratio to the signal versus background sound ratio modification unit <b>461</b>. The signal versus background sound ratio decoding unit <b>261</b> outputs the signal versus background sound ratio without performing the decoding operation when the signal versus background sound ratio has not been encoded. The signal versus background sound ratio modification unit <b>461</b> modifies the inputted signal versus background sound ratio by employing the signal control information received from the outside, and generates the modified signal versus background sound ratio. A modification method similar to that of the suppression coefficient modification unit <b>460</b> in the first example may be applied for modifying the signal versus background sound ratio. That is, the signal versus background sound ratio may be modified by inputting a magnification of the signal versus background sound ratio as signal control information. Further, the signal versus background sound ratio may be modified by inputting the maximum value or the minimum value of the signal versus background sound ratio as signal control information. In addition, the signal versus background sound ratio may be modified by inputting the signal control information for selecting one of the signal versus background sound ratio modified with a magnification of the signal versus background sound ratio and the signal versus background sound ratio modified with the maximum value or the minimum value of the signal versus background sound ratio as signal control information. The signal versus background sound ratio modification unit <b>461</b> outputs the modified signal versus background sound ratio to the suppression coefficient conversion unit <b>262</b>. The suppression coefficient conversion unit <b>262</b> converts the modified signal versus background sound ratio into the suppression coefficient, and outputs the modified suppression coefficient. As a method of converting the signal versus background sound ratio into the suppression coefficient, a conversion method similar to that of the suppression coefficient conversion unit <b>262</b> shown in <figref idref="DRAWINGS">FIG. 11</figref> may be employed. In the second example, after the signal versus background sound ratio is modified with the signal control information, it is converted into the modified signal versus background sound ratio suppression coefficient. The above signal control information is similar to the signal control information employed in the third embodiment, so its explanation is omitted.

0210In addition, a third example will be explained. Upon making a comparison with the foregoing second example, the third example assumes a configuration in which after the signal versus background sound ratio is converted into the suppression coefficient, the suppression coefficient is modified with the signal control information.

0211The suppression coefficient re-configuration unit <b>450</b> of the third example will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 25</figref>. Upon making a comparison with the suppression coefficient re-configuration unit <b>250</b> of the second embodiment shown in <figref idref="DRAWINGS">FIG. 11</figref>, the suppression coefficient re-configuration unit <b>450</b> of this example further includes a suppression coefficient modification unit <b>460</b>.

0212The suppression coefficient re-configuration unit <b>450</b> receives the encoded signal versus background sound ratio and the signal control information, and outputs the modified suppression coefficient. The suppression coefficient re-configuration unit <b>450</b> is configured of a signal versus background sound ratio decoding unit <b>261</b>, a suppression coefficient conversion unit <b>262</b>, and a suppression coefficient modification unit <b>460</b>. The signal versus background sound ratio decoding unit <b>261</b> receives and decodes the encoded signal versus background sound ratio. The signal versus background sound ratio decoding unit <b>261</b> outputs the signal versus background sound ratio to the suppression coefficient conversion unit <b>262</b>. The suppression coefficient conversion unit <b>262</b> converts the decoded signal versus background sound ratio into the suppression coefficient. The suppression coefficient conversion unit <b>262</b> outputs the suppression coefficient to the suppression coefficient modification unit <b>460</b>. The suppression coefficient modification unit <b>460</b> modifies the suppression coefficient inputted from the suppression coefficient conversion unit <b>262</b> by employing the signal control information received from the outside. The suppression coefficient modification unit <b>460</b> outputs the modified suppression coefficient. The above signal control information is similar to the signal control information employed in the third embodiment, so its explanation is omitted. A configuration of the suppression coefficient modification unit <b>460</b> is similar to the suppression coefficient modification unit <b>460</b> of the first example shown in <figref idref="DRAWINGS">FIG. 20</figref>, so its explanation is omitted.

0213Continuously, a fourth example will be explained. The fourth example is a configuration example of the case of employing the background sound itself as analysis information. A first configuration example of the signal processing unit <b>360</b> of the fourth example will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 26</figref>. While the signal processing unit <b>172</b> of the second example shown in <figref idref="DRAWINGS">FIG. 14</figref> is configured of the suppression coefficient calculation unit <b>252</b>, the signal processing unit <b>360</b> of this example is configured of a suppression coefficient calculation unit <b>452</b>. The suppression coefficient calculation unit <b>452</b> receives the signal control information from the outside.

0214The signal processing unit <b>360</b> receives the second converted signal, the encoded background sound, and the signal control information, and outputs the modified decoded signal. The signal processing unit <b>360</b> is configured of the suppression coefficient calculation unit <b>452</b> and a multiplier <b>251</b>. The second converted signal is inputted into the suppression coefficient calculation unit <b>452</b> and the multiplier <b>251</b>, and the encoded background sound is inputted as analysis information into the suppression coefficient calculation unit <b>452</b>. The suppression coefficient calculation unit <b>452</b> calculates the modified suppression coefficient based upon the encoded background sound, the second converted signal, and the signal control information. And, the suppression coefficient calculation unit <b>452</b> outputs the modified suppression coefficient to the multiplier <b>251</b>. The multiplier <b>251</b> multiplies the second converted signal by the suppression coefficient, and outputs the modified decoded signal to the inverse conversion unit <b>173</b>. The above signal control information is similar to the signal control information employed in the third embodiment, so its explanation is omitted.

0215A configuration example of the suppression coefficient calculation unit <b>452</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 27</figref>. The suppression coefficient calculation unit <b>452</b> receives the second converted signal, the encoded background sound, and the signal control information, and outputs the suppression coefficient. The suppression coefficient calculation unit <b>452</b> is configured of a background sound decoding unit <b>263</b>, a background sound modification unit <b>464</b>, and a suppression coefficient generation unit <b>264</b>.

0216The background sound decoding unit <b>263</b> receives and decodes the encoded background sound. The background sound decoding unit <b>263</b> outputs the decoded background sound to the background sound modification unit <b>464</b>. The background sound decoding unit <b>263</b> outputs the background sound to the background sound modification unit <b>464</b> without performing the decoding operation when the background sound has not been encoded. The background sound modification unit <b>464</b> modifies the background sound by employing the signal control information inputted from the outside. A modification method similar to that of the suppression coefficient modification unit <b>460</b> in the first example may be applied for modifying the background sound. That is, the background sound may be modified by inputting a magnification of the background sound as signal control information. Further, the background sound may be modified by inputting the maximum value or the minimum value of the background sound as signal control information. In addition, the background sound may be modified by inputting the signal control information for selecting one of the background sound modified with a magnification of the background sound and the background sound modified with the maximum value or the minimum value of the background sound as signal control information. The background sound modification unit <b>464</b> outputs the modified background sound to the suppression coefficient generation unit <b>264</b>. The suppression coefficient generation unit <b>264</b> calculates an appropriate suppression coefficient for suppressing the background sound by employing the second converted signal and the modified background sound. As a method of calculating this suppression coefficient, a calculation method similar to that of the suppression coefficient calculation unit <b>201</b> shown in <figref idref="DRAWINGS">FIG. 10</figref> may be employed. The suppression coefficient generation unit <b>264</b> outputs the suppression coefficient. The above signal control information is similar to the signal control information employed in the third embodiment, so its explanation is omitted.

0217A second configuration example of the signal processing unit <b>360</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 28</figref>. The signal processing unit <b>360</b> of this configuration example is configured of a background sound decoding unit <b>263</b>, a background sound modification unit <b>464</b>, and a subtractor <b>253</b>. The signal processing unit <b>360</b> receives the second converted signal, the encoded background sound, and the signal control information, and outputs the signal of which the background sound has been controlled.

0218The second converted signal is inputted into the subtractor <b>253</b>. Further, the encoded background sound is inputted into the background sound decoding unit <b>263</b> as analysis information. The background sound decoding unit <b>263</b> decodes the encoded background sound that has been inputted. And, the background sound decoding unit <b>263</b> outputs the decoded background sound to the background sound modification unit <b>464</b>. The background sound decoding unit <b>263</b> outputs the background sound without performing the decoding operation therefor when the background sound has not been encoded. The background sound modification unit <b>464</b> modifies the background sound information by employing the signal control information, and generates the modified background sound. The background sound modification unit <b>464</b> outputs the modified background sound to the subtractor <b>253</b>. The subtractor <b>253</b> subtracts the modified background sound from the second converted signal, and outputs a subtraction result.

0219Next, a fifth example will be explained. Upon making a comparison with the fourth example, this example assumes a configuration in which after the suppression coefficient is generated from the decoded background sound, the suppression coefficient is modified with the signal control information.

0220The suppression coefficient calculation unit <b>452</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 29</figref>. The suppression coefficient calculation unit <b>452</b> receives the second converted signal, the encoded background sound, and the signal control information, and outputs the modified suppression coefficient. The suppression coefficient calculation unit <b>452</b> is configured of a background sound decoding unit <b>263</b>, a suppression coefficient generation unit <b>264</b>, and a suppression coefficient modification unit <b>460</b>.

0221The background sound decoding unit <b>263</b> receives and decodes the encoded background sound. And, the background sound decoding unit <b>263</b> outputs the decoded background sound to the suppression coefficient generation unit <b>264</b>. The suppression coefficient generation unit <b>264</b> generates the suppression coefficient from the second converted signal and the decoded background sound. As a calculation of this suppression coefficient, a calculation method similar to that of the suppression coefficient calculation unit <b>201</b> shown in <figref idref="DRAWINGS">FIG. 10</figref> may be employed. And, the suppression coefficient generation unit <b>264</b> outputs the suppression coefficient to the suppression coefficient modification unit <b>460</b>. The suppression coefficient modification unit <b>460</b> modifies the suppression coefficient by employing the received signal control information, and generates the modified suppression coefficient. A modification method similar to that of the suppression coefficient modification unit <b>460</b> shown in <figref idref="DRAWINGS">FIG. 23</figref> may be applied for modifying the suppression coefficient. That is, the suppression coefficient may be modified by inputting a magnification of the suppression coefficient as signal control information. Further, the suppression coefficient may be modified by inputting the maximum value or the minimum value of the suppression coefficient as signal control information. In addition, the suppression coefficient may be modified by inputting the signal control information for selecting a magnification of the suppression coefficient, or the maximum value or the minimum value of the suppression coefficient as signal control information. The suppression coefficient modification unit <b>460</b> outputs the modified suppression coefficient. The above signal control information is similar to the signal control information employed in the third embodiment, so its explanation is omitted.

0222As explained above, the fourth embodiment of the present invention makes it possible to curtail the arithmetic quantity of the receiving unit for controlling only the signal, and to control the input signal, which is configured of the objective sound and the background sound, because the transmission unit (or the recording unit) analyzes the signal. Further, this embodiment makes it possible to independently control only a specific sound source by employing the signal control information received by the receiving unit.

0223A fifth embodiment of the present invention will be explained by making a reference to <figref idref="DRAWINGS">FIG. 30</figref>. Upon comparing <figref idref="DRAWINGS">FIG. 30</figref> with <figref idref="DRAWINGS">FIG. 17</figref> indicative of the third embodiment, the former differs from the latter in a point that the receiving unit <b>35</b> is replaced with a receiving unit <b>55</b>. The receiving unit <b>55</b>, into which the transmission signal, the signal control information, and the component element rendering information are inputted, outputs the output signal that is configured of a plurality of the channels. Upon making a comparison with the third embodiment, the fifth embodiment differs in a point of having the component element rendering information as well as an input, and a point that the output signal is a signal that is configured of a plurality of the channels.

0224The so-called component element rendering information is information indicating a relation between the component element being included in the decoded signal and the output signal of the receiving unit <b>55</b> for each frequency component. For example, it indicates constant position information of each of the component elements being mixed in the decoded signal. It may include information for manipulating localization feeling, for example, by shading-off the sound image.

0225Utilizing the component element rendering information makes it possible to control the signal outputted to each channel for each component element. Each component element may be output from a specific one channel (for example, a loudspeaker) in some cases, and may be distributed and outputted to a plurality of the channels in some cases.

0226Upon making a comparison with the receiving unit <b>35</b> of <figref idref="DRAWINGS">FIG. 17</figref> explained in the third embodiment, the receiving unit <b>55</b> differs in a point that the signal control unit <b>350</b> is replaced with an output signal generation unit <b>550</b>. The component element rendering information as well besides the decoded signal, the analysis information, and the signal control information is inputted into the output signal generation unit <b>550</b>.

0227Hereinafter, a configuration example of the output signal generation unit <b>550</b>, which is characteristic of this embodiment, will be explained. A first configuration example is shown in <figref idref="DRAWINGS">FIG. 31</figref>, a second configuration example in <figref idref="DRAWINGS">FIG. 32</figref>, and a third configuration example in <figref idref="DRAWINGS">FIG. 33</figref>.

0228Upon making a reference to <figref idref="DRAWINGS">FIG. 31</figref>, the output signal generation unit <b>550</b> in the first configuration example is configured of a signal control unit <b>560</b>, a component element information conversion unit <b>561</b>, and a rendering unit <b>562</b>. This configuration example is characterized in that the modified decoded signal being inputted into the rendering unit <b>562</b> is a signal pre-manipulated for each component element based upon the signal control information.

0229The signal control unit <b>560</b> has the decoded signal and the analysis information as an input. At first, the signal control unit <b>560</b> decodes the analysis information, and generates the analysis parameter corresponding to each frequency component. Next, the signal control unit <b>560</b> decomposes the decoded signal into the respective component elements based upon the analysis parameter. In addition, the signal control unit <b>560</b> manipulates each component element by employing the signal control information, generates the modified component element, re-configures the generated modified component element, and outputs the re-configured signal to the rendering unit <b>562</b> as a modified decoded signal. Further, the signal control unit <b>560</b> generates a modified parameter indicating a relation between the modified decoded signal and the modified component element for each frequency component, and outputs it to the component element information conversion unit <b>561</b> as well. Herein, the decoded signal is one that is configured of general plural sound sources.

0230Additionally, the signal control unit <b>560</b> may convert the decoded signal into the modified decoded signal by employing the analysis parameter and the signal control information without generating the modified component element as another operation example. In this case, the signal control unit <b>560</b> outputs the modified parameter used at the moment of converting the decoded signal into the modified decoded signal to the component element information conversion unit <b>561</b>.

0231Hereinafter, a specific example of an operation of the signal control unit <b>560</b> will be explained.

0232Upon defining the frequency component of the decoded signal in a certain frequency band f as X_k(f), k=1, 2, . . . , P (P is the number of the channels of the decoded signal), the frequency component of the component element as Y_j(f), j=1, 2, . . . , M (M is the number of the component elements), the frequency component of the component element modified based upon the signal control information as Y′_j(f), and the modified decoded signal as X′(f), the following relation holds by employing a conversion function F₅₀₁being specified with the analysis parameter, and a conversion function F₅₀₂being specified with the signal control information.

0000<br /><i>Y</i>_j(<i>f</i>)=<i>F</i>₅₀₁(<i>X</i>₁(<i>f</i>), . . . , X_p(<i>f</i>))  [Numerical equation 9]

0000<br /><i>Y′</i>_j(<i>f</i>)=<i>F</i>₅₀₂(<i>Y</i>_j(<i>f</i>))  [Numerical equation 10]

0000<br /><i>X</i>′(<i>f</i>)=<i>F</i>₅₀₃(<i>Y′</i>_j(<i>f</i>))  [Numerical equation 11]

0233Where, the conversion function F₅₀₃<i>is a function for converting the modified component element into the modified decoded signal, and the modified parameter becomes a parameter indicative of the inverse function of the conversion function F</i>₅₀₃.

0234As mentioned as another operation example, by integrating the conversion functions F₅₀₀, F₅₀₁, F₅₀₂, and F₅₀₃, the following equation may be yielded.

0000<br /><i>X</i>′(<i>f</i>)=<i>F</i>₅₀₄(<i>X</i>(<i>f</i>))  [Numerical equation 12]

0235At this time, the conversion function F₅₀₄is specified with the analysis parameter, the signal control information, and the modified parameter.

0236As a specific example of the above-mentioned conversion, upon expressing an analysis parameter B(f) of the frequency band f as the following equation 13, and a signal control information A(f) as the following equation 14, [Numerical equation 9] to [Numerical equation 12] can be expressed by the following [Numerical equation 15].

0000<maths id="MATH-US-00008" num="00008"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>B</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>C</mi><mn>11</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msub><mi>C</mi><mn>12</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>C</mi><mrow><mn>1</mn><mo></mo><mi>P</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>C</mi><mn>21</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msub><mi>C</mi><mn>22</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>C</mi><mrow><mn>2</mn><mo></mo><mi>P</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mi>⋮</mi></mtd><mtd><mi>⋮</mi></mtd><mtd><mi>⋱</mi></mtd><mtd><mi>⋮</mi></mtd></mtr><mtr><mtd><mrow><msub><mi>C</mi><mrow><mi>M</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msub><mi>C</mi><mrow><mi>M</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>2</mn></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>C</mi><mi>MP</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>13</mn></mrow><mo>]</mo></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mi>A</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>A</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mn>0</mn></mtd><mtd><mi>…</mi></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mrow><msub><mi>A</mi><mn>2</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mi>⋮</mi></mtd><mtd><mi>⋮</mi></mtd><mtd><mi>⋱</mi></mtd><mtd><mi>⋮</mi></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>A</mi><mi>M</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>14</mn></mrow><mo>]</mo></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mi>X</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>X</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>X</mi><mn>2</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mi>⋮</mi></mtd></mtr><mtr><mtd><mrow><msub><mi>X</mi><mi>P</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>15</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0008.tif" />

0237That is, a matrix for converting the decoded signal into the modified decoded signal can be calculated as D(f)×A(f)×B(f). Herein, D(f) is an arbitrary P-row and M-column matrix, and upon defining the modified parameter as E(f), the following equation is yielded.

0000<br /><i>E</i>(<i>f</i>)=<i>D</i>⁻¹(<i>f</i>)  [Numerical equation 16]

0238For example, when the inverse matrix of B(f) is employed as D(f), the modified parameter behaves like E(f)=B(f). Additionally, as apparent from [Numerical equation 15], it is appropriate as a manipulation of converting the modified component element into the modified decoded signal to employ the inverse matrix of B(f) as D(f).

0239The component element information conversion unit <b>561</b> converts the component element rendering information supplied via an input terminal into rendering information by employing the modified parameter outputted from the signal control unit <b>560</b>, and outputs the rendering information to the rendering unit <b>562</b>.

0240As a specific example of converting the component element rendering information into the rendering information, upon expressing the component element rendering information U(f) and the rendering information W(f) as the following equations, respectively, W(f)=U(f)×E(f) can be yielded.

0000<maths id="MATH-US-00009" num="00009"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mrow><mi>U</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>U</mi><mn>11</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msub><mi>U</mi><mn>12</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>U</mi><mrow><mn>1</mn><mo></mo><mi>M</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>U</mi><mn>21</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msub><mi>U</mi><mn>22</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>U</mi><mrow><mn>2</mn><mo></mo><mi>M</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mi>⋮</mi></mtd><mtd><mi>⋮</mi></mtd><mtd><mi>⋱</mi></mtd><mtd><mi>⋮</mi></mtd></mtr><mtr><mtd><mrow><msub><mi>U</mi><mrow><mi>Q</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msub><mi>U</mi><mrow><mi>Q</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>2</mn></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>U</mi><mi>QM</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow><mo>,</mo><mstyle><mtext></mtext></mstyle><mo></mo><mrow><mrow><mi>W</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>W</mi><mn>11</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msub><mi>W</mi><mn>12</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>W</mi><mrow><mn>1</mn><mo></mo><mi>P</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>W</mi><mn>21</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msub><mi>W</mi><mn>22</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>W</mi><mrow><mn>2</mn><mo></mo><mi>P</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mi>⋮</mi></mtd><mtd><mi>⋮</mi></mtd><mtd><mi>⋱</mi></mtd><mtd><mi>⋮</mi></mtd></mtr><mtr><mtd><mrow><msub><mi>W</mi><mrow><mi>Q</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msub><mi>W</mi><mrow><mi>Q</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>2</mn></mrow></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>W</mi><mi>QP</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>17</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0009.tif" />

0241Where, Q is the number of the channels of the output signal.

0242Additionally, the rendering information, which is information indicating a relation between the modified decoded signal and the output signal of the output signal generation unit <b>550</b> for each frequency component, can be expressed by employing an energy differences, a time difference, a correlation between the signals, etc. As one example of the rendering information, the information disclosed in Non-patent document 10 (ISO/IEC 23003-1: 2007 Part 1 MPEG Surround) is known.

0243The rendering unit <b>562</b> converts the modified decoded signal outputted from the signal control unit <b>560</b> and generates the output signal by employing the rendering information outputted from the component element information conversion unit <b>561</b>, and outputs it as an output signal of the output signal generation unit <b>550</b>.

0244As a method of the conversion, the method disclosed in the Non-patent document 10 is known. When a MPEG Surround decoder disclosed in the Non-patent document 10 is employed, a data stream being supplied to the MPEG Surround decoder is outputted as rendering information. Additionally, the parameter being used within the MPEG Surround decoder may be supplied to the rendering unit without being converted into the data stream.

0245While, in the foregoing, a configuration was explained in which the modified decoded signal decomposed into the frequency components was supplied to the rendering unit <b>562</b> as an output of the signal control unit <b>560</b>, the rendering unit <b>562</b> decomposes the time signal into the frequency components, and then performs a process therefor when the modified decoded signal is inverse-converted and supplied to the rendering unit <b>562</b> as a time signal in the output of the signal control unit <b>560</b>. The rendering unit <b>562</b> outputs a signal obtained by inverse-converting the signal decomposed into the frequency components as an output signal.

0246Upon defining the frequency component of the output signal as V_k(f), k=1, 2, . . . , Q (Q is the number of the channels of the output signal), and expressing V(f) by the following equation, an operation of the rendering unit becomes V(f)=W(f)×X′(f).

0000<maths id="MATH-US-00010" num="00010"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>V</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>V</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>V</mi><mn>2</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mi>⋮</mi></mtd></mtr><mtr><mtd><mrow><msub><mi>V</mi><mi>Q</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>18</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0010.tif" />

0247Next, a second configuration example will be explained. Upon making a reference to <figref idref="DRAWINGS">FIG. 32</figref>, the output signal generation unit <b>550</b> in the second configuration example is configured of a component element information conversion unit <b>563</b> and a rendering unit <b>562</b>. This configuration example is characterized in incorporating information for taking a control for each component element into the rendering information, and in realizing the manipulation for each component element in the rendering unit <b>562</b>.

0248The component element information conversion unit <b>563</b> has the analysis information, the signal control information, and the component element rendering information as an input. At first, the component element information conversion unit <b>563</b> decodes the analysis information, and generates the analysis parameter corresponding to each frequency component. Next, the component element information conversion unit <b>563</b> calculates the modified analysis parameter from the analysis parameter and the signal control information, calculates the rendering information indicating a relation between the decoded signal and the output signal for each frequency component from the modified analysis parameter and the component element rendering information, and outputs it to the rendering unit <b>562</b>.

0249Additionally, as another operation, the component element information conversion unit <b>563</b> may generate the rendering information indicating a relation between the decoded signal and the output signal for each frequency component from the analysis parameter, the signal control information, and the component element rendering information without generating the modified analysis parameter.

0250As a specific example of the above-mentioned conversion, upon defining a modified analysis parameter B′(f) of a frequency band f as the following equation, the modified analysis parameter B′(f) can be calculated as A(f)×B(f).

0000<maths id="MATH-US-00011" num="00011"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><msup><mi>B</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msubsup><mi>C</mi><mn>11</mn><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msubsup><mi>C</mi><mn>12</mn><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msubsup><mi>C</mi><mrow><mn>1</mn><mo></mo><mi>P</mi></mrow><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msubsup><mi>C</mi><mn>21</mn><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msubsup><mi>C</mi><mn>22</mn><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msubsup><mi>C</mi><mrow><mn>2</mn><mo></mo><mi>P</mi></mrow><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mi>⋮</mi></mtd><mtd><mi>⋮</mi></mtd><mtd><mi>⋱</mi></mtd><mtd><mi>⋮</mi></mtd></mtr><mtr><mtd><mrow><msubsup><mi>C</mi><mrow><mi>M</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mrow><msubsup><mi>C</mi><mrow><mi>M</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>2</mn></mrow><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msubsup><mi>C</mi><mi>MP</mi><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>19</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0011.tif" />

0251In addition, the rendering information W(f) expressed by [Numerical equation 17] can be defined as W(f)=U(f)×B′(f) by employing the component element rendering information U(f) and the modified analysis parameter B′(f).

0000As mentioned as another operation example, the rendering information W(f) may be defined as W(f)=U(f)×A(f)×B(f) without the modified analysis parameter B′(f) calculated.

0252An operation of the rendering unit <b>562</b> is identical to the operation explained in the first configuration example of this embodiment. Specifically, the operation behaves like V(f)=W(f)×X(f).

0253Making such a configuration makes it possible to incorporate the information for controlling each component element, which is included in the decoded signal, into the rendering information.

0254Next, a third configuration example will be explained. Upon making a reference to <figref idref="DRAWINGS">FIG. 33</figref>, the output signal generation unit <b>550</b> in the third configuration is configured of a component element information conversion unit <b>564</b>, a rendering unit <b>562</b>, and a signal control unit <b>565</b>.

0255This configuration example is characterized in manipulating each component element based upon the signal control information by employing the signal in which the decoded signal has been rendered.

0256The component element information conversion unit <b>564</b>, into which the analysis information and the component element rendering information are inputted, outputs the rendering information. At first, the component element information conversion unit <b>564</b> decodes the analysis information, and generates the analysis parameter corresponding to each frequency component. Next, the component element information conversion unit <b>564</b> calculates the rendering information indicating a relation between the decoded signal and the output signal for each frequency component from the analysis parameter and the component element rendering information. As a specific example of the above-mentioned conversion, the rendering information W(f) can be defined as W(f)=U(f)×B(f) from the analysis parameter B(f) and the component element rendering information U(f) defined in [Numerical equation 13] and [Numerical equation 17], respectively.

0257The rendering unit <b>562</b> generates a rendering signal from the decoded signal and the rendering information, and outputs it to the signal control unit <b>565</b>. The rendering unit <b>562</b> operates as explained in the first configuration of this embodiment. Upon defining the frequency component of the rendering signal in a certain frequency band f as I_k(f), k=1, 2, . . . , Q (Q is the number of the channels of the output signal), the rendering signal behaves like I(f)=[I₁(f)I₂(f) . . . I_Q(f)]^T=W(f)×X(f).

0258The signal control unit <b>565</b> generates the output signal from the rendering signal, the component element rendering information, and the signal control information. The following relation of the output signal V(f) holds by employing a conversion function F₅₀₅that is specified with the component element rendering information and the signal control information.

0000<br /><i>V</i>(<i>f</i>)=<i>F</i>₅₀₅(<i>I</i>(<i>f</i>))  [Numerical equation 20]

0259As a specific example of the above-mentioned conversion, when the signal control information A(f) and the component element rendering information U(f) defined in [Numerical equation 14] and [Numerical equation 17], respectively, are employed, [Numerical equation 20] can be expressed as follows.

0000<br /><i>V</i>(<i>f</i>)=<i>U</i>(<i>f</i>)·<i>A</i>(<i>f</i>)·<i>U</i>⁻¹(<i>f</i>)·<i>I</i>(<i>f</i>)  [Numerical equation 21]

0260As explained above, the fifth embodiment of the present invention enables the receiving unit to control the input signal independently for each component element corresponding to each sound source of the input signal based upon the analysis information. Further, the localization of each component element can be controlled based upon the component element rendering information. Further, only a specific sound source can be also controlled independently based upon the signal control information.

0261In addition, the receiving unit can curtail the arithmetic quantity relating to the calculation of the analysis information because the transmission unit calculates the analysis information.

0262A sixth embodiment of the present invention will be explained. This embodiment is for controlling the objective sound and the background sound by employing the transmission signal, the component element rendering information, and the signal control information with the input signal, in which the objective sound and the background sound coexist, targeted as a sound source. This embodiment, which is represented in <figref idref="DRAWINGS">FIG. 30</figref> similarly to the fifth embodiment, differs in configurations of a signal analysis unit <b>101</b> and an output signal generation unit <b>550</b>. Thereupon, the signal analysis unit <b>101</b> and the output signal generation unit <b>550</b> will be explained in details.

0263A first example of this embodiment relates to the case that the analysis information is a suppression coefficient. In <figref idref="DRAWINGS">FIG. 30</figref>, the signal analysis unit <b>101</b> outputs the suppression coefficient as analysis information. The output signal generation unit <b>550</b>, responding to this, controls the decoded signal based upon the signal control information and the component element rendering information by employing the suppression coefficient. The configuration of the signal analysis unit <b>101</b> was explained in details in the first example of the second embodiment, so its explanation is omitted. Hereinafter, the output signal generation unit <b>550</b> will be explained in details.

0264While a configuration of the output signal generation unit <b>550</b> of <figref idref="DRAWINGS">FIG. 30</figref> for controlling the objective sound and the background sound by employing the suppression coefficient is represented in <figref idref="DRAWINGS">FIG. 32</figref> similarly to the second configuration example of the output signal generation unit <b>550</b> in the fifth embodiment, the former differs from the latter in a configuration of a component element information conversion unit <b>563</b>. Thereupon, hereinafter, the component element information conversion unit <b>563</b> will be explained.

0265A configuration example of the component element information conversion unit <b>563</b> is shown in <figref idref="DRAWINGS">FIG. 34</figref>. The component element information conversion unit <b>563</b> is configured of a component element parameter generation unit <b>651</b> and a rendering information generation unit <b>652</b>. The component element parameter generation unit <b>651</b> re-configures the suppression coefficient corresponding to each frequency component from the analysis information, calculates the component element parameter based upon the signal control information, and supplies it to the rendering information generation unit <b>652</b>.

0266As a specific example of the above-mentioned conversion, upon defining the suppression coefficient corresponding to each frequency component of a certain frequency band f as g_i(f), i=1, 2, . . . , P (P is the number of the channels of the decoded signal), the signal control information for controlling the objective sound as A_main(f), and the signal control information for controlling the background sound as A_sub(f), a component element parameter H(f) can be expressed with the following equation.

0000<maths id="MATH-US-00012" num="00012"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>H</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>A</mi><mi>main</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mrow><msub><mi>A</mi><mi>sub</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow><mo></mo><mrow><mo> </mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>g</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>g</mi><mi>P</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mn>1</mn><mo>-</mo><mrow><msub><mi>g</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><mn>1</mn><mo>-</mo><mrow><msub><mi>g</mi><mi>P</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>22</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0012.tif" />

0267The rendering information generation unit <b>652</b> outputs the rendering information indicating a relation between the decoded signal and the output signal based upon the component element parameter and the component element rendering information. Now think about the case that M=2 in [Numerical equation 17] as a specific example of the above-mentioned conversion, the rendering information W(f) can be defined as W(f)=U(f)×H(f).

0268Additionally, as another configuration example of the component element information conversion unit <b>563</b>, the component element parameter generation unit <b>651</b> and the rendering information generation unit <b>652</b> in <figref idref="DRAWINGS">FIG. 34</figref> can be also integrated. In this case, the analysis information is decoded, the suppression coefficient corresponding to each frequency component is calculated, the rendering information is calculated from the suppression coefficient, the signal control information, and the component element rendering information, and the rendering information is outputted to the rendering unit <b>562</b>.

0269Now think about the case that M=2 in [Numerical equation 17] as a specific example of the above-mentioned conversion, the rendering information W(f) can be expressed with the following equation.

0000<maths id="MATH-US-00013" num="00013"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>W</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><mrow><mi>U</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>A</mi><mi>main</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mrow><msub><mi>A</mi><mi>sub</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow><mo></mo><mrow><mo> </mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>g</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>g</mi><mi>P</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mn>1</mn><mo>-</mo><mrow><msub><mi>g</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><mn>1</mn><mo>-</mo><mrow><msub><mi>g</mi><mi>P</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>23</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0013.tif" />

0270A second example of this embodiment relates to the case that the analysis information is a signal versus background sound ratio. In <figref idref="DRAWINGS">FIG. 30</figref>, the signal analysis unit <b>101</b> outputs the signal versus background sound ratio as analysis information. The output signal generation unit <b>550</b>, responding to this, controls the decoded signal based upon the signal control information and the component element rendering information by employing the signal versus background sound ratio. The second example differs from the first example only in configurations of the signal analysis unit <b>101</b> and the output signal generation unit <b>550</b>. The signal analysis unit <b>101</b> for calculating the signal versus background sound ratio as analysis information was explained in details in the second example of the second embodiment, so its explanation is omitted. Hereinafter, an operation of the output signal generation unit <b>550</b> will be explained in details.

0271A configuration of the output signal generation unit <b>550</b> of <figref idref="DRAWINGS">FIG. 30</figref> for controlling the objective sound and the background sound by employing the signal versus background sound ratio is represented in <figref idref="DRAWINGS">FIG. 32</figref> and <figref idref="DRAWINGS">FIG. 34</figref> similarly to case of the first example. Upon making a comparison with the first example, this example differs in a configuration of the component element parameter generation unit <b>651</b> of <figref idref="DRAWINGS">FIG. 34</figref>. Thereupon, hereinafter, the component element parameter generation unit <b>651</b> will be explained.

0272The component element parameter generation unit <b>651</b> decodes the analysis information, calculates the signal versus background sound ratio corresponding to each frequency component, calculates the component element parameter for controlling the objective sound and the background sound based upon the signal control information from the signal versus background sound ratio, and supplies it to the rendering information generation unit <b>652</b>. For example, after the signal versus background sound ratio is converted into the suppression coefficient as explained in the second embodiment, the component element parameter can be calculated based upon the signal control information by employing [Numerical equation 22] as explained in the first embodiment. Further, as explained in the fourth embodiment, the method of, after manipulating the signal versus background sound ratio based upon the signal control information, and converting the manipulated signal versus background sound ratio into the suppression coefficient, calculating the component element parameter may be employed as another method. In this case, upon defining the converted suppression coefficient as g_i(f), a component element parameter H(f) behaves like the following equation.

0000<maths id="MATH-US-00014" num="00014"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>H</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo> </mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msubsup><mi>g</mi><mn>1</mn><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msubsup><mi>g</mi><mi>P</mi><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mn>1</mn><mo>-</mo><mrow><msubsup><mi>g</mi><mn>1</mn><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><mn>1</mn><mo>-</mo><mrow><msubsup><mi>g</mi><mi>P</mi><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>24</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0014.tif" />

0273As another configuration example of the component element information conversion unit <b>563</b> of <figref idref="DRAWINGS">FIG. 32</figref>, the component element parameter generation unit <b>651</b> and the rendering information generation unit <b>652</b> of <figref idref="DRAWINGS">FIG. 34</figref> can be integrated. In this case, the signal versus background sound ratio corresponding to each frequency component is calculated by decoding the analysis information, the rendering information is calculated from the signal versus background sound ratio, the signal control information, and the component element rendering information, and the rendering information is outputted to the rendering unit <b>562</b>. As a specific example, for example, after the signal versus background sound ratio is converted into the suppression coefficient as explained in the second embodiment, the rendering information is calculated from the suppression coefficient, the signal control information, and the component element rendering information by employing [Numerical equation 23], and the rendering information is outputted to the rendering unit <b>562</b> as explained in the first embodiment. Further, as another method, as explained in the fourth embodiment, after the signal versus background sound ratio is manipulated based upon the signal control information, and the manipulated signal versus background sound ratio is converted into the suppression coefficient, the rendering information may be calculated from the converted suppression coefficient and the component element rendering information. In this case, the rendering information W(f) behaves like the following equation.

0000<maths id="MATH-US-00015" num="00015"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>W</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><mi>U</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msubsup><mi>g</mi><mn>1</mn><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msubsup><mi>g</mi><mi>P</mi><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mn>1</mn><mo>-</mo><mrow><msubsup><mi>g</mi><mn>1</mn><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><mn>1</mn><mo>-</mo><mrow><msubsup><mi>g</mi><mi>P</mi><mi>′</mi></msubsup><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>25</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0015.tif" />

0274A third example of this embodiment relates to the case that the analysis information is background sound. Upon making a reference to <figref idref="DRAWINGS">FIG. 30</figref>, the signal analysis unit <b>101</b> calculates the background sound as analysis information. The output signal generation unit <b>550</b>, responding to this, controls the decoded signal based upon the signal control information and the component element rendering information by employing the background sound. The third example differs from the first example only in configurations of the signal analysis unit <b>101</b> and the output signal generation unit <b>550</b>. The signal analysis unit <b>101</b> for calculating the background sound as analysis information was explained in details in the third example of the second embodiment, so its explanation is omitted. Thereupon, hereinafter, an operation of the output signal generation unit <b>550</b> will be explained in details.

0275A configuration example of the output signal generation unit <b>550</b> of <figref idref="DRAWINGS">FIG. 30</figref> for controlling the objective sound and the background sound by employing the background sound is shown in <figref idref="DRAWINGS">FIG. 35</figref>. The third example of <figref idref="DRAWINGS">FIG. 35</figref> differs from the first example shown in <figref idref="DRAWINGS">FIG. 32</figref> in a point that the component element information conversion unit <b>563</b> is replaced with a component element information conversion unit <b>655</b>. Hereinafter, the component element information conversion unit <b>655</b> will be explained.

0276The component element information conversion unit <b>655</b>, into which the decoded signal, the analysis information, the signal control information, and the component element rendering information are inputted, generates the rendering information indicating a relation between the decoded signal and the output signal for each frequency component, and outputs it to the rendering unit <b>562</b>. A configuration example of the component element information conversion unit <b>655</b> is shown in <figref idref="DRAWINGS">FIG. 36</figref>. The component element information conversion unit <b>655</b> is configured of a conversion unit <b>171</b>, a component element parameter generation unit <b>653</b>, and a rendering information generation unit <b>652</b>. The conversion unit <b>171</b> decomposes the decoded signal into the respective frequency components, generates the second converted signal, and outputs the second converted signal to the component element parameter generation unit <b>653</b>.

0277The component element parameter generation unit <b>653</b> has the second converted signal, the analysis information, and the signal control information as an input. The component element parameter generation unit <b>653</b> calculates the background sound by decoding the analysis information, calculates the component element parameter for controlling the objective sound and the background sound based upon the signal control information from the second converted signal and the background sound, and outputs it to the rendering information generation unit <b>652</b>.

0278Hereinafter, a specific example of the method of calculating the component element parameter is shown. In a first method, the suppression coefficient is calculated from the background sound and the second converted signal as explained in the third example of the second embodiment. In addition, the component element parameter is calculated based upon the signal control information by applying [Numerical equation 25] for the suppression coefficient. In a second method, the suppression coefficient is calculated from the background sound, the signal control information, and the second converted signal with the method explained in the fourth example and the fifth example of the fourth embodiment. The component element parameter is calculated by applying [Numerical equation 24] for the suppression coefficient calculated with the foregoing methods.

0279Additionally, the component element parameter generation unit <b>653</b> and the rendering information generation unit <b>652</b> of <figref idref="DRAWINGS">FIG. 36</figref> can be also integrated as another configuration example of the component element information conversion unit <b>655</b> of <figref idref="DRAWINGS">FIG. 35</figref>. In this case, the rendering information is calculated from the second converted signal corresponding to each frequency component, the background sound corresponding to each frequency component in which the analysis information has been decoded, the signal control information, and the component element rendering information, and the rendering information is outputted to the rendering unit <b>562</b>.

0280Hereinafter, a specific example of the method of calculating the rendering information is shown. In a first method, the suppression coefficient is calculated from the background sound by employing the decoded signal as explained in the third example of the second embodiment. In addition, the rendering information is calculated from the suppression coefficient, the signal control information, and the component element rendering information by employing [Numerical equation 23]. In a second method, the suppression coefficient is calculated from the background sound, the signal control information, and the second converted signal with the method explained in the fourth example and the fifth example of the fourth embodiment. The rendering information is calculated from the suppression coefficient and the component element rendering information by employing [Numerical equation 25] for the suppression coefficient calculated with the foregoing methods.

0281As explained above, the sixth embodiment of the present invention enables the receiving unit to control the input signal, which is configured of the objective sound and the background sound, independently based upon the analysis information. Further, the localization of the objective sound and the background sound can be controlled based upon the component element rendering information. Further, only a specific sound source can be also controlled independently based upon the signal control information.

0282In addition, the receiving unit can curtail the arithmetic quantity relating to the calculation of the analysis information because the transmission unit calculates the analysis information.

0283A seventh embodiment of the present invention will be explained by making a reference to <figref idref="DRAWINGS">FIG. 37</figref>. Upon comparing <figref idref="DRAWINGS">FIG. 37</figref> with <figref idref="DRAWINGS">FIG. 30</figref> indicative of the fifth embodiment, the former differs from the latter in a point that the receiving unit <b>55</b> of <figref idref="DRAWINGS">FIG. 30</figref> is replaced with a receiving unit <b>75</b> in <figref idref="DRAWINGS">FIG. 37</figref>. The receiving unit <b>75</b>, into which the transmission signal and the component element rendering information are inputted, outputs the signal, which is configured of a plurality of the channels, as an output signal. The receiving unit <b>75</b> differs from the receiving unit <b>55</b> of the fifth embodiment in a point of not having the signal control signal as an input, and a point that the output signal generation unit <b>550</b> is replaced with an output signal generation unit <b>750</b>. Additionally, the component element rendering information of this embodiment may include the information for manipulating each component element that is included in the decoded signal. The output signal generation unit <b>750</b> can manipulate the decoded signal with the component element group, which is configured of a plurality of the component element, defined as a unit instead of each component element corresponding to the sound source.

0284Upon comparing the receiving unit <b>75</b> with the receiving unit <b>55</b> explained in the fifth embodiment, the former differs from the latter in a point that the output signal generation unit <b>550</b> is replaced with the output signal generation unit <b>750</b>. Hereinafter, a configuration example of the output signal generation unit <b>750</b>, which is characteristic of this embodiment, will be explained.

0285In <figref idref="DRAWINGS">FIG. 38</figref>, a configuration example of the output signal generation unit <b>750</b> of <figref idref="DRAWINGS">FIG. 37</figref> is shown. The output signal generation unit <b>750</b> is configured of a component element information conversion unit <b>760</b> and a rendering unit <b>562</b>. The output signal generation unit <b>750</b> differs from the output signal generation unit <b>550</b> shown in <figref idref="DRAWINGS">FIG. 32</figref> of the fifth embodiment in a point that the component element information conversion unit <b>563</b> is replaced with the component element information conversion unit <b>750</b>. Hereinafter, a configuration example of the component element information conversion unit <b>760</b> will be explained.

0286The component element information conversion unit <b>760</b>, into which the analysis information and the component element rendering information are inputted, outputs the rendering information. At first, the component element information conversion unit <b>760</b> decodes the analysis information, and calculates the analysis parameter corresponding to each frequency component. In addition, the component element information conversion unit <b>760</b> generates the rendering information indicating a relation between the decoded signal and the output signal of the output signal generation unit <b>750</b> for each frequency component by employing the analysis parameter and the component element rendering information.

0287As a specific example of the above-mentioned conversion, the rendering information W(f) can be expresses by W(f)=U(f)×B(f) by employing [Numerical equation 13] and [Numerical equation 17]. Where B(f) is an analysis parameter of the frequency band f, and U(f) is component element rendering information.

0288This configuration example is characterized in incorporating the information for taking a control for each component element into the rendering information, and realizing the manipulation for each component element in the rendering unit <b>562</b>.

0289As explained above, the seventh embodiment of the present invention enables the receiving unit to control the input signal independently for each component element corresponding to each sound source of the input signal based upon the analysis information. In addition, the localization of each component element can be controlled based upon the component element rendering information.

0290In addition, the receiving unit can curtail the arithmetic quantity relating to the calculation of the analysis information because the transmission unit calculates the analysis information.

0291An eighth embodiment of the present invention will be explained. This embodiment makes it possible to control the objective sound and the background sound independently, and to control the localization of the objective sound and the background sound by employing the component element rendering information supplied to the receiving unit with the input signal, in which the objective sound and the background sound coexist as a sound source, targeted. This embodiment, which is represented in <figref idref="DRAWINGS">FIG. 37</figref> similarly to the seventh embodiment, differs in configurations of the signal analysis unit <b>101</b> and the output signal generation unit <b>750</b>. Hereinafter, the signal analysis unit <b>101</b> and the output signal generation unit <b>750</b> will be explained in details.

0292A first example of this embodiment relates to the case that the analysis information is a suppression coefficient. The signal analysis unit <b>101</b> of the transmission unit <b>10</b> outputs the suppression coefficient as analysis information. The output signal generation unit <b>750</b>, responding to this, controls the decoded signal by employing the component element rendering information and the suppression coefficient. The signal analysis unit <b>101</b> in the case of employing the suppression coefficient as analysis information was explained in details in the first example of the second embodiment, so its explanation is omitted. Hereinafter, an operation of the output signal generation unit <b>750</b> will be explained in details.

0293While a configuration example of the output signal generation unit <b>750</b> of <figref idref="DRAWINGS">FIG. 37</figref> for controlling the objective sound and the background sound by employing the suppression coefficient is represented in <figref idref="DRAWINGS">FIG. 38</figref> similarly to that of the output signal generation unit <b>750</b> of the seventh embodiment, the former differs from the latter in a configuration of a component element information conversion unit <b>760</b>. A configuration example of the component element information conversion unit <b>760</b> is shown in <figref idref="DRAWINGS">FIG. 39</figref>. The component element information conversion unit <b>760</b> is configured of a component element parameter generation unit <b>851</b> and a rendering information generation unit <b>652</b>.

0294The component element parameter generation unit <b>851</b> has the analysis information as an input. The component element parameter generation unit <b>851</b> decodes the analysis information, re-configures the suppression coefficient corresponding to each frequency component, calculates the component element parameter, and outputs it to the rendering information generation unit <b>652</b>. As a specific example of this conversion, upon defining the suppression coefficient corresponding to each frequency component of the frequency band f as g_i(f), a component element parameter H(f) is equivalent to the case that A_main(f)=1 and A_sub(f)=1 in [Numerical equation 22], namely, behaves like the following equation.

0000<maths id="MATH-US-00016" num="00016"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>H</mi><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo> </mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>g</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><msub><mi>g</mi><mi>P</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mn>1</mn><mo>-</mo><mrow><msub><mi>g</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mtd><mtd><mi>…</mi></mtd><mtd><mrow><mn>1</mn><mo>-</mo><mrow><msub><mi>g</mi><mi>P</mi></msub><mo></mo><mrow><mo>(</mo><mi>f</mi><mo>)</mo></mrow></mrow></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Numerical</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>26</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2010189280A1_D0016.tif" />

0295The rendering information generation unit <b>652</b> was already explained in the sixth embodiment by employing <figref idref="DRAWINGS">FIG. 34</figref>, so its explanation is omitted.

0296A second example of this embodiment relates to the case that the analysis information is a signal versus background sound ratio. The signal analysis unit <b>101</b> of the transmission unit <b>10</b> outputs the signal versus background sound ratio as analysis information. The output signal generation unit <b>750</b>, responding to this, controls the decoded signal based upon the component element rendering information by employing the signal versus background sound ratio. The signal analysis unit <b>101</b> in the case of employing the signal versus background sound ratio as analysis information was explained in details in the second example of the second embodiment, so its explanation is omitted. Hereinafter, an operation of the output signal generation unit <b>750</b> will be explained in details.

0297A configuration example of the output signal generation unit <b>750</b> of <figref idref="DRAWINGS">FIG. 37</figref> for controlling the objective sound and the background sound by employing the signal versus background sound ratio is represented in <figref idref="DRAWINGS">FIG. 38</figref> similarly to the case of the first example. This example differs from the first example in a configuration of a component element parameter generation unit <b>851</b> of <figref idref="DRAWINGS">FIG. 39</figref> indicative of a configuration of the component element information conversion unit <b>760</b>. Hereinafter, the component element parameter generation unit <b>851</b> will be explained.

0298The component element parameter generation unit <b>851</b>, into which the analysis information is inputted, decodes the analysis information, and calculates the signal versus background sound ratio corresponding to each frequency component. In addition, the component element parameter generation unit <b>851</b> calculates the component element parameter from the signal versus background sound ratio, and outputs it to the rendering information generation unit <b>652</b>. As a method of calculating the component element parameter, for example, the signal versus background sound ratio is converted into the suppression coefficient as explained in the second example of the second embodiment. In addition, the component element parameter is calculated from the suppression coefficient by employing [Numerical equation 26] as explained in the first example of this embodiment.

0299A third example of this embodiment relates to the case that the analysis information is background sound. The signal analysis unit <b>101</b> of the transmission unit <b>10</b> outputs the background sound as analysis information. The output signal generation unit <b>750</b>, responding to this, controls the decoded signal based upon the background sound and the component element rendering information. The signal analysis unit <b>101</b> in the case of employing the signal versus background sound ratio as analysis information was explained in details in the third example of the second embodiment, so its explanation is omitted. Hereinafter, an operation of the output signal generation unit <b>750</b> will be explained in details.

0300A configuration example of the output signal generation unit <b>750</b> of <figref idref="DRAWINGS">FIG. 37</figref> for controlling the objective sound and the background sound by employing the background sound is represented in <figref idref="DRAWINGS">FIG. 40</figref>. This example of <figref idref="DRAWINGS">FIG. 40</figref> differs from the first example of <figref idref="DRAWINGS">FIG. 38</figref> in a point that the component element information conversion unit <b>760</b> is replaced with a component element information conversion unit <b>761</b>. The rendering information generation unit <b>652</b> was already explained by employing <figref idref="DRAWINGS">FIG. 34</figref>, so its explanation is omitted.

0301The component element information conversion unit <b>761</b> generates the rendering information indicating a relation between the decoded signal and the output signal for each frequency component from the decoded signal, the analysis information, and the component element rendering information, and supplies it to the rendering unit <b>562</b>. A configuration example of the component element information conversion unit <b>761</b> is shown in <figref idref="DRAWINGS">FIG. 41</figref>. The component element information conversion unit <b>761</b> is configured of a conversion unit <b>171</b>, a component element parameter generation unit <b>853</b>, and a rendering information generation unit <b>652</b>. The conversion unit <b>171</b> decomposes the decoded signal into the respective frequency components, generates the second converted signal, and supplies the second converted signal to the component element parameter generation unit <b>853</b>.

0302The component element parameter generation unit <b>853</b> has the analysis information and the second converted signal as an input. The component element parameter generation unit <b>853</b> decodes the analysis information, calculates the background sound, calculates the component element parameter based upon the second converted signal and the background sound, and outputs it to the rendering information generation unit <b>652</b>. As a method of calculating the component element parameter, for example, the background sound is converted into the suppression coefficient as explained in the third example of the second embodiment. In addition, the component element parameter is calculated from the suppression coefficient by employing [Numerical equation 26] as explained in the first example of this embodiment.

0303As explained above, the eighth embodiment of the present invention enables the receiving unit to control the input signal, which is configured of the objective sound and the background sound, independently based upon the analysis information. Further, the localization of the objective sound and the background sound can be controlled based upon the component element rendering information.

0304In addition, the receiving unit can curtail the arithmetic quantity relating to the calculation of the analysis information because the transmission unit calculates the analysis information such as the suppression coefficient and the signal versus background sound ratio.

0305A ninth embodiment of the present invention will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 42</figref>. Upon making a comparison with the first embodiment of the present invention shown in <figref idref="DRAWINGS">FIG. 1</figref>, the transmission unit <b>10</b> of the first embodiment is replaced with a transmission unit <b>90</b>. In addition, while the transmission unit <b>10</b> is configured of the signal analysis unit <b>101</b>, the transmission unit <b>90</b> is configured of a signal analysis unit <b>900</b>. Further, the input signal and the encoded signal coming from an encoding unit <b>100</b> are inputted into the signal analysis unit <b>900</b>.

0306Further, in the second embodiment to the eighth embodiment, the signal analysis unit <b>101</b> being included in the transmission unit <b>10</b> may be replaced with the signal analysis unit <b>900</b> of this embodiment. In this case, it is enough for the input signal and the encoded signal coming from an encoding unit <b>100</b> to be inputted into the signal analysis unit <b>900</b>.

0307With the ninth embodiment, the signal analysis unit <b>900</b> makes an analysis taking into consideration an influence of quantizing distortion that has occurred in the encoding unit, thereby enabling the quantizing distortion, which occurs at the moment that the receiving unit <b>15</b> performs the decoding, to be reduced.

0308A first configuration example of the signal analysis unit <b>900</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 43</figref>.

0309The signal analysis unit <b>900</b> generates the analysis information from the input signal and the encoded signal coming from an encoding unit <b>100</b>. The signal analysis unit <b>900</b> can generate the analysis information by taking the quantizing distortion quantity into consideration because the encoded signal is a signal to which the quantizing distortion has been added.

0310The signal analysis unit <b>900</b> receives the input signal and the encoded signal coming from an encoding unit <b>100</b>, and outputs the analysis information. The signal analysis unit <b>900</b> is configured of a conversion unit <b>120</b>, a decoding unit <b>150</b>, a quantizing distortion calculation unit <b>910</b>, an analysis information generation unit <b>911</b>, and a conversion unit <b>920</b>.

0311The input signal is inputted into the conversion unit <b>120</b>. Further, the encoded signal coming from an encoding unit <b>100</b> is inputted into the decoding unit <b>150</b>.

0312The decoding unit <b>150</b> decodes the encoded signal inputted from the encoding unit <b>100</b>. The decoding unit <b>150</b> outputs the decoded signal to the conversion unit <b>920</b>. The conversion unit <b>920</b> decomposes the decoded signal into the frequency components. The conversion unit <b>920</b> outputs the decoded signal decomposed into the frequency components to the quantizing distortion calculation unit <b>910</b>.

0313The conversion unit <b>120</b> decomposes the input signal into the frequency components. The conversion unit <b>120</b> outputs the input signal decomposed into the frequency components to the quantizing distortion calculation unit <b>910</b> and the analysis information generation unit <b>911</b>. The quantizing distortion calculation unit <b>910</b> compares the decoded signal decomposed into the frequency components with the input signal decomposed into the frequency components, and calculates the quantizing distortion quantity for each frequency component. For example, a difference between magnitude of each frequency component of the decoded signal decomposed into the frequency components and magnitude of each frequency component of the input signal decomposed into the frequency components could be the quantizing distortion in the above frequency. The quantizing distortion calculation unit <b>910</b> outputs the quantizing distortion quantity of each frequency to the analysis information generation unit <b>911</b>.

0314The analysis information generation unit <b>911</b> receives the input signal decomposed into the frequency components from the conversion unit <b>120</b>, and receives the quantizing distortion quantity of each frequency from the quantizing distortion calculation unit <b>910</b>. With regard to the input signal decomposed into the frequency components, the analysis information generation unit <b>911</b> decomposes the input signal corresponding to each frequency component for each component element corresponding to the sound source. And, the analysis information generation unit <b>911</b> generates the analysis information indicative of a relation between a plurality of the component elements. The analysis information generation unit <b>911</b> outputs the analysis information. Further, With regard to the input signal decomposed into the frequency components, the analysis information generation unit <b>911</b> may decompose the input signal for each component element group that is configured of a plurality of the component elements.

0315The analysis information generation unit <b>911</b>, taking the quantizing distortion quantity into consideration, calculates the analysis information so that the quantizing distortion quantity is reduced at the moment that the receiving unit performs the decoding. For example, the analysis information generation unit <b>911</b> may calculate the analysis information from magnitude of each frequency component of the input signal decomposed into the frequency components and magnitude of the quantizing distortion in the above frequency so that the quantizing distortion is auditorily masked. Herein, the analysis information generation unit <b>911</b> may utilize the fact that the small component becomes hard to hear in a frequency neighboring the frequency of which the frequency component is large due to the auditory masking. The magnitude of the component, which becomes hard to hear in the neighboring frequency due to the magnitude of each frequency component, is defined as a masking characteristic. The analysis information generation unit <b>911</b> calculates the masking characteristic in terms of all frequencies. The analysis information generation unit <b>911</b> corrects the analysis information by taking an influence of the quantizing distortion into consideration in each frequency. The quantizing distortion is hard to hear when the magnitude of the quantizing distortion is smaller than the masking characteristic. In this case, the analysis information generation unit <b>911</b> does not correct the analysis information because an influence of the quantizing distortion is small. The quantizing distortion is not masked when the magnitude of the quantizing distortion is larger than the masking characteristic. In this case, the analysis information generation unit <b>911</b> corrects the analysis information so that the quantizing distortion is reduced. For example, when the suppression coefficient is employed as analysis information, the suppression coefficient, which is relatively small, should be employed so as to suppress the quantizing distortion as well simultaneously with the background sound.

0316As mentioned above, the analysis information generation unit <b>911</b> corrects the analysis information, thereby allowing quantizing distortion to be auditorily masked, and the distortion and the noise to be reduced at the moment that the receiving unit performs the decoding.

0317So far, the correction of the analysis information such that the quantizing distortion was reduced by taking the auditory masking into consideration was explained. However, a configuration for correcting the analysis information so that the quantizing distortion is reduced in all frequencies without the auditory masking taken into consideration may be employed.

0318A second configuration example of the signal analysis unit <b>900</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 44</figref>.

0319The signal analysis unit <b>900</b> receives the input signal and the encoded signal coming from the encoding unit <b>100</b>, and outputs the analysis information. The signal analysis unit <b>900</b> is configured of a conversion unit <b>120</b>, a decoding unit <b>150</b>, a quantizing distortion calculation unit <b>910</b>, an analysis information generation unit <b>912</b>, and a conversion unit <b>920</b>.

0320The input signal is inputted into the conversion unit <b>120</b>. Further, the encoded signal coming from the encoding unit <b>100</b> is inputted into the decoding unit <b>150</b>.

0321The decoding unit <b>150</b> decodes the encoded signal inputted from the encoding unit <b>100</b>.

0322The decoding unit <b>150</b> outputs the decoded signal to the conversion unit <b>920</b>. The conversion unit <b>920</b> decomposes the decoded signal into the frequency components. The conversion unit <b>920</b> outputs the decoded signal decomposed into the frequency components to the quantizing distortion calculation unit <b>910</b> and the analysis information generation unit <b>912</b>.

0323The conversion unit <b>120</b> decomposes the input signal into the frequency components. The conversion unit <b>120</b> outputs the input signal decomposed into the frequency components to the quantizing distortion calculation unit <b>910</b>. The quantizing distortion calculation unit <b>910</b> compares the decoded signal decomposed into the frequency components with the input signal decomposed into the frequency components, and calculates the quantizing distortion quantity for each frequency component. For example, a difference between the magnitude of each frequency component of the decoded signal decomposed into the frequency components and the magnitude of each frequency component of the input signal decomposed into the frequency components could be the quantizing distortion in the above frequency. The quantizing distortion calculation unit <b>910</b> outputs the quantizing distortion quantity of each frequency to the analysis information generation unit <b>912</b>.

0324The analysis information generation unit <b>912</b> receives the decoded signal decomposed into the frequency components from the conversion unit <b>920</b>, and receives the quantizing distortion quantity of each frequency from the quantizing distortion calculation unit <b>910</b>. With regard to the decoded signal decomposed into the frequency components, the analysis information generation unit <b>912</b> decomposes the input signal corresponding to each frequency component for each component element that corresponds to the sound source. And, the analysis information generation unit <b>912</b> generates the analysis information indicative of a relation between a plurality of the component elements. The analysis information generation unit <b>912</b> outputs the analysis information corrected so that the quantizing distortion is reduced. The calculation of the analysis information such that the quantizing distortion is reduced is similar to the case of the first configuration example, so its explanation is omitted.

0325As explained above, the first configuration example and the second configuration example of the signal analysis unit <b>900</b> have an effect that generating the analysis information so as to reduce an influence of the encoding distortion that occurred in the encoding unit <b>100</b> makes it possible to reduce the quantizing distortion that occurs at the moment that the receiving unit <b>15</b> performs the decoding.

0326Continuously, a tenth embodiment of the present invention will be explained. The tenth embodiment of the present invention is for controlling the input signal that is configured of the objective sound and the background sound as a sound source. A configuration of the tenth embodiment of the present invention is shown in <figref idref="DRAWINGS">FIG. 42</figref> and <figref idref="DRAWINGS">FIG. 43</figref> similarly to that of the ninth embodiment of the present invention. This embodiment differs from the ninth embodiment of the present invention in <figref idref="DRAWINGS">FIG. 43</figref> in a configuration of an analysis information generation unit <b>911</b>.

0327A configuration example of the analysis information generation unit <b>911</b> in the tenth embodiment of the present invention will be explained in details by making a reference <figref idref="DRAWINGS">FIG. 45</figref>. Upon comparing the analysis information generation unit <b>121</b> shown in <figref idref="DRAWINGS">FIG. 6</figref> with the analysis information generation unit <b>911</b> shown in <figref idref="DRAWINGS">FIG. 45</figref>, the latter differs from the former in a point that the quantizing distortion quantity of each frequency coming from the quantizing distortion calculation unit <b>910</b> is inputted. In addition, while the analysis information generation unit <b>121</b> is configured of the background sound estimation unit <b>200</b>, the analysis information generation unit <b>911</b> is configured of a background sound estimation unit <b>1020</b>. Explanation of a portion which overlaps the portion explained in <figref idref="DRAWINGS">FIG. 6</figref> and <figref idref="DRAWINGS">FIG. 43</figref> is omitted.

0328The analysis information generation unit <b>911</b> receives the input signal decomposed into the frequency components and the quantizing distortion quantity of each frequency, and outputs the analysis information. The analysis information generation unit <b>911</b> is configured of a background sound information generation unit <b>202</b> and the background sound estimation unit <b>1020</b>.

0329The background sound estimation unit <b>1020</b> receives the input signal decomposed into the frequency components and the quantizing distortion quantity of each frequency. The background sound estimation unit <b>1020</b> estimates the background sound by taking the quantizing distortion quantity into consideration. For example, the background sound estimation unit <b>1020</b> can perform a process similar to the process, which the background sound estimation unit <b>200</b> being included in the analysis information generation unit <b>121</b> performs, with the background sound obtained by adding the quantizing distortion to the estimated background sound defined as an estimated background sound. The background sound estimation unit <b>1020</b> outputs the information of the background sound in which the quantizing distortion has been taken into consideration to the background sound information generation unit <b>202</b>. The background sound information generation unit <b>202</b> generates the analysis information based upon the information of the background sound. And, the background sound information generation unit <b>202</b> outputs the analysis information in which the quantizing distortion has been taken into consideration.

0330The receiving unit <b>15</b> controls the decoded signal based upon the analysis information in which the quantizing distortion has been taken into consideration. This configuration makes it possible to take a high-quality control in which the quantizing distortion has been taken into consideration at the moment of controlling the decoded signal. In addition, this configuration yields an effect that the quantizing distortion, which occurs when the receiving unit <b>15</b> performs the decoding, can be reduced.

0331In addition, in the tenth embodiment of the present invention, the background sound information generation unit <b>202</b> may be adapted to output the suppression coefficient as analysis information, the signal versus background sound ratio or the background sound itself.

0332The analysis information generation unit <b>911</b> in <figref idref="DRAWINGS">FIG. 43</figref> calculates and encodes the suppression coefficient when encoding and outputting the suppression coefficient as analysis information. The analysis information generation unit <b>911</b> in <figref idref="DRAWINGS">FIG. 43</figref> may employ the configuration of the background sound information generation unit <b>202</b> shown in <figref idref="DRAWINGS">FIG. 7</figref> as that of the background sound information generation unit <b>202</b> thereof so as to output the suppression coefficient. In this case, the signal control unit <b>151</b> of the receiving unit <b>15</b> in <figref idref="DRAWINGS">FIG. 42</figref> is configured so as to correspond to the control of the decoded signal by the suppression coefficient.

0333The analysis information generation unit <b>911</b> in <figref idref="DRAWINGS">FIG. 43</figref> calculates and encodes the signal versus background sound ratio when encoding and outputting the signal versus background sound ratio as analysis information. The analysis information generation unit <b>911</b> in <figref idref="DRAWINGS">FIG. 43</figref> may employ the configuration of the background sound information generation unit <b>202</b> shown in <figref idref="DRAWINGS">FIG. 10</figref> or the configuration of the background sound information generation unit <b>202</b> shown in <figref idref="DRAWINGS">FIG. 12</figref> as that of the background sound information generation unit <b>202</b> thereof so as to encode the signal versus background sound ratio. In this case, the signal control unit <b>151</b> of the receiving unit <b>15</b> in <figref idref="DRAWINGS">FIG. 42</figref> is configured so as to correspond to the control of the decoded signal by the signal versus background sound ratio.

0334The analysis information generation unit <b>911</b> in <figref idref="DRAWINGS">FIG. 43</figref> encodes and outputs the estimated background sound estimated in the background sound estimation unit <b>1020</b> when encoding and outputting the background sound itself as analysis information.

0335A configuration example of the analysis information generation unit <b>911</b> for outputting the background sound itself as analysis information will be explained by making a reference to <figref idref="DRAWINGS">FIG. 46</figref>. The analysis information generation unit <b>911</b> of this configuration example receives the input signal decomposed into the frequency components and the quantizing distortion quantity of each frequency, and outputs the encoded background sound. The analysis information generation unit <b>911</b> is configured of a background sound encoding unit <b>205</b> and a background sound estimation unit <b>1020</b>. An operation of the background sound estimation unit <b>1020</b> overlaps the operation explained in <figref idref="DRAWINGS">FIG. 45</figref>, so its explanation is omitted. Further, an operation of the background sound encoding unit <b>205</b> overlaps the operation explained in <figref idref="DRAWINGS">FIG. 13</figref>, so its explanation is omitted.

0336In this case, the signal control unit <b>151</b> of the receiving unit <b>15</b> in <figref idref="DRAWINGS">FIG. 42</figref> is configured so as to correspond to the control of the decoded signal by the background sound.

0337Above, the tenth embodiment of the present invention is for controlling the decoded signal based upon the suppression coefficient in which the quantizing distortion has been taken into consideration, the signal versus background sound ratio, or the background sound. This configuration makes it possible to take a high-quality control in which the quantizing distortion has been taken into consideration at the moment of controlling the decoded signal. In addition, this configuration yields an effect that the quantizing distortion and the encoding distortion, which occur at the moment that the receiving unit <b>15</b> performs the decoding, can be reduced.

0338Next, an eleventh embodiment of the present invention will be explained. The eleventh embodiment of the present invention is for reducing the arithmetic quantity in the transmission side unit, and the arithmetic quantity relating to the control for each component element corresponding to each sound source, which is taken by the receiving side unit based upon the analysis information.

0339Next, the eleventh embodiment of the present invention will be explained by making a reference to <figref idref="DRAWINGS">FIG. 47</figref>. The eleventh embodiment of the present invention shown in <figref idref="DRAWINGS">FIG. 47</figref> differs from the first embodiment of the present invention shown in <figref idref="DRAWINGS">FIG. 1</figref> in a point that the transmission unit <b>10</b> is replaced with a transmission unit <b>13</b>, and a point that the receiving unit <b>15</b> is replaced with a receiving unit <b>18</b>. With this configuration, the eleventh embodiment of the present invention can share the conversion unit existing in the transmission unit, and can share the conversion unit existing in the receiving unit. As a result, the arithmetic quantity of the transmission unit <b>13</b> and the receiving unit <b>18</b> can be reduced.

0340The transmission unit <b>13</b> shown in <figref idref="DRAWINGS">FIG. 47</figref> differs from the transmission unit <b>10</b> shown in <figref idref="DRAWINGS">FIG. 1</figref> in a point that the encoding unit <b>100</b> is replaced with an encoding unit <b>1100</b>, and a point that the signal analysis unit <b>101</b> is replaced with a signal analysis unit <b>1101</b>. In this example, the encoding unit <b>1100</b> outputs the input signal decomposed into the frequency components to the signal analysis unit <b>1101</b>.

0341A configuration example of the encoding unit <b>1100</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 48</figref>. The encoding unit <b>1100</b> shown in <figref idref="DRAWINGS">FIG. 48</figref> differs from the encoding unit <b>100</b> shown in <figref idref="DRAWINGS">FIG. 2</figref> in a point that the first converted signal, being an output of the conversion unit <b>110</b>, is outputted to the signal analysis unit <b>1101</b>. An operation of the conversion unit <b>110</b> and the quantization unit <b>111</b> overlaps the operation explained in <figref idref="DRAWINGS">FIG. 2</figref>, so its explanation is omitted. Herein, the arithmetic quantity of the encoding unit <b>1100</b> is almost identical to that of the encoding unit <b>100</b> because the encoding unit <b>1100</b> differs from the encoding unit <b>100</b> shown in <figref idref="DRAWINGS">FIG. 2</figref> only in the signal being outputted.

0342A configuration example of the signal analysis unit <b>1101</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 49</figref>. The point in which the signal analysis unit <b>1101</b> shown in <figref idref="DRAWINGS">FIG. 49</figref> differs from the signal analysis unit <b>101</b> shown in <figref idref="DRAWINGS">FIG. 4</figref> is that the conversion <b>120</b> included in the signal analysis unit <b>101</b> is deleted. An operation of the analysis information generation unit <b>121</b> overlaps the operation explained in <figref idref="DRAWINGS">FIG. 4</figref>, so its explanation is omitted.

0343The signal analysis unit <b>1101</b> receives the first converted signal from the encoding unit <b>1100</b>. The received first converted signal is inputted into the analysis information generation unit <b>121</b>. Herein, upon comparing the conversion unit <b>110</b> within the encoding unit <b>1100</b> shown in <figref idref="DRAWINGS">FIG. 48</figref> with the conversion unit <b>120</b> within the signal analysis unit <b>101</b> shown in <figref idref="DRAWINGS">FIG. 4</figref>, the first converted signal, being an output of the former, and the second converted signal, being an output of the latter, become identical to each other when the input signal being supplied to the conversion unit is identical and an operation of the conversion unit is identical. For this, it is possible to delete the conversion unit <b>120</b> in the signal analysis unit <b>1101</b>, and to use the first converted signal being outputted by the signal analysis unit <b>1101</b> as the second converted signal when an operation of the conversion unit <b>110</b> is identical to that of the conversion unit <b>120</b>. With this configuration, the arithmetic quantity of the signal analysis unit <b>1101</b> is curtailed by a portion equivalent to the arithmetic quantity of the conversion unit <b>120</b> as compared with the arithmetic quantity of the signal analysis unit <b>101</b>.

0344With regard to the receiving unit, the receiving unit <b>18</b> shown in <figref idref="DRAWINGS">FIG. 47</figref> differs from the receiving unit <b>15</b> shown in <figref idref="DRAWINGS">FIG. 1</figref> in a point that the decoding unit <b>150</b> is replaced with a decoding unit <b>1150</b>, and a point that the signal control unit <b>151</b> is replaced with a signal control unit <b>1151</b>.

0345A configuration example of the decoding unit <b>1150</b> will be explained by making a reference to <figref idref="DRAWINGS">FIG. 50</figref>. The decoding unit <b>1150</b> differs from decoding unit <b>150</b> shown in <figref idref="DRAWINGS">FIG. 3</figref> in point that the inverse conversion unit <b>161</b> is deleted. An operation of the inverse quantization unit <b>160</b> overlap the operation explained in <figref idref="DRAWINGS">FIG. 3</figref>, so its explanation is omitted. In the decoding unit <b>150</b> shown in <figref idref="DRAWINGS">FIG. 3</figref>, the inverse conversion unit <b>161</b> inverse-converts the first converted signal being outputted by the inverse quantization unit <b>160</b> into a time region signal, and outputs it as a decoded signal to the conversion unit <b>171</b> shown in <figref idref="DRAWINGS">FIG. 5</figref>. In <figref idref="DRAWINGS">FIG. 5</figref>, the conversion unit <b>171</b> performs a process of receiving the decoded signal, and performs a process of converting it into the second converted signal. Herein, as mentioned above, the first converted signal can be used as the second converted signal when an operation of the conversion unit <b>110</b> is identical to that of the conversion unit <b>120</b>. With this, the decoding unit <b>1150</b> outputs the first converted signal being outputted by the inverse quantization unit <b>160</b> to the signal processing unit <b>172</b> being included in the signal control unit <b>1151</b> in this embodiment. Thus, in this embodiment, the inverse conversion unit <b>161</b> is deleted.

0346A configuration example of the signal control unit <b>1151</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 51</figref>. The signal control unit <b>1151</b> shown in <figref idref="DRAWINGS">FIG. 51</figref> differs from the signal control unit <b>151</b> shown in <figref idref="DRAWINGS">FIG. 5</figref> in point that the conversion unit <b>171</b> is deleted. An operation of the signal processing unit <b>172</b> and the inverse conversion unit <b>173</b> overlaps the operation explained in <figref idref="DRAWINGS">FIG. 5</figref>, so its explanation is omitted.

0347In the signal control unit <b>151</b> of <figref idref="DRAWINGS">FIG. 5</figref>, the conversion unit <b>171</b> converts the decoded signal inputted as a time region signal into the second converted signal, and outputs it to the signal processing unit <b>172</b>. As mentioned above, the first converted signal can be used as the second converted signal when an operation of the conversion unit <b>110</b> is identical to that of the conversion unit <b>120</b>. With this, the signal processing unit <b>172</b> being included in the signal control unit <b>1151</b> can receive the first converted signal being outputted by the inverse quantization unit <b>160</b>. Thus, in this example, the conversion unit <b>171</b> is deleted.

0348Herein, upon paying attention to the signal being inputted into the signal control unit <b>1151</b> from the decoding unit <b>1150</b>, it can be seen that a difference between the first embodiment shown in <figref idref="DRAWINGS">FIG. 1</figref> and the eleventh embodiment shown in <figref idref="DRAWINGS">FIG. 47</figref> is whether or not the signal being outputted by the inverse quantization unit <b>160</b> goes through the inverse conversion unit <b>161</b> and the conversion unit <b>171</b>. When the first converted signal can be used as the second converted signal, the frequency component of the signal being outputted by the inverse quantization unit <b>160</b> is identical to the frequency component of the signal being inputted into the signal processing unit <b>172</b> in both of the first embodiment and the eleventh embodiment. Thus, the signal processing unit <b>172</b> within the signal control unit <b>1151</b> outputs a result identical to the result that the signal processing unit <b>172</b> shown in <figref idref="DRAWINGS">FIG. 5</figref> outputs. Further, the arithmetic quantity of the decoding unit <b>1150</b> is curtailed by a portion equivalent to the arithmetic quantity of the inverse conversion unit <b>161</b> shown in <figref idref="DRAWINGS">FIG. 3</figref> as compared with the arithmetic quantity of the decoding unit <b>150</b>. In addition, the arithmetic quantity of the signal control unit <b>1151</b> is curtailed by a portion equivalent to the arithmetic quantity of the conversion unit <b>171</b> shown in <figref idref="DRAWINGS">FIG. 5</figref> as compared with the arithmetic quantity of the signal control unit <b>151</b>.

0349Above, the eleventh embodiment of the present invention has an effect that the arithmetic quantity is curtailed by a portion equivalent to the respective arithmetic quantities of the conversion unit <b>120</b>, the inverse conversion unit <b>161</b>, and the conversion unit <b>171</b> as compared with the case of the first embodiment in addition to the effect of the first embodiment of the present invention. In addition, the configuration of the eleventh embodiment capable of curtailing the arithmetic quantity is applicable to the second embodiment to the tenth embodiment. With this, each embodiment has an effect of curtailing the arithmetic quantity that is similar to the effect of the eleventh embodiment of the present invention.

0350Above, so far, the method of analyzing the input signal that is configured of a plurality of the sound sources, calculating the analysis information, and controlling the decoded signal based upon the analysis information in the receiving side was explained in the first embodiment to the eleventh embodiment of the present invention. Herein, the details will be explained by employing a specific example. As an input signal, for example, there exist sound, musical instrument sound, etc. that differ for each utilization method. In addition to these, operational sound that each machine utters, sound or a foot step of a manipulator, etc. exist in the case of aiming for the monitoring with sound.

0351The signal analysis control system relating to the present invention is configured to analyze the input signal, and encode the analyzed result as analysis information when a plurality of the component elements exist in the input signal. A configuration similar to the configuration shown in <figref idref="DRAWINGS">FIG. 1</figref> is applied when a plurality of the component elements exist. The configuration of the signal analysis unit <b>101</b> and the signal control unit <b>151</b>, the information that the signal analysis unit <b>101</b> outputs to the multiplexing unit <b>102</b>, and the information being sent to the signal control unit <b>151</b> from the separation unit <b>152</b> will be explained in details, respectively.

0352A second configuration example of the signal analysis unit <b>101</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 52</figref>. The second configuration example of the signal analysis unit <b>101</b> is applied when a plurality of the component elements exist. This signal analysis unit <b>101</b> is configured of a sound environment analysis unit <b>1210</b> and a sound environment information encoding unit <b>1211</b>. The sound environment analysis unit <b>1210</b> analyzes the information of a plurality of the component elements being included in the input signal. The sound environment analysis unit <b>1210</b> outputs the component element analysis information to the sound environment information encoding unit <b>1211</b>. The sound environment information encoding unit <b>1211</b> encodes the component element analysis information inputted from the sound environment analysis unit <b>1210</b>. And, the sound environment information encoding unit <b>1211</b> outputs the encoded component element analysis information to the multiplexing unit <b>102</b> shown in <figref idref="DRAWINGS">FIG. 1</figref>. Herein, the multiplexing unit <b>102</b> shown in <figref idref="DRAWINGS">FIG. 1</figref> carries out the multiplexing corresponding to the component element analysis information inputted from the sound environment information encoding unit <b>1211</b>.

0353The sound environment analysis unit <b>1210</b> will be further explained in details.

0354As a method of analyzing the information of a plurality of the sound sources in the sound environment analysis unit <b>1210</b>, various methods are employable. For example, as a method of analyzing the information of a plurality of the sound sources, the method of the signal separation disclosed in Non-patent document 11 (Speech Enhancement, Springer, 2005, pp. 371-402) may be employed. Further, as a method of analyzing the information of a plurality of the sound sources, the method of the signal separation, which is called an auditory scene analysis, a computational auditory scene analysis, a single input signal separation, a single channel signal separation, etc., may be employed. With these methods of the signal separation, the sound environment analysis unit <b>1210</b> separates the input signal into a plurality of the component elements. In addition, the sound environment analysis unit <b>1210</b> converts each separated component elements into the component element analysis information that should be outputted, and outputs it. This component element analysis information can be outputted in various formats. For example, as component element analysis information, there exist the suppression coefficient for suppressing the background sound, a percentage of each component element in each frequency component, and magnitude of each frequency component of the signal of each component element itself. The percentage of the component element includes, for example, an amplitude ratio with the input signal, an energy ratio with the input signal, an average value thereof, etc. The magnitude of each frequency component of the signal includes, for example, an amplitude absolute value, an energy value, an average value thereof, etc. Further, the analysis result itself that should be outputted, or the signal that can be easily converted into the analysis result that should be outputted can be obtained in a way to the signal separation, depending upon the method of the signal separation. In that case, it is also possible to perform the process of obtaining the analysis result that should be outputted in a way to the signal separation without performing the signal separation to the end.

0355A configuration example of the signal control unit <b>151</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 53</figref>. The configuration example of the signal control unit <b>151</b> is applied when a plurality of the component elements exist. The signal control unit <b>151</b> is configured of a sound environment information decoding unit <b>1212</b> and a sound environment information processing unit <b>1213</b>. The signal control unit <b>151</b> receives the decoded signal from the decoding unit <b>150</b>, and the signal of which the analysis information has been encoded from the separation unit <b>152</b>. The sound environment information decoding unit <b>1212</b> decodes the signal received from the separation unit <b>152</b>, of which the analysis information has been encoded. The sound environment information decoding unit <b>1212</b> outputs the decoded analysis information to the sound environment information processing unit <b>1213</b>. The above analysis information is equivalent to the analysis information outputted by the sound environment analysis unit <b>1210</b> being included in the signal analysis unit <b>101</b> shown in <figref idref="DRAWINGS">FIG. 52</figref>. The sound environment information processing unit <b>1213</b> controls the decoded signal based upon the analysis information inputted from the sound environment information decoding unit <b>1212</b>. This method of the control differs depending upon a purpose of the control. For example, the sound environment information processing unit <b>1213</b> may take a control for suppressing the background sound similarly to the case of the second embodiment.

0356Above, when the component elements being included in the input signal exist in plural, applying the present invention yields the effect that is gained in the first embodiment of the present invention.

0357Above, the first embodiment of the present invention was explained with the configuration, which was applied when the component elements being included in the input signal existed in plural, exemplified. Likewise, a scheme for changing the signal analysis unit, the signal control unit, or the output signal generation unit may employed for the second embodiment to the eleventh embodiment. Further, like the configurations of the fifth embodiment to the eighth embodiment, the control for localizing the output of each component element to the output signal, which is configured of a plurality of the channels, may be taken.

0358In addition, when the number of the channels of the input signal is plural, as a technique of the analysis in the signal analysis unit <b>101</b> of the present invention, the technique, which is called a directivity control, a beamforming, a blind source separation, or an independent component analysis, may be employed. In particular, when the number of the channels of the input signal is larger than the number of the objective sound, the signal may be analyzed not by employing the above-mentioned method of estimating the background sound information or the method of the analysis being employed in a thirteenth embodiment, but by employing only the directivity control, the beamforming, the blind source separation, or the independent component analysis. For example, the technology relating to the directivity control and the beamforming is disclosed in Non-patent document 12 (Microphone arrays, Springer, 2001), and Non-patent document 13 (Speech Enhancement, Springer, 2005, pp. 229-246). Further, the technology relating to the method of the blind source separation and the independent component analysis is disclosed in Non-patent document 14 (Speech Enhancement, Springer, 2005, pp. 271-369).

0359The configuration shown in <figref idref="DRAWINGS">FIG. 1</figref> is applied for the first embodiment of the present invention when the foregoing method of the analysis is applied. In addition, the configuration of the signal analysis unit <b>101</b>, the configuration of the signal control unit <b>151</b>, the information that the signal analysis unit <b>101</b> outputs to the multiplexing unit <b>102</b>, and the information being sent to the signal control unit <b>151</b> from the separation unit <b>152</b> will be explained in details. The input signal is a signal of a plurality of the channels. A basic operation, which is similar to the operation of the first embodiment, overlaps the operation explained in <figref idref="DRAWINGS">FIG. 1</figref>, so its explanation is omitted.

0360A third configuration example of the signal analysis unit <b>101</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 54</figref>. The third configuration example of the signal analysis unit <b>101</b> corresponds to the case that the number of the channels of the input signal is plural. The signal analysis unit <b>101</b> of this configuration example employs the method of the independent component analysis as a method of analyzing the input signal. The signal analysis unit <b>101</b> of this configuration example outputs a filter coefficient for the signal separation of the component element corresponding to each sound source being included in the input signal as analysis information.

0361The signal analysis unit <b>101</b> is configured of a signal separation analysis unit <b>1200</b> and a separation filter encoding unit <b>1201</b>. The signal separation analysis unit <b>1200</b> calculates a separation filter coefficient with the method of the independent component analysis. The separation filter coefficient is a filter coefficient that is employed for performing the signal separation of the component element corresponding to each sound source being included in the input signal. And, the signal separation analysis unit <b>1200</b> outputs the separation filter coefficient to the separation filter encoding unit <b>1201</b>. The separation filter encoding unit <b>1201</b> encodes the separation filter coefficient inputted from the signal separation analysis unit <b>1200</b>. The separation filter encoding unit <b>1201</b> outputs the encoded separation filter coefficient as analysis information.

0362A third configuration example of the signal control unit <b>151</b> will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 55</figref>. The third configuration example of the signal control unit <b>151</b> corresponds to the case that the number of the channels of the input signal is plural.

0363The signal control unit <b>151</b> is configured of a separation filter decoding unit <b>1202</b> and a filter <b>1203</b>. The separation filter decoding unit <b>1202</b> receives the encoded separation filter coefficient as analysis information from the separation unit <b>152</b>. And, the separation filter decoding unit <b>1202</b> decodes the encoded separation filter coefficient, and outputs the separation filter coefficient to the filter <b>1203</b>. The filter <b>1203</b> receives the decoded signal of a plurality of the channels from the decoding unit <b>150</b>, and receives the separation filter coefficient from the separation filter decoding unit <b>1202</b>. And, the filter <b>1203</b> performs the filtering process based upon the separation filter coefficient for the decoded signal of a plurality of the channels. The filter <b>1203</b> outputs the signal in which the signal of the component element corresponding to each sound source has been separated.

0364As explained above, in the signal analysis control system of the present invention, the transmission unit analyzes the input signal when the number of the channels of the input signal is plural. This configuration enables the receiving unit to control the input signal, which is configured of a plurality of the sound sources, for each component element corresponding to each sound source based upon the information of the signal analysis made by the transmission unit also when the number of the channels of the input signal is plural. In addition, the receiving unit can curtail the arithmetic quantity relating to the signal analysis because the transmission unit analyzes the signal.

0365Further, while the filter coefficient of the separation filter was employed as analysis information of the input signal in the configuration examples shown in <figref idref="DRAWINGS">FIG. 54</figref> and <figref idref="DRAWINGS">FIG. 55</figref>, the analysis information employed in the first embodiment to the eleventh embodiment may be employed. For this, it is enough for the signal separation analysis unit <b>1200</b> shown in <figref idref="DRAWINGS">FIG. 54</figref> to be configured so as to calculate the separation filter, and to perform the signal separation employing the separation filter. With this, the separation filter encoding unit <b>1201</b> is configured of the sound environment information encoding unit <b>1211</b> shown in <figref idref="DRAWINGS">FIG. 52</figref>.

0366In addition, not only of the method of the independent component analysis but also the methods disclosed in the Non-patent documents 12 to 15 may be employed as a method of analyzing the input signal in the signal analysis unit <b>101</b>. Further, these methods of the analysis may be combined with the methods of the analysis in the first embodiment to the eleventh embodiment of the present invention, and employed. In addition, the analysis result that should be outputted, or the signal that can be easily converted into the analysis result that should be outputted can be obtained in a way to the analysis, depending upon the method of the analysis. In that case, the process of the analysis may be changed so that the analysis result is outputted without the analysis performed to the end.

0367The twelfth embodiment of the present invention will be explained by making a reference to <figref idref="DRAWINGS">FIG. 56</figref>. Only One-way communication was taken into consideration in the embodiments ranging from the first embodiment up to the eleventh embodiment. That is, the communication between the transmission unit integrally built in a terminal and the receiving unit integrally built in another terminal was explained. In the twelfth embodiment, which takes bilateral communication into consideration, both of the transmission unit and the receiving unit for which the present invention has been applied are integrally built in one transmission/reception terminal. As a terminal having both of the transmission unit and the receiving unit integrally built therein, for which the present invention has been applied, a combination of any of the transmission units of the first embodiment to the eleventh embodiment, and any of the receiving units of the first embodiment to the eleventh embodiment may employed. In the twelfth embodiment of the present invention, incorporating both of the transmission unit and the receiving unit into the terminal yields an effect of the present invention at the moment of utilizing it for the bilateral communication devices such as a television conference terminal and a mobile telephone.

0368The signal analysis control system of the present invention is applicable in the case that the one-way sound communication is made, for example, in the case of a broadcast. It is enough for the transmission terminal of a broadcast station to have, for example, at least the transmission unit <b>10</b> shown in <figref idref="DRAWINGS">FIG. 1</figref>. The so-called broadcast station includes not only a licensed broadcast station but also a point in which sound is transmitted and no reception is almost performed, for example, a main site of a multi-point television conference. Any of the transmission units of the second embodiment to the eleventh embodiment of the present invention may be employed for this transmission terminal.

0369Further, the signal analysis control system of the present invention is applicable to a point as well in which only the reception is performed. It is enough for the reception terminal in a point in which only the reception is performed to have, for example, at least the receiving unit <b>15</b> shown in <figref idref="DRAWINGS">FIG. 1</figref>. Any of the receiving units of the second embodiment to the eleventh embodiment of the present invention may be employed for this reception terminal.

0370In addition, the signal process device based upon the thirteenth embodiment of the present invention will be explained in details by making a reference to <figref idref="DRAWINGS">FIG. 57</figref>. The thirteenth embodiment of the present invention is configured of computers <b>1300</b> and <b>1301</b> each of which operates under a program control. The computer could be any of a central processing device, a processor, and a data processing device.

0371The computer <b>1300</b>, which performs a process relating to any of the first embodiment to the twelfth embodiment, operates based upon a program for receiving the input signal and outputting the transmission signal. On the other hand, the computer <b>1301</b>, which performs a process relating to any of the first embodiment to the twelfth embodiment, operates based upon a program for receiving the transmission signal and outputting the output signal. Additionally, in the case of having both of the transmission unit and receiving unit explained in the twelfth embodiment, the transmission process and the reception process may be executed by employing the identical computer.

0372While in the first embodiment to the thirteenth embodiment explained above, the operations of the transmission unit, the transmission path, and the receiving unit were exemplified, they may be replaced with the recoding unit, the storage medium, and the reproduction unit, respectively. For example, the transmission unit <b>10</b> shown in <figref idref="DRAWINGS">FIG. 1</figref> may output the transmission signal as a bit stream to the storage medium, and record the bit stream into the storage medium. Further, the receiving unit <b>15</b> may take out the bit stream recorded into the storage medium, and generate the output signal by decoding the bit stream and performing a process therefor.

0373Above, while the present invention has been described with respect to the preferred embodiments and examples, the present invention is not always limited to the above-mentioned embodiment and examples, and alterations to, variations of, and equivalent to these embodiments and the examples can be implemented without departing from the spirit and scope of the present invention.

0374The 1st invention inventions is characterized in that a signal analysis device, comprising: a signal receiving unit for receiving an input signal including a plurality of component elements; and a signal analysis unit for generating analysis information indicative of a relation between said plurality of component elements from said input signal.

0375In addition, the 2nd invention in the above-mentioned 1st invention is characterized in that said component element includes objective sound and background sound.

0376In addition, the 3rd invention in the above-mentioned 1st invention is characterized in that said signal analysis unit comprises: a conversion unit for generating a converted signal in which said input signal has been decomposed into frequency components; and an analysis information generation unit for decomposing said converted signal into said plurality of component elements and generating said analysis information.

0377In addition, the 4th invention in the above-mentioned 3rd invention is characterized in that said component element includes objective sound and background sound.

0378In addition, the 5th invention in the above-mentioned 4th invention is characterized in that said analysis information generation unit comprises: a background sound estimation unit for estimating the background sound from said converted signal; and a background sound information generation unit for generating a suppression coefficient for suppressing the background sound from said converted signal and said estimated background sound.

0379In addition, the 6th invention in the above-mentioned 4th invention is characterized in that said analysis information generation unit comprises: a background sound estimation unit for estimating the background sound from said converted signal; and a background sound information generation unit for generating a ratio of the objective sound and the background sound from said converted signal and said estimated background sound.

0380In addition, the 7th invention in the above-mentioned 4th invention is characterized in that said analysis information generation unit comprises a background sound estimation unit for estimating the background sound from said converted signal.

0381In addition, the 8th invention inventions is characterized in that a signal control device, comprising: a signal receiving unit for receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements; and a signal control unit for controlling a relation between said plurality of component elements based upon said analysis information.

0382In addition, the 9th invention in the above-mentioned 8th invention is characterized in that said component element includes objective sound and background sound.

0383In addition, the 10th invention in the above-mentioned 8th invention is characterized in that said signal control unit comprises: a conversion unit for generating a converted signal in which said signal has been decomposed into frequency components; and a signal processing unit for controlling a relation between said plurality of component elements being included in said converted signal based upon said analysis information.

0384In addition, the 11th invention in the above-mentioned 10th invention is characterized in that said component element includes objective sound and background sound.

0385In addition, the 12th invention in the above-mentioned 11th invention is characterized in that said analysis information includes a suppression coefficient for suppressing said background sound; and said signal processing unit comprises a multiplication unit for multiplying said converted signal by said suppression coefficient.

0386In addition, the 13th invention in the above-mentioned 11th invention is characterized in that said analysis information includes objective sound versus background sound ratio information indicative of a ratio of said objective sound and said background sound; and said signal processing unit comprises: a suppression coefficient generation unit for generating a suppression coefficient for suppressing said background sound from said objective sound versus background sound ratio information; and a multiplication unit for multiplying said converted signal by said suppression coefficient.

0387In addition, the 14th invention in the above-mentioned 11th invention is characterized in that said analysis information includes background sound information indicative of said background sound; and said signal processing unit comprises: a suppression coefficient generation unit for generating a suppression coefficient for suppressing said background sound from said background sound information; and a multiplication unit for multiplying said converted signal by said suppression coefficient.

0388In addition, the 15th invention in the above-mentioned 11th invention is characterized in that said analysis information includes background sound information indicative of said background sound; and said signal processing unit comprises a subtraction unit for subtracting said background sound from said converted signal based upon said background sound information.

0389In addition, the 16th invention inventions is characterized in that a signal control device, comprising: a signal receiving unit for receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements; and a signal control unit for receiving signal control information for controlling a specific component element, and controlling said plurality of component elements based upon said analysis information and said signal control information.

0390In addition, the 17th invention in the above-mentioned 16th invention is characterized in that said component element includes objective sound and background sound.

0391In addition, the 18th invention in the above-mentioned 16th invention is characterized in that said signal control unit comprises: a conversion unit for generating a converted signal in which said signal has been decomposed into frequency components; and a signal processing unit for controlling said plurality of component elements being included in said converted signal based upon said analysis information and said signal control information.

0392In addition, the 19th invention in the above-mentioned 18th invention is characterized in that said component element includes objective sound and background sound.

0393In addition, the 20th invention in the above-mentioned 19th invention is characterized in that said analysis information includes a suppression coefficient for suppressing said background sound; and said signal processing unit comprises: a suppression coefficient modification unit for modifying said suppression coefficient based upon said signal control information; and a multiplication unit for multiplying said converted signal by said modified suppression coefficient.

0394In addition, the 21th invention in the above-mentioned 20th invention is characterized in that said suppression coefficient modification unit comprises a multiplication unit for multiplying said suppression coefficient by said signal control information.

0395In addition, the 22th invention in the above-mentioned 20th invention is characterized in that said suppression coefficient modification unit comprises a comparison unit for comparing said suppression coefficient with said signal control information.

0396In addition, the 23th invention in the above-mentioned 20th invention is characterized in that said suppression coefficient modification unit comprises: a multiplication unit for multiplying said suppression coefficient by said signal control information; a comparison unit for comparing said suppression coefficient with said signal control information; and a selection unit for selecting a result by said multiplication unit and a result by said comparison unit based upon said signal control information.

0397In addition, the 24th invention in the above-mentioned 23th invention is characterized in that said signal control information includes at least one of a maximum value and a minimum value of the suppression coefficient.

0398In addition, the 25th invention in the above-mentioned 19th invention is characterized in that said analysis information includes objective sound versus background sound ratio information indicative of a ratio of said objective sound and said background sound; and wherein said signal processing unit comprises: an objective sound versus background sound ratio information modification unit for modifying said objective sound versus background sound ratio information based upon said signal control information; a suppression coefficient conversion unit for converting said modified objective sound versus background sound ratio into a suppression coefficient; and a multiplication unit for multiplying said converted signal by said suppression coefficient.

0399In addition, the 26th invention in the above-mentioned 19th invention is characterized in that said analysis information includes objective sound versus background sound ratio information indicative of a ratio of said objective sound and said background sound; and said signal processing unit comprises: a suppression coefficient conversion unit for converting said objective sound versus background sound ratio into a suppression coefficient; a suppression coefficient modification unit for modifying said suppression coefficient based upon said signal control information; and a multiplication unit for multiplying said converted signal by said modified suppression coefficient.

0400In addition, the 27th invention in the above-mentioned 19th invention is characterized in that said analysis information includes background sound information indicative of said background sound; and said signal processing unit comprises: a background sound information modification unit for modifying said background sound information based upon said signal control information; a suppression coefficient conversion unit for converting said modified background sound information into a suppression coefficient; and a multiplication unit for multiplying said converted signal by said suppression coefficient.

0401In addition, the 28th invention in the above-mentioned 19th invention is characterized in that said analysis information includes background sound information indicative of said background sound; and said signal processing unit comprises: a suppression coefficient conversion unit for converting said background sound information into a suppression coefficient; a suppression coefficient modification unit for modifying said suppression coefficient based upon said signal control information; and a multiplication unit for multiplying said converted signal by said modified suppression coefficient.

0402In addition, the 29th invention in the above-mentioned 19th invention is characterized in that said analysis information includes background sound information indicative of said background sound; and said signal processing unit comprises: a background sound information modification unit for modifying said background sound information based upon said signal control information; and a subtraction unit for subtracting said modified background sound information from said converted signal.

0403In addition, the 30th invention is characterized in that a signal control device, comprising: a signal receiving unit for receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements; and an output signal generation unit for receiving component element rendering information for controlling an output of said component element, controlling said component element based upon said analysis information and said component element rendering information, and generating an output signal.

0404In addition, the 31st invention in the above-mentioned 30th invention is characterized in that said output signal generation unit comprises a component element information conversion unit for converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said analysis information.

0405In addition, the 32nd invention in the above-mentioned 30th invention is characterized in that said output signal generation unit receives signal control information for controlling a specific component element, controls said component element based upon said signal control information, said analysis information, and said component element rendering information, and generates the output signal.

0406In addition, the 33rd invention in the above-mentioned 32nd invention is characterized in that said output signal generation unit comprises: a signal control unit for generating a parameter indicative of a relation between said signal and said component element based upon said signal and said analysis information, and modifying said parameter based upon said signal control information; and a component element information conversion unit for converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said modified parameter.

0407In addition, the 34th invention in the above-mentioned 32nd invention is characterized in that said output signal generation unit comprises: a signal control unit for generating a parameter indicative of a relation between said signal and said component element based upon said analysis information and said signal control information, and modifying said parameter based upon said signal control information; and a component element information conversion unit for converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said modified parameter.

0408In addition, the 35th invention in the above-mentioned 33rd or 34th inventions is characterized in that said signal control device comprising a rendering unit for converting said signal based upon said rendering information, and generating said output signal.

0409In addition, the 36th invention in the above-mentioned 30th invention is characterized in that said component element includes objective sound and background sound.

0410In addition, the 37th invention in the above-mentioned 35th invention is characterized in that said output signal generation unit comprises a component element information conversion unit for converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said analysis information.

0411In addition, the 38th invention in the above-mentioned 36th invention is characterized in that said analysis information includes a suppression coefficient for suppressing said background sound; and said output signal generation unit comprises: a signal control unit for generating a component element parameter for controlling said component element based upon said suppression coefficient; and a component element information conversion unit for converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said component element parameter.

0412In addition, the 39th invention in the above-mentioned 36th invention is characterized in that said analysis information includes objective sound versus background sound ratio information indicative of a ratio of said objective sound and said background sound; and said output signal generation unit comprises: a signal control unit for generating a component element parameter for controlling said component element based upon said objective sound versus background sound ratio information; and a component element information conversion unit for converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said component element parameter.

0413In addition, the 40th invention in the above-mentioned 36th invention is characterized in that said analysis information includes background sound information indicative of said background sound; and said output signal generation unit comprises: a signal control unit for generating a component element parameter for controlling said component element based upon said signal and said background sound information; and a component element information conversion unit for converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said component element parameter.

0414In addition, the 41st invention in the above-mentioned any one of 38th to 40th inventions is characterized in that said signal control device comprising a rendering unit for converting said signal and generating said output signal based upon said rendering information.

0415In addition, the 42nd invention is characterized in that a signal analysis method, comprising generating analysis information from an input signal including a plurality of component elements, said analysis information indicating a relation between said plurality of component elements.

0416In addition, the 43rd invention in the above-mentioned 42nd invention is characterized in that said component element includes objective sound and background sound.

0417In addition, the 44th invention in the above-mentioned 42nd invention is characterized in that said signal analysis method comprising: generating a converted signal in which said input signal has been decomposed into frequency components; and decomposing said converted signal into said plurality of component elements, and generating said analysis information.

0418In addition, the 45th invention in the above-mentioned 42nd invention is characterized in that said component element includes objective sound and background sound.

0419In addition, the 46th invention in the above-mentioned 45th invention is characterized in that said signal analysis method comprising: estimating the background sound from said converted signal; and generating a suppression coefficient for suppressing the background sound from said converted signal and said estimated background sound as said analysis information.

0420In addition, the 47th invention in the above-mentioned 44th invention is characterized in that a signal analysis method comprising: estimating background sound from said converted signal; and generating a ratio of objective sound and the background sound from said converted signal and said estimated background sound as said analysis information.

0421In addition, the 48th invention in the above-mentioned 44th invention is characterized in that said signal analysis method comprising estimating the background sound from said converted signal.

0422In addition, the 49th invention is characterized in that a signal control method, comprising: receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements; and controlling a relation between said plurality of component elements based upon said analysis information.

0423In addition, the 50th invention in the above-mentioned 49th invention is characterized in that said component element includes objective sound and background sound.

0424In addition, the 51st invention in the above-mentioned 49th invention is characterized in that said signal control method comprising: generating a converted signal in which said signal has been decomposed into frequency components; and controlling a relation between said plurality of component elements being included in said converted signal based upon said analysis information.

0425In addition, the 52nd invention in the above-mentioned 51st invention is characterized in that said component element includes objective sound and background sound.

0426In addition, the 53rd invention in the above-mentioned 52nd invention is characterized in that said analysis information includes a suppression coefficient for suppressing said background sound; and said signal control method comprises multiplying said converted signal by said suppression coefficient, and taking a control based upon this multiplication result.

0427In addition, the 54th invention in the above-mentioned 52nd invention is characterized in that said analysis information includes objective sound versus background sound ratio information indicative of a ratio of said objective sound and said background sound; and said signal control method comprises: generating a suppression coefficient for suppressing said background sound from said objective sound versus background sound ratio information; and multiplying said converted signal by said suppression coefficient, and taking a control based upon this multiplication result.

0428In addition, the 55th invention in the above-mentioned 52nd invention is characterized in that said analysis information includes background sound information indicative of said background sound; and said signal control method comprises: generating a suppression coefficient for suppressing said background sound from said background sound information; and multiplying said converted signal by said suppression coefficient, and taking a control based upon this multiplication result.

0429In addition, the 56th invention in the above-mentioned 52nd invention is characterized in that said analysis information includes background sound information indicative of said background sound; and said signal control method comprises subtracting said background sound from said converted signal based upon said background sound information, and taking a control based upon this subtraction result.

0430In addition, the 57th invention is characterized in that a signal control method, comprising receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements, and signal control information for controlling a specific component element, and controlling said plurality of component elements based upon said analysis information and said signal control information.

0431In addition, the 58th invention in the above-mentioned 57th invention is characterized in that said component element includes objective sound and background sound.

0432In addition, the 59th invention in the above-mentioned 57th invention is characterized in that said signal control method comprising: generating a converted signal in which said signal has been decomposed into frequency components; and controlling said plurality of component elements being included in said converted signal based upon said analysis information and said signal control information.

0433In addition, the 60th invention in the above-mentioned 59th invention is characterized in that said component element includes objective sound and background sound.

0434In addition, the 61th invention in the above-mentioned 60th invention is characterized in that said analysis information includes a suppression coefficient for suppressing said background sound; and said signal control method comprises: modifying said suppression coefficient based upon said signal control information; and multiplying said converted signal by said modified suppression coefficient, and taking a control based upon this multiplication result.

0435In addition, the 62th invention in the above-mentioned 61st invention is characterized in that said signal control method comprising multiplying said suppression coefficient by said signal control information, and modifying the suppression coefficient.

0436In addition, the 63rd invention in the above-mentioned 61st invention is characterized in that said signal control method comprising comparing said suppression coefficient with said signal control information, and modifying the suppression coefficient.

0437In addition, the 64th invention in the above-mentioned 61st invention is characterized in that said a signal control method comprising: multiplying said suppression coefficient by said signal control information; comparing said suppression coefficient with said signal control information; and modifying the suppression coefficient by employing one of said result by a multiplication unit and said result by a comparison unit based upon said signal control information.

0438In addition, the 65th invention in the above-mentioned 64th invention is characterized in that said signal control information includes at least one of a maximum value and a minimum value of the suppression coefficient.

0439In addition, the 66th invention in the above-mentioned 60th invention is characterized in that said analysis information includes objective sound versus background sound ratio information indicative of a ratio of said objective sound and said background sound; and wherein said signal control method comprises: modifying said objective sound versus background sound ratio information based upon said signal control information; converting said modified objective sound versus background sound ratio into a suppression coefficient; and multiplying said converted signal by said suppression coefficient, and taking a control based upon this multiplication result.

0440In addition, the 67th invention in the above-mentioned 60th invention is characterized in that said analysis information includes objective sound versus background sound ratio information indicative of a ratio of said objective sound and said background sound; and wherein said signal control method comprises: converting said objective sound versus background sound ratio into a suppression coefficient; modifying said suppression coefficient based upon said signal control information; and multiplying said converted signal by said modified suppression coefficient, and taking a control based upon this multiplication result.

0441In addition, the 68th invention in the above-mentioned 60th invention is characterized in that said analysis information includes background sound information indicative of said background sound; and said signal control method comprises: modifying said background sound information based upon said signal control information; converting said modified background sound information into a suppression coefficient; and multiplying said converted signal by said suppression coefficient, and taking a control based upon this multiplication result.

0442In addition, the 69th invention in the above-mentioned 60th invention is characterized in that said analysis information includes background sound information indicative of said background sound; and said signal control method comprises: converting said background sound information into a suppression coefficient; modifying said suppression coefficient based upon said signal control information; and multiplying said converted signal by said modified suppression coefficient, and taking a control based upon this multiplication result.

0443In addition, the 70th invention in the above-mentioned 60th invention is characterized in that said analysis information includes background sound information indicative of said background sound; and said signal control method comprises: modifying said background sound information based upon said signal control information; and subtracting said modified background sound information from said converted signal, and taking a control based upon this subtraction result.

0444In addition, the 71st invention is characterized in that a signal control method, comprising: receiving a signal including a plurality of component elements, analysis information indicative of a relation between said plurality of component elements, and component element rendering information for controlling an output of said component element; and controlling said component element based upon said analysis information and said component element rendering information, and generating an output signal.

0445In addition, the 72th invention in the above-mentioned 71th invention is characterized in that said signal control method comprising converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said analysis information.

0446In addition, the 73th invention in the above-mentioned 71th invention is characterized in that said signal control method comprising receiving signal control information for controlling a specific component element, controlling said component element based upon said signal control information, said analysis information, and said component element rendering information, and generating the output signal.

0447In addition, the 74th invention in the above-mentioned 73rd invention is characterized in that said signal control method comprising: generating a parameter indicative of a relation between said signal and said component element based upon said signal and said analysis information, and modifying said parameter based upon said signal control information; and converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said modified parameter.

0448In addition, the 75th invention in the above-mentioned 73rd invention is characterized in that said signal control method comprising: generating a parameter indicative of a relation between said signal and said component element based upon said analysis information and said signal control information, and modifying said parameter based upon said signal control information; and converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said modified parameter.

0449In addition, the 76th invention in the above-mentioned 74th or 75th inventions is characterized in that said signal control method comprising converting said signal based upon said rendering information, and generating said output signal.

0450In addition, the 77th invention in the above-mentioned 71th invention is characterized in that said component element includes objective sound and background sound.

0451In addition, the 78th invention in the above-mentioned 76th invention is characterized in that said signal control method comprising converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said analysis information.

0452In addition, the 79th invention in the above-mentioned 77th invention is characterized in that said analysis information includes a suppression coefficient for suppressing said background sound; and said signal control method comprises: generating a component element parameter for controlling said component element based upon said suppression coefficient; and converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said component element parameter.

0453In addition, the 80th invention in the above-mentioned 77th invention is characterized in that said analysis information includes objective sound versus background sound ratio information indicative of a ratio of said objective sound and said background sound; and said signal control method comprises: generating a component element parameter for controlling said component element based upon said objective sound versus background sound ratio information; and converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said component element parameter.

0454In addition, the 81st invention in the above-mentioned 77th invention is characterized in that said analysis information includes background sound information indicative of said background sound; and said signal control method comprises: generating a component element parameter for controlling said component element based upon said signal and said background sound information; and converting said component element rendering information into rendering information indicative of a relation between said signal and said output signal based upon said component element parameter.

0455In addition, the 82nd invention in the above-mentioned any one of 79th to 81st inventions is characterized in that said signal control method comprising converting said signal and generating said output signal based upon said rendering information.

0456In addition, the 83rd invention is characterized in that a system comprising: a signal receiving unit for receiving a signal including a plurality of component elements; a signal analysis unit for generating analysis information indicative of a relation between said plurality of component elements from said signal; a signal receiving unit for receiving said signal including said plurality of component elements, and said analysis information; and a signal control unit for controlling a relation between said plurality of component elements based upon said analysis information.

0457In addition, the 84th invention is characterized in that a system comprising: a signal receiving unit for receiving a signal including a plurality of component elements; a signal analysis unit for generating analysis information indicative of a relation between said plurality of component elements from said signal; a signal receiving unit for receiving said signal including said plurality of component elements, and said analysis information; and a signal control unit for receiving signal control information for controlling a specific component element, and controlling said plurality of component elements based upon said analysis information and said signal control information.

0458In addition, the 85th invention is characterized in that a system comprising: a signal receiving unit for receiving a signal including a plurality of component elements; a signal analysis unit for generating analysis information indicative of a relation between said plurality of component elements from said signal; a signal receiving unit for receiving said signal including said plurality of component elements, and said analysis information; and an output signal generation unit for receiving component element rendering information for controlling an output of said component element, controlling said component element based upon said analysis information and said component element rendering information, and generating an output signal.

0459In addition, the 86th invention is characterized in that a signal analysis program, said program causing an information processing device to execute: a signal receiving process of receiving an input signal including a plurality of component elements; and a signal analysis process of generating analysis information indicative of a relation between said plurality of component elements from said input signal.

0460In addition, the 87th invention is characterized in that a signal control program, comprising: a signal receiving process of receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements; and a signal control process of controlling a relation between said plurality of component elements based upon said analysis information.

0461In addition, the 85th invention is characterized in that a signal control program, said program causing an information processing device to execute: a signal receiving process of receiving a signal including a plurality of component elements and analysis information indicative of a relation between said plurality of component elements; and a signal control process of receiving signal control information for controlling a specific component element, and controlling said plurality of component elements based upon said analysis information and said signal control information.

0462In addition, the 89th invention is characterized in that a signal control program, comprising: a signal receiving process of receiving a signal including a plurality of component elements, and analysis information indicative of a relation between said plurality of component elements; and an output signal generation process of receiving component element rendering information for controlling an output of said component element, controlling said component element based upon said analysis information and said component element rendering information, and generating an output signal.

0463This application is based upon and claims the benefit of priority from Japanese patent application No. 2007-168544, filed on Jun. 27, 2007, the disclosure of which is incorporated herein in its entirety by reference.

APPLICABILITY IN INDUSTRY

0464The present invention may be applied to an apparatus that performs signal analysis or signal control. The present invention may also be applied to a program that causes an information processing device to execute signal analysis or signal control.