Distance based sound source signal filtering method and apparatus
Claim Score by NHIP
Abstract
Provided is a sound source signal filtering method and apparatus. The sound source signal filtering method includes: generating two or more microphone output signals by combining sound source signals input through a plurality of microphones; calculating distances between the microphones and a sound source from which the sound source signals are emitted by using distance relationships according to frequencies of the sound source signals extracted from the generated microphone output signals; and filtering the sound source signals to obtain one or more sound source signals corresponding to a predetermined distance by using the calculated distances. Accordingly, it is possible to obtain only sound source signals emitted from a sound source at a particular distance from the microphone array among a plurality of sound source signals input through the microphone array.

Term
Projected expiry 20 March 2031.
- Priority
- Filed
- Published
- Today
- Projected expiry
13 claims: 2 independent, 11 dependent
- 1Broadest claimClaim Score 71, broad(NHIP)A sound source signal filtering method comprising:generating two or more microphone output signals by combining sound source signals input through a plurality of microphones;calculating distances between the microphones and a sound source from which the sound source signals are emitted by using distance relationships according to frequencies of the sound source signals extracted from the generated microphone output signals;and filtering the sound source signals to obtain one or more sound source signals corresponding to a predetermined distance by using the calculated distances.
- 8A sound source signal filtering apparatus comprising:a microphone output signal generator to generate two or more microphone output signals by combining sound source signals input through a plurality of microphones;a distance calculator to calculate distances from the microphones to a sound source from which the sound source signals are emitted, by using distance relationships based on frequencies of the sound source signals of the generated microphone output signals;and a signal filter to filter the sound source signals to obtain one or more sound source signals corresponding to a predetermined distance by using the calculated distances.
Independent claims2
93 paragraphs in 5 sections, as filed
CROSS-REFERENCE TO RELATED PATENT APPLICATION
0001This application claims the benefit of Korean Patent Application No. 10-2007-0124385, filed on Dec. 3, 2007, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference.
BACKGROUND
00021. Field
0003One or more embodiments of the present invention relates to a method of and apparatus for filtering sound source signals in a sound acquisition device including a microphone array, and more particularly, to a method of and apparatus for filtering a plurality of sound source signals input through a microphone array to obtain particular sound source signals.
00042. Description of the Related Art
0005Nowadays, recording of an external voice, recording of a video file, or speaking on the phone can be easily performed by using a portable digital device. In order to record sound source signals, microphones are used for various digital devices such as mobile phones and consumer electronics. In addition, a microphone array including a plurality of microphones is generally used to easily process an acquired sound source signal.
0006The microphone array can obtain additional characteristics on directivity such as a direction or a position of a sound source signal to be acquired in addition to the sound source signal itself by combining a plurality of microphones. The directivity represents increases in sensitivity of sound source signals emitted from a sound source in a particular direction by using differences in times the sound source signals arrive at each microphone. Therefore, by acquiring sound source signals through a use of the microphone array, the sound signal input in a particular direction can either be emphasized or suppressed.
0007Unless recording is performed in a soundproof studio, recording a sound source signal or receiving a sound source signal by using a general digital device is more often performed in an environment with a presence of noise and interferences rather than in a quiet environment free from noise. Therefore, in order to extract a particular sound source signal for a user from mixed sound source signals via the division of each sound source signal, or to remove a sound source signal corresponding to unnecessary interference noise, various sound source signal processing technologies have been developed.
SUMMARY OF THE INVENTION
0008One or more embodiments of the present invention provides a sound source signal filtering method and apparatus capable of solving a problem in which acquiring only sound source signals emitted from a sound source at a particular distance away from a microphone array among a plurality of sound source signals input through the microphone array cannot be performed. The present invention also provides a sound source signal filtering method and apparatus capable of overcoming a constraint in which sound source signals emitted from a sound source in the same direction cannot be clearly identified.
0009According to an aspect of the present invention, there is provided a sound source signal filtering method including: generating two or more microphone output signals by combining sound source signals input through a plurality of microphones; calculating distances between the microphones and a sound source from which the sound source signals are emitted by using distance relationships according to frequencies of the sound source signals extracted from the generated microphone output signals; and filtering the sound source signals to obtain one or more sound source signals corresponding to a predetermined distance by using the calculated distances.
0010According to another aspect of the present invention, there is provided a recording medium that can be read by a computer that records the program for executing the sound source signal filtering method on the computer.
0011According to another aspect of the present invention, there is provided a sound source signal filtering apparatus including: a microphone output signal generator generating two or more microphone output signals by combining sound source signals input through a plurality of microphones; a distance calculator calculating distances from the microphones to a sound source from which the sound source signals are emitted by using distance relationships according to frequencies of the sound source signals of the generated microphone output signals; and a signal filter filtering the sound source signals to obtain one or more sound source signals corresponding to a predetermined distance by using the calculated distances.
BRIEF DESCRIPTION OF THE DRAWINGS
0012The above and other features and advantages of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings in which:
0013<figref idrefs="DRAWINGS">FIG. 1</figref> is a block diagram illustrating a sound source signal filtering apparatus based on sound source distances, according to an embodiment of the present invention;
0014<figref idrefs="DRAWINGS">FIG. 2</figref> is a block diagram illustrating a sound source signal filtering apparatus based on sound source distances, according to another embodiment of the present invention;
0015<figref idrefs="DRAWINGS">FIGS. 3A to 3C</figref> are diagrams for explaining a process of calculating a direction of a sound source performed by a sound source signal filtering apparatus, according to an embodiment of the present invention;
0016<figref idrefs="DRAWINGS">FIGS. 4A and 4B</figref> are diagrams for explaining a process of generating microphone output signals performed by a sound source signal filtering apparatus, according to an embodiment of the present invention;
0017<figref idrefs="DRAWINGS">FIGS. 5A and 5B</figref> are diagrams illustrating a process of generating the microphone output signals of <figref idrefs="DRAWINGS">FIGS. 4A and 4B</figref>;
0018<figref idrefs="DRAWINGS">FIGS. 6A and 6B</figref> are diagrams for explaining a process of calculating a distance performed by a sound source signal filtering apparatus, according to embodiments of the present invention;
0019<figref idrefs="DRAWINGS">FIGS. 7A and 7B</figref> are diagrams for explaining a process of filtering sound source signals and an application method thereof performed by the sound source signal filtering apparatus, according to an embodiment of the present invention; and
0020<figref idrefs="DRAWINGS">FIG. 8</figref> is a flowchart of a sound source signal filtering method, according to another embodiment of the present invention.
DETAILED DESCRIPTION OF THE INVENTION
0021Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the attached drawings. In the description, a sound source is used as a term referring to a source from which a sound is emitted, and a sound pressure refers to a force exerted by acoustic energy through a use of a physical quantity. In addition, according to the exemplary embodiments of the present invention, a sound source distance is used to filter sound source signals that are input through a microphone array to obtain a particular sound source signal. Here, the term sound source distance refers to a distance from a sound source acquisition device (a microphone or a device including a microphone) to the sound source.
0022<figref idrefs="DRAWINGS">FIG. 1</figref> is a block diagram illustrating a sound source signal filtering apparatus based on a sound source distance according to an embodiment of the present invention. The sound source signal filtering apparatus includes a plurality of microphones <b>111</b><sub>1 </sub>to <b>111</b><sub>N</sub>, a microphone output signal generator <b>120</b>, a distance calculator <b>130</b>, and a signal filter <b>140</b>.
0023The plurality of microphones <b>111</b><sub>1 </sub>to <b>111</b><sub>N </sub>receives sound source signals from various sound sources near the sound source signal filtering apparatus. The plurality of microphones <b>111</b><sub>1 </sub>to <b>111</b><sub>N </sub>may be implemented as a microphone array, which is a structure for convenient attainment of positional information on sound sources such as their direction or their distance away from the sound source. In <figref idrefs="DRAWINGS">FIG. 1</figref>, N sound source signals e<sub>1 </sub>to e<sub>N </sub>are received through a microphone array including N microphones Mic<sub>1 </sub>to Mic<sub>N</sub>.
0024The microphone output signal generator <b>120</b> generates two or more microphone output signals by combining the sound source signals input through the plurality of the microphones <b>111</b><sub>1 </sub>to <b>111</b><sub>N</sub>. The microphone output signal generator <b>120</b> includes M microphone output signal generators to generate M microphone output signals E<sub>1</sub>, . . . , E<sub>K</sub>, . . . , E<sub>M</sub>. For example, in <figref idrefs="DRAWINGS">FIG. 1</figref>, the first microphone output signal generator <b>121</b> receives N sound source signals e<sub>1 </sub>to e<sub>N </sub>and generates the microphone output signal E<sub>1 </sub>by combining the received N sound source signals e<sub>1 </sub>to e<sub>N</sub>. Similarly, the K-th microphone output signal generator <b>122</b> receives N sound source signals e<sub>1 </sub>to e<sub>N </sub>and generates the microphone output signal E<sub>K </sub>by combining the received N sound source signals e<sub>1 </sub>to e<sub>N</sub>. Now, operations of generating the microphone output signals are described in detail with reference to <figref idrefs="DRAWINGS">FIGS. 4A and 4B</figref>.
0025<figref idrefs="DRAWINGS">FIGS. 4A and 4B</figref> are diagrams for explaining a process of generating a microphone output signal performed by the sound source signal filtering apparatus, according to an embodiment of the present invention. <figref idrefs="DRAWINGS">FIGS. 4A and 4B</figref> show the first microphone output signal generator <b>410</b> and the K-th microphone output signal generator <b>420</b>. According to exemplary embodiments of the present invention, operations of generating a plurality of (for example, N that is equal to the number of microphone output signal generators) microphone output signals using a plurality of (for example, N) microphone output signal generators are described. However, in <figref idrefs="DRAWINGS">FIGS. 4A and 4B</figref>, the two microphone output signal generators are illustrated for the convenience of description.
0026The two microphone output signal generators <b>410</b> and <b>420</b> generate the microphone output signals E<sub>1 </sub>and E<sub>K </sub>by combining the N sound source signals e<sub>1 </sub>to e<sub>N </sub>using predetermined transformation functions. The transformation functions illustrated in <figref idrefs="DRAWINGS">FIGS. 4A and 4B</figref> are F<sub>1</sub>(•) and F<sub>K</sub>(•), respectively. Here, the predetermined transformation function receives a plurality of sound source signals and outputs the microphone output signal through various combination methods such as adding the sound source signals or subtracting some sound source signals from the sound source signals. The combination methods can be applied to any transformation function such as linear and non-linear transformation functions, and this can be easily construed by those skilled in the art.
0027The M microphone output signals E<sub>1</sub>, . . . , E<sub>K</sub>, . . . , E<sub>M </sub>generated by the microphone output signal generators <b>410</b> and <b>420</b> must have different sound attenuation rates according to their distance. The sound attenuation rate of a signal according to its distance represents a rate of decrease in amplitude or acoustic energy as a sound (referred to as a sound wave) is transmitted from a sound source. The sound attenuation rate is derived from a wave equation. In general, the amplitude decreases according to a distance of a sound from a sound source, so that the sound attenuation ratio is inversely proportional to a distance from a sound source.
0028The fact that the M generated microphone output signals have different sound attenuation rates according to their distances from each other means that the M transformation functions are different from each other. Specifically, methods of combining the N sound source signals e<sub>1 </sub>to e<sub>N </sub>of the transformation functions such as the F<sub>1</sub>(•) and F<sub>K</sub>(•) are different from each other. Therefore, as long as the aforementioned condition in which the sound attenuation rates through the transformation functions being different from each other is satisfied, the methods of combining the input sound source signals of the M transformation functions can be designed freely. An example of designing the transformation functions is described with reference to <figref idrefs="DRAWINGS">FIGS. 5A and 5B</figref>.
0029<figref idrefs="DRAWINGS">FIGS. 5A and 5B</figref> are diagrams illustrating a process of generating the microphone output signals of <figref idrefs="DRAWINGS">FIGS. 4A and 4B</figref>. <figref idrefs="DRAWINGS">FIGS. 5A and 5B</figref> further illustrate two microphone output signal generators corresponding to the first microphone output signal generator <b>410</b> of <figref idrefs="DRAWINGS">FIG. 4A</figref> and the K-th microphone output signal generator <b>420</b> of <figref idrefs="DRAWINGS">FIG. 4B</figref>, respectively. According to the current embodiment of the present invention, it is assumed that the two microphone output signal generators and a microphone array including four microphones are used.
0030In <figref idrefs="DRAWINGS">FIG. 5A</figref>, the microphone output signal generator combines four sound source signals e(<b>1</b>), e(<b>2</b>), e(<b>3</b>), and e(<b>4</b>) emitted from a sound source <b>510</b> by using a second-order gradient microphone structure. The second-order gradient microphone (referred to as a differential microphone) structure is a microphone structure that combines sound source signals by grouping the four microphones into pairs. Here, it will be understood that a first-order or higher-order gradient microphone may be used instead of the second-order gradient microphone according to the number of microphones receiving sound source signals.
0031Transforming the four sound source signals using the second-order gradient microphone is performed by a linear transformation matrix as represented in Equation 1.
0000<maths id="MATH-US-00001" num="00001"><math overflow="scroll"><mtable><mtr><mtd><mrow><msub><mi>F</mi><mn>1</mn></msub><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mn>1</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mrow><mo>-</mo><mn>1</mn></mrow></mtd><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mrow><mo>-</mo><mn>1</mn></mrow></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>1</mn></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths>
0032Here, when each element in Equation 1 is represented as g<sub>ij </sub>(i denotes a row and j denotes a column), the transformation function of the second-order gradient microphone is represented as a linear transformation matrix having the diagonal elements [g<sub>11</sub>, g<sub>22</sub>, g<sub>33</sub>, g<sub>44</sub>] equal to [1, −1, −1, 1] with the remaining elements equal to 0. Specifically, multiplications of the sound source signals e(<b>1</b>), e(<b>2</b>), e(<b>3</b>), and e(<b>4</b>) illustrated in <figref idrefs="DRAWINGS">FIG. 5A</figref> and g(<b>1</b>), g(<b>2</b>), g(<b>3</b>), and g(<b>4</b>), respectively, are performed, and the multiplied values are added through an adder <b>520</b> to be output as a single microphone output signal E<sub>1</sub>.
0033When it is assumed that the microphone array exists on the x-axis of coordinates illustrated in <figref idrefs="DRAWINGS">FIG. 5A</figref>, an angle between the x-axis and the sound source <b>510</b> is θ, and a distance from the origin to the sound source <b>510</b> is R, the microphone output signal is calculated by using Equation 2.
0000<maths id="MATH-US-00002" num="00002"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>e</mi><mo>=</mo><mrow><mi>A</mi><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo></mo><mrow><mo>(</mo><mrow><mrow><mi>c</mi><mo>·</mo><mi>t</mi></mrow><mo>-</mo><mi>r</mi></mrow><mo>)</mo></mrow></mrow><mi>r</mi></mfrac></mrow></mrow><mo></mo><mstyle><mtext /></mstyle><mo></mo><mrow><mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo>=</mo><msqrt><mrow><msup><mrow><mo>(</mo><mrow><mrow><mi>x</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo>-</mo><mrow><mrow><mi>R</mi><mo>·</mo><mi>cos</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>θ</mi></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup><mo>+</mo><msup><mrow><mo>(</mo><mrow><mrow><mi>y</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo>-</mo><mrow><mrow><mi>R</mi><mo>·</mo><mi>sin</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>θ</mi></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup></mrow></msqrt></mrow><mo>,</mo><mstyle><mtext /></mstyle><mo></mo><mi>where</mi><mo>,</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mo>,</mo><mn>2</mn><mo>,</mo><mn>3</mn><mo>,</mo><mn>4.</mn></mrow><mo></mo><mstyle><mtext /></mstyle><mo></mo><mrow><mrow><mrow><mi>e</mi><mo></mo><mrow><mo>(</mo><mrow><mi>t</mi><mo>,</mo><mi>λ</mi><mo>,</mo><mi>j</mi></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mi>A</mi><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mrow><mo>[</mo><mrow><mrow><mi>ω</mi><mo>·</mo><mi>t</mi></mrow><mo>-</mo><mrow><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo>·</mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mrow></mrow><mo>]</mo></mrow></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow></mrow><mo>,</mo><mstyle><mtext /></mstyle><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>where</mi><mo>,</mo><mrow><mi>ω</mi><mo>=</mo><mrow><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo>·</mo><mi>c</mi></mrow></mrow></mrow><mo></mo><mstyle><mtext /></mstyle><mo></mo><mtable><mtr><mtd><mrow><mrow><msub><mi>E</mi><mi>g</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mi>t</mi><mo>,</mo><mi>λ</mi></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mi /><mo></mo><mrow><mi>A</mi><mo>·</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo>[</mo><mfrac><mrow><mi>sin</mi><mo></mo><mrow><mo>[</mo><mrow><mrow><mi>ω</mi><mo>·</mo><mi>t</mi></mrow><mo>-</mo><mrow><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo>·</mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mrow></mrow><mo>]</mo></mrow></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac><mo>]</mo></mrow></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mi /><mo></mo><mrow><mi>A</mi><mo>·</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo></mo><mfrac><mrow><mi>cos</mi><mo></mo><mrow><mo>[</mo><mrow><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo>·</mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mrow><mo>]</mo></mrow></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mi /><mo></mo><mrow><mrow><mi>sin</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>ω</mi><mo>·</mo><mi>t</mi></mrow></mrow><mo>-</mo><mrow><mi>A</mi><mo>·</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mrow><mo>[</mo><mrow><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo>·</mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mrow><mo>]</mo></mrow></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac><mo></mo><mi>cos</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>ω</mi><mo>·</mo><mi>t</mi></mrow></mrow></mrow></mrow></mrow></mrow></mtd></mtr></mtable><mo></mo><mstyle><mtext /></mstyle><mo></mo><mrow><mrow><mrow><mo></mo><mrow><msub><mi>E</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mrow><mi>t</mi><mo>,</mo><mi>λ</mi></mrow><mo>)</mo></mrow></mrow><mo></mo></mrow><mo>=</mo><mrow><mi>A</mi><mo>·</mo><msqrt><mtable><mtr><mtd><mrow><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo></mo><mfrac><mrow><mi>cos</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup><mo>+</mo></mrow></mtd></mtr><mtr><mtd><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup></mtd></mtr></mtable></msqrt></mrow></mrow><mo>,</mo><mstyle><mtext /></mstyle><mo></mo><mi>where</mi><mo>,</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>ψ</mi><mo>=</mo><mrow><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo>·</mo><mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo>.</mo></mrow></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>2</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths>
0034Here, e denotes an input signal, A denotes an amplitude, λ denotes a wavelength, c denotes a speed of a sound wave in air having a value of 340 m/sec, and E<sub>1 </sub>denotes the microphone output signal.
0035Next, the second microphone output signal generator illustrated in <figref idrefs="DRAWINGS">FIG. 5B</figref> is described. The microphone output signal generator illustrated in <figref idrefs="DRAWINGS">FIG. 5B</figref> combines the four sound source signals e(<b>1</b>), e(<b>2</b>), e(<b>3</b>), and e(<b>4</b>) emitted from the sound source <b>510</b> by using a sum of omni microphone structure. The sum of omni microphone structure is a microphone structure for simply combining the sound source signals acquired through four omni microphones. Here, the omni microphone refers to a non-directional microphone having a uniform sensitivity to all directions around the microphone. Similarly, the microphone output signal generator illustrated in <figref idrefs="DRAWINGS">FIG. 5B</figref> may use any type of microphone combination in addition to the sum of omni microphone structure.
0036Transforming the four sound signals using the sum of omni microphone structure is performed by a linear transformation matrix as represented in Equation 3.
0000<maths id="MATH-US-00003" num="00003"><math overflow="scroll"><mtable><mtr><mtd><mrow><msub><mi>F</mi><mn>2</mn></msub><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mn>1</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mn>1</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>1</mn></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>1</mn></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>3</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths>
0037Similarly to Equation 1, each element of Equation 3 is represented as g<sub>ij </sub>(i denotes a row and j denotes a column), the transformation function of the omni microphone is represented as a linear transformation matrix having diagonal elements [g<sub>11</sub>, g<sub>22</sub>, g<sub>33</sub>, g<sub>44</sub>] equal to [1, 1, 1, 1] with the remaining elements of 0. Specifically, without a particular transformation, the sound source signals e(<b>1</b>), e(<b>2</b>), e(<b>3</b>), and e(<b>4</b>) illustrated in <figref idrefs="DRAWINGS">FIG. 5B</figref> are added through an adder <b>530</b> to be output as a single microphone output signal E<sub>2</sub>.
0038When it is assumed that the microphone array exists on the x-axis of coordinates illustrated in <figref idrefs="DRAWINGS">FIG. 5B</figref>, an angle between the x-axis and the sound source <b>510</b> is θ, and a distance from the origin to the sound source <b>510</b> is R, the microphone output signal is calculated by using Equation 4.
0000<maths id="MATH-US-00004" num="00004"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mrow><mrow><mi>e</mi><mo>=</mo><mrow><mi>A</mi><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo></mo><mrow><mo>(</mo><mrow><mrow><mi>c</mi><mo>·</mo><mi>t</mi></mrow><mo>-</mo><mi>r</mi></mrow><mo>)</mo></mrow></mrow><mi>r</mi></mfrac></mrow></mrow><mo></mo><mstyle><mtext /></mstyle><mo></mo><mrow><mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo>=</mo><msqrt><mrow><msup><mrow><mo>(</mo><mrow><mrow><mi>x</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo>-</mo><mrow><mrow><mi>R</mi><mo>·</mo><mi>cos</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>θ</mi></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup><mo>+</mo><msup><mrow><mo>(</mo><mrow><mrow><mi>y</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo>-</mo><mrow><mrow><mi>R</mi><mo>·</mo><mi>sin</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>θ</mi></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup></mrow></msqrt></mrow><mo>,</mo><mstyle><mtext /></mstyle><mo></mo><mi>where</mi><mo>,</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mo>,</mo><mn>2</mn><mo>,</mo><mn>3</mn><mo>,</mo><mn>4.</mn></mrow><mo></mo><mstyle><mtext /></mstyle><mo></mo><mrow><mi>e</mi><mo></mo><mrow><mo>(</mo><mrow><mi>t</mi><mo>,</mo><mi>λ</mi><mo>,</mo><mi>j</mi></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mi>A</mi><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mrow><mo>[</mo><mrow><mrow><mi>ω</mi><mo>·</mo><mi>t</mi></mrow><mo>-</mo><mrow><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo>·</mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mrow></mrow><mo>]</mo></mrow></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow></mrow><mo>,</mo><mstyle><mtext /></mstyle><mo></mo><mi>where</mi><mo>,</mo><mrow><mi>ω</mi><mo>=</mo><mrow><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo>·</mo><mi>c</mi></mrow></mrow></mrow><mo></mo><mstyle><mtext /></mstyle><mo></mo><mtable><mtr><mtd><mrow><mrow><msub><mi>E</mi><mi>o</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mi>t</mi><mo>,</mo><mi>λ</mi></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mi /><mo></mo><mrow><mi>A</mi><mo>·</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mo>[</mo><mfrac><mrow><mi>sin</mi><mo></mo><mrow><mo>[</mo><mrow><mrow><mi>ω</mi><mo>·</mo><mi>t</mi></mrow><mo>-</mo><mrow><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo>·</mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mrow></mrow><mo>]</mo></mrow></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac><mo>]</mo></mrow></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mi /><mo></mo><mrow><mi>A</mi><mo>·</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mfrac><mrow><mi>cos</mi><mo></mo><mrow><mo>[</mo><mrow><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo>·</mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mrow><mo>]</mo></mrow></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mi /><mo></mo><mrow><mrow><mi>sin</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>ω</mi><mo>·</mo><mi>t</mi></mrow></mrow><mo>-</mo><mrow><mi>A</mi><mo>·</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mfrac><mrow><mi>sin</mi><mo></mo><mrow><mo>[</mo><mrow><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo>·</mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mrow><mo>]</mo></mrow></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac><mo></mo><mi>cos</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>ω</mi><mo>·</mo><mi>t</mi></mrow></mrow></mrow></mrow></mrow></mrow></mtd></mtr></mtable><mo></mo><mstyle><mtext /></mstyle><mo></mo><mrow><mrow><mrow><mo></mo><mrow><msub><mi>E</mi><mn>2</mn></msub><mo></mo><mrow><mo>(</mo><mrow><mi>t</mi><mo>,</mo><mi>λ</mi></mrow><mo>)</mo></mrow></mrow><mo></mo></mrow><mo>=</mo><mrow><mi>A</mi><mo>·</mo><msqrt><mrow><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mfrac><mrow><mi>cos</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow><mo>)</mo></mrow><mn>2</mn></msup><mo>+</mo><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow><mo>)</mo></mrow><mn>2</mn></msup></mrow></msqrt></mrow></mrow><mo>,</mo><mstyle><mtext /></mstyle><mo></mo><mi>where</mi><mo>,</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>ψ</mi><mo>=</mo><mrow><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>π</mi></mrow><mi>λ</mi></mfrac><mo>·</mo><mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo>.</mo></mrow></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>4</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths>
0039Similarly to Equation 2, e denotes an input signal, A denotes an amplitude, λ denotes a wavelength, c denotes a speed of a sound wave in air having a value of 340 m/sec, and E<sub>1 </sub>denotes the microphone output signal.
0040When the microphone output signals E<sub>1 </sub>and E<sub>2 </sub>are compared with each other by using Equations 2 and 4, the microphone output signal E<sub>1 </sub>using the second-order gradient microphone structure further includes a sign component g(j) as compared with the microphone output signal E<sub>2</sub>.
0041The process of generating the microphone output signals by combining the sound source signals performed by the microphone output signal generator <b>120</b> illustrated in <figref idrefs="DRAWINGS">FIG. 1</figref> is described above. In addition, the transformation functions of the microphone output signal generator <b>120</b> are described above by using the second-order gradient microphone structure and the sum of omni microphone structure. A method of configuring the microphone output signal generator <b>120</b> is not limited to the aforementioned embodiments, and it will be understood by those skilled in the art that various methods of designing the microphone output signal generator <b>120</b> and the transformation functions of the microphone output signal generator <b>120</b> may be used according to the number of the plurality of the microphones <b>111</b><sub>1 </sub>to <b>111</b><sub>N </sub>or the method of combining the sound source signals.
0042Next, the distance calculator <b>130</b> calculates distances from the microphones to the sound source from which the sound source signals are emitted by using distance relationships according to frequencies of the sound source signals of the microphone output signals E<sub>1</sub>, . . . , E<sub>K</sub>, . . . , E<sub>M </sub>generated by the microphone output signal generator <b>120</b>. To do this, the distance calculator <b>130</b> operates the microphone output signals E<sub>1</sub>, . . . , E<sub>K</sub>, . . . , E<sub>M </sub>by using distance functions. Here, the distance function refers to a function for independently calculating a distance from a magnitude of the sound source signal by receiving the microphone output signals generated by the microphone output signal generator <b>120</b>. The magnitude of the sound source signal refers to a strength of the sound source signal such as an amplitude of a sound wave. Specifically, the distance function calculates a sound source distance irrespective of the magnitude of the sound source signal among various factors for determining the microphone output signals generated by the microphone output signal generator <b>120</b>. Now, a calculation process of the sound source distance using the distance function with the distance calculator <b>130</b> is described in detail with reference to <figref idrefs="DRAWINGS">FIGS. 6A to 6B</figref>.
0043<figref idrefs="DRAWINGS">FIGS. 6A and 6B</figref> are diagrams for explaining the process of calculating a distance performed by a sound source signal filtering apparatus, according to embodiments of the present invention.
0044In <figref idrefs="DRAWINGS">FIG. 6A</figref>, a distance calculator <b>600</b> receives the microphone output signals E<sub>1</sub>, . . . , E<sub>K</sub>, . . . , E<sub>M </sub>to calculate through a distance function DF(•) thereon, and outputs a sound source distance. The distance function can implement the microphone output signals as a linear or nonlinear function or table, and more specifically, the distance function is a function satisfying the constraint conditions of independent magnitude of the sound source signal described above.
0045For convenience, it is assumed that the two microphone output signals are used and that the distance function DF(•) of the distance calculator <b>600</b> is a ratio between the two output signals. Here, when the microphone output signals are defined as E<sub>1 </sub>and E<sub>2 </sub>obtained by using Equations 2 and 4 described above, the distance function DF(•) may be defined as E<sub>1</sub>/E<sub>2 </sub>represented in Equation 5 as follows.
0000<maths id="MATH-US-00005" num="00005"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><msub><mi>E</mi><mn>1</mn></msub><mo>=</mo><mrow><mi>A</mi><mo></mo><msqrt><mrow><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo></mo><mfrac><mrow><mi>cos</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup><mo>+</mo><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup></mrow></msqrt></mrow></mrow><mo></mo><mstyle><mtext /></mstyle><mo></mo><mrow><msub><mi>E</mi><mn>2</mn></msub><mo>=</mo><mrow><mi>A</mi><mo></mo><msqrt><mrow><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mfrac><mrow><mi>cos</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow><mo>)</mo></mrow><mn>2</mn></msup><mo>+</mo><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow><mo>)</mo></mrow><mn>2</mn></msup></mrow></msqrt></mrow></mrow><mo></mo><mstyle><mtext /></mstyle><mo></mo><mtable><mtr><mtd><mrow><mfrac><msub><mi>E</mi><mn>1</mn></msub><msub><mi>E</mi><mn>2</mn></msub></mfrac><mo>=</mo><mfrac><mrow><mi>A</mi><mo></mo><msqrt><mrow><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo></mo><mfrac><mrow><mi>cos</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup><mo>+</mo><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup></mrow></msqrt></mrow><mrow><mi>A</mi><mo></mo><msqrt><mrow><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mfrac><mrow><mi>cos</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow><mo>)</mo></mrow><mn>2</mn></msup><mo>+</mo><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow><mo>)</mo></mrow><mn>2</mn></msup></mrow></msqrt></mrow></mfrac></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mfrac><msqrt><mrow><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo></mo><mfrac><mrow><mi>cos</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup><mo>+</mo><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup></mrow></msqrt><msqrt><mrow><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mfrac><mrow><mi>cos</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow><mo>)</mo></mrow><mn>2</mn></msup><mo>+</mo><msup><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mn>4</mn></munderover><mo></mo><mfrac><mrow><mi>sin</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>ψ</mi></mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mfrac></mrow><mo>)</mo></mrow><mn>2</mn></msup></mrow></msqrt></mfrac></mrow></mtd></mtr></mtable><mo></mo><mstyle><mtext /></mstyle><mo></mo><mrow><mi>where</mi><mo>,</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mstyle><mtext /></mstyle><mo></mo><mtable><mtr><mtd><mrow><mi>ψ</mi><mo>=</mo><mi /><mo></mo><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>π</mi><mo>·</mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mrow></mrow><mi>λ</mi></mfrac></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mi /><mo></mo><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>π</mi><mo>·</mo><mi>f</mi><mo>·</mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow></mrow></mrow><mi>c</mi></mfrac></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mi /><mo></mo><mfrac><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>π</mi><mo>·</mo><mi>f</mi><mo>·</mo><msqrt><mrow><msup><mrow><mo>(</mo><mrow><mrow><mi>x</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo>-</mo><mrow><mrow><mi>R</mi><mo>·</mo><mi>cos</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>θ</mi></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup><mo>+</mo><msup><mrow><mo>(</mo><mrow><mrow><mi>y</mi><mo></mo><mrow><mo>(</mo><mi>j</mi><mo>)</mo></mrow></mrow><mo>-</mo><mrow><mrow><mi>R</mi><mo>·</mo><mi>sin</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>θ</mi></mrow></mrow><mo>)</mo></mrow><mn>2</mn></msup></mrow></msqrt></mrow></mrow><mi>c</mi></mfrac></mrow></mtd></mtr></mtable></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>5</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths>
0046Here, A denotes an amplitude, θ denotes a direction, f denotes a frequency, c denotes a speed of sound in air, and R denotes a sound source distance. Therefore, the magnitude A (amplitude) of the sound source signal in Equation 5 is present both at a denominator and a numerator and therefore can be eliminated, so that the distance function E<sub>1</sub>/E<sub>2 </sub>can be a function independent from the magnitude of the sound source signal.
0047It can be noted that factors in Equation 5 for determining the distance function E<sub>1</sub>/E<sub>2 </sub>are the direction θ, the frequency f, and the distance R. Therefore, once E<sub>1</sub>/E<sub>2 </sub>is obtained through the use of the direction θ, the frequency f, and the distance function, the distance R can also be obtained. The distance calculator <b>600</b> computes the microphone output signals through the distance function DF(•), and therefore can calculate the sound source distance by using the positional (including direction and distance) relationships according to the results of calculation and frequencies of the sound source signals.
0048<figref idrefs="DRAWINGS">FIG. 6B</figref> illustrates a method of calculating a sound source distance by using a conversion table including results obtained in advance from the transformation function. The distance calculator <b>600</b> illustrated in <figref idrefs="DRAWINGS">FIG. 6B</figref> includes an operator <b>610</b>, a calculator <b>620</b>, and a distance storage <b>630</b>. For the convenience of description, only the two microphone output signals E<sub>1 </sub>and E<sub>2 </sub>are used.
0049The operator <b>610</b> performs a computation by receiving the microphone output signals E<sub>1 </sub>and E<sub>2</sub>. As illustrated in <figref idrefs="DRAWINGS">FIG. 6A</figref>, when the distance function is defined as E<sub>1</sub>/E<sub>2</sub>, a result of the computation is output.
0050The distance storage unit <b>630</b> may store sound source distances in advance according to the computation results of the distance function E<sub>1</sub>/E<sub>2 </sub>in a form of a table or a database. For example, when a direction and a frequency of a sound source are specified, the stored table is searched by using the direction and the frequency, as well as the computation results of the distance function E<sub>1</sub>/E<sub>2</sub>, and a sound source distance corresponding to the search result can be retrieved. When the distance storage unit <b>630</b> is implemented as the database, search keys for searching for the sound source distance may be the direction and the frequency.
0051The calculator <b>620</b> inquires of the distance storage <b>630</b> what value is the sound source distance corresponding to the computation result of the distance function E<sub>1</sub>/E<sub>2 </sub>using the computation result of the operator <b>610</b> and other information (such as the direction and the frequency of a sound source) as parameters. As a result, the calculator <b>620</b> receives the sound source distance.
0052As illustrated in <figref idrefs="DRAWINGS">FIGS. 6A and 6B</figref>, it can be easily construed by the use of Equations described above, studies, or use of experimental results that the distance calculator <b>600</b> can calculate a sound source distance. Therefore, as long as a condition that the distance function of the distance calculator <b>600</b> does not relate to changes in the magnitude of the sound source signal is satisfied, the distance calculator may be designed to be appropriate for an environment in which the exemplary embodiments of the present invention are implemented.
0053The process of calculating the sound source distance performed by the distance calculator <b>130</b> illustrated in <figref idrefs="DRAWINGS">FIG. 1</figref> is described above, according to the aforementioned embodiments. Next, the signal filter <b>140</b> of <figref idrefs="DRAWINGS">FIG. 1</figref> will be described.
0054The signal filter <b>140</b> filters the sound source signals to obtain one or more sound source signals corresponding to particular distances on the basis of the distance calculated by the distance calculator <b>130</b>. Here, the particular distance refers to a sound source distance from which a sound source emitting a sound source signal to be acquired by a user from among sound source signals input though the plurality of the microphones <b>111</b><sub>1 </sub>to <b>111</b><sub>N </sub>is disposed. Since the sound source distances corresponding to sound sources are calculated by the distance calculator <b>130</b>, when sound source signals are filtered by using the sound source distances, only a sound source signal emitted from a sound source from a particular distance can be obtained.
0055Now, a process of filtering the sound source signals performed by the signal filter <b>140</b> will be described in detail with reference to <figref idrefs="DRAWINGS">FIGS. 7A and 7B</figref>. <figref idrefs="DRAWINGS">FIGS. 7A and 7B</figref> are diagrams for explaining the process of filtering sound source signals and an application method thereof performed by the sound source signal filtering apparatus, according to an embodiment of the present invention. First, before explaining <figref idrefs="DRAWINGS">FIGS. 7A and 7B</figref>, the process of filtering sound source signals is described.
0056A detailed process of filtering sound source signals performed by a signal filter (not shown) is as follows. First, a weight of a sound source signal is calculated by comparing the distance calculated by the distance calculator (not shown) with a threshold value. Next, a sound source signal corresponding to a particular distance is obtained according to the calculated weight.
0057In <figref idrefs="DRAWINGS">FIG. 7A</figref>, a result of performing time-frequency transformation on a sound source signal is displayed on coordinates. The abscissa axis of the coordinates refers to time, and the ordinate axis refers to frequency. In general, for digital signal processing, a convolution is used to input a signal to a corresponding system and represent an output signal generated as a result of the input. In this case, in order to limit a given signal, the signal is divided into individual frames to be processed. Here, the frame refers to a unit obtained by dividing the sound source signal into predetermined sections according to changes in time. Specifically, the frame is an individual section obtained by dividing the time axis of the coordinates of <figref idrefs="DRAWINGS">FIG. 7A</figref>. An individual processing unit obtained by dividing the frequency axis into predetermined sections is called a bin.
0058In <figref idrefs="DRAWINGS">FIG. 7A</figref>, a time-frequency transformation result on the left represents a sound source signal before the filtering, and a time-frequency transformation result on the right represents a sound source signal after the filtering. As described above, for a single frequency bin, a sound source distance and a threshold value are compared with each other. The sound source distance may be processed as a particular parameter so as to be easily calculated and used for the comparison. Otherwise, the distance may be directly used for the comparison.
0059In addition, the threshold value may be determined according to an environment in which the exemplary embodiments of the present invention are implemented. Therefore, the threshold value may be a value that has been set to a predetermined value, or a value determined by the user. According to a range of distance areas for filtering the sound source signal, one or more threshold values may be used. For example, when a sound source signal having a sound source distance of 1 m˜2 m and a sound source signal having a sound source distance of 5 m˜7 m are to be simultaneously acquired, four threshold values may be set to perform the sound source distance comparison through the application of various equations.
0060<figref idrefs="DRAWINGS">FIG. 7B</figref> illustrates a method of displaying a sound source signal depending on distances and a method of selecting a region corresponding to a desired sound source. In <figref idrefs="DRAWINGS">FIG. 7A</figref>, the abscissa axis refers to distance, wherein various threshold values such as 1 to N can be set. Thus, only regions corresponding to the sound source desired by the user can be selected and acquired by comparing the sound source distances with the threshold values.
0061Returning to <figref idrefs="DRAWINGS">FIG. 7A</figref>, only two cases where the sound source distance is either larger or smaller than the threshold value are exemplified. Specifically, a filtering method of determining weights as predetermined two values (particularly, performing filtering by using two values 0 and 1) is referred to as a binary weighted filtering. However, it will be understood that a soft weighted filtering method and the like using a linear or nonlinear function in addition to the binary weighted filtering may be used in order to determine the weights. As one of the soft weighted filtering methods, a sigmoid function of transforming input values that are intermittent and nonlinear into continuous and linear values between 0 and 1 is well known.
0062The filter illustrated in <figref idrefs="DRAWINGS">FIG. 7A</figref> is reconfigured by using the aforementioned distance function E<sub>1</sub>/E<sub>2 </sub>as represented by Equation 6.
0000<maths id="MATH-US-00006" num="00006"><math overflow="scroll"><mtable><mtr><mtd><mrow><mo>{</mo><mtable><mtr><mtd><mrow><mrow><mi>W</mi><mo></mo><mrow><mo>(</mo><msub><mi>a</mi><mi>tf</mi></msub><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>a</mi><mi>tf</mi></msub><mo>·</mo><mn>1</mn></mrow></mrow></mtd><mtd><mrow><mrow><mi>if</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mfrac><mrow><msub><mi>E</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mrow><mi>t</mi><mo>,</mo><mi>f</mi></mrow><mo>)</mo></mrow></mrow><mrow><msub><mi>E</mi><mn>2</mn></msub><mo></mo><mrow><mo>(</mo><mrow><mi>t</mi><mo>,</mo><mi>f</mi></mrow><mo>)</mo></mrow></mrow></mfrac></mrow><mo>≥</mo><mi>threshold</mi></mrow></mtd></mtr><mtr><mtd><mrow><mrow><msup><mi>W</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><msub><mi>a</mi><mi>tf</mi></msub><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>a</mi><mi>tf</mi></msub><mo>·</mo><mn>0</mn></mrow></mrow></mtd><mtd><mrow><mrow><mi>if</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mfrac><mrow><msub><mi>E</mi><mn>1</mn></msub><mo></mo><mrow><mo>(</mo><mrow><mi>t</mi><mo>,</mo><mi>f</mi></mrow><mo>)</mo></mrow></mrow><mrow><msub><mi>E</mi><mn>2</mn></msub><mo></mo><mrow><mo>(</mo><mrow><mi>t</mi><mo>,</mo><mi>f</mi></mrow><mo>)</mo></mrow></mrow></mfrac></mrow><mo><</mo><mi>threshold</mi></mrow></mtd></mtr></mtable></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>6</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths>
0063As represented in Equation 6, when a computation result of the distance function is equal to or larger than the threshold value, a weight is calculated by multiplying 1 to the computation result, and when the operation result is smaller than the threshold value, a weight is calculated by multiplying 0 to the computation result.
0064The operations performed by the signal filter <b>140</b> illustrated in <figref idrefs="DRAWINGS">FIG. 1</figref> of obtaining one or more sound source signals corresponding to particular distances by filtering the sound source signals depending on the distances calculated by the distance calculator <b>130</b> are described above. According to an embodiment of the present invention, it is possible to obtain only sound source signals emitted from a sound source at a particular distance from the microphone array among a plurality of sound source signals input through the microphone array.
0065<figref idrefs="DRAWINGS">FIG. 2</figref> is a block diagram illustrating a sound source signal filtering apparatus based on a sound source distance, according to an embodiment of the present invention. The sound source signal filtering apparatus according to the current embodiment further includes a direction calculator <b>250</b> in addition to the sound source signal filtering apparatus illustrated in <figref idrefs="DRAWINGS">FIG. 1</figref>. Similarly to <figref idrefs="DRAWINGS">FIG. 1</figref>, the sound source signal filtering apparatus illustrated in <figref idrefs="DRAWINGS">FIG. 2</figref> also includes a plurality of microphones <b>211</b><sub>1 </sub>to <b>211</b><sub>N</sub>, a microphone output signal generator <b>220</b>, a distance calculator <b>230</b>, and a signal filter <b>240</b>. A newly included direction calculator <b>250</b> will be described in detail below.
0066The direction calculator <b>250</b> calculates input directions of sound source signals by using time delays between the sound source signals input through the plurality of the microphones <b>211</b><sub>1 </sub>to <b>211</b><sub>N</sub>. In general, in order for the microphone array including two or more microphones to receive target signals mixed with background noises with high sensitivity, the microphone array provides an appropriate weight to each of the received signals to increase amplitudes. Accordingly, the microphone array functions as a filter for spatially reducing noise when directions of a desired target signal and an interference noise signal are different from each other. A type of spatial filter having the aforementioned function is called a beam-former.
0067In order to obtain sound source directions of sound source signals input from various sound sources around the microphones, phase differences between an array pattern and signals input to the microphones must be obtained. A number of beam-forming algorithms for obtaining the signal information are widely known. As a representative beam-forming algorithm for amplifying or extracting a target source signal, there is a delay-and-sum algorithm for obtaining a position of a sound source using relative delay times at which sound source signals are arrived at the microphones, or a filter-and-sum algorithm for spatially filtering outputs by using a linear filter to reduce influences from two or more signals and noise in a sound field formed by sound sources. The beam-forming algorithms are well known by those skilled in the art, and the delay-and-sum algorithm will be described to explain the direction calculator <b>250</b> according to embodiments of the present invention described below.
0068As described above, the direction calculator <b>250</b> searches for a sound source signal that has dominant signal characteristics such as high gain or high sound pressure from surroundings to calculate a sound source direction, thus the direction calculator <b>250</b> detects a direction or a position representing dominant signal characteristics regarding the sound sources in the surroundings. Here, for a method of perceiving the dominant signal characteristics, an objective measured value such as a signal to noise ratio (SNR) of a corresponding sound source signal can be used to determine a direction of a sound source having a relatively larger measured value as a target sound source direction.
0069For measurement methods, there are time delay of arrival (TDOA) method, beam-forming method, spectral analysis method, various sound source position searching methods, and the like. Now, the methods are briefly explained.
0070According to the TDOA method, time delays between microphones are measured by paring the microphones of an array regarding a mixed sound input to the plurality of the microphones <b>211</b> and <b>212</b> from a number of sound sources, and directions of the sound sources are estimated by using the measured time delays. Next, the direction calculator <b>250</b> assumed that a sound source exists at a spatial point where the sound source directions estimated by each pair cross. According to the beam-forming method, the direction calculator <b>250</b> provides a delay to a sound source signal at a predetermined angle, scans signals in a space based on angles, and selects a position having a largest scanned signal value as a target sound source direction, thereby estimating a position of the sound source. The various position searching methods can be easily construed so a detailed description thereof is omitted.
0071<figref idrefs="DRAWINGS">FIGS. 3A to 3C</figref> are views for explaining a process of calculating a direction of a sound source performed by the sound source signal filtering apparatus according to the embodiment of the present invention and illustrate the aforementioned direction calculating operations.
0072Sound waves illustrated in <figref idrefs="DRAWINGS">FIG. 3A</figref> represent sound source signals input through the microphones. Specifically, the sound waves on the left represent operations of searching for a direction of a sound source, and the sound waves on the right represent sound waves when the direction of the sound source is searched. First, the direction calculator (not shown) searches for a sound source signal while changing an angle of all surrounding directions. When the direction of the sound source and a direction the microphones are headed for are different from each other, distance differences between the microphones may generate a delay between arrival times of sound waves. In <figref idrefs="DRAWINGS">FIG. 3A</figref>, it can be seen that a time difference of τ<sub>N</sub>−τ<sub>1 </sub><b>310</b> occurs between arrival times of a sound wave e<sub>1</sub>(t) and a sound wave e<sub>N</sub>(t). By controlling a delay value so that the time difference does not occur and the arrival times are the same as a reference value <b>320</b> on the right, phases and magnitudes of the sound waves are substantially the same, so that the sound source direction can be calculated by using the delay value.
0073<figref idrefs="DRAWINGS">FIG. 3B</figref> illustrates a configuration according to the delay-and-sum algorithm for controlling the delay value of <figref idrefs="DRAWINGS">FIG. 3A</figref>. In <figref idrefs="DRAWINGS">FIG. 3B</figref>, the sound source signals (referred to as arrived sound waves) e<sub>1 </sub>to e<sub>N </sub>are delayed by a predetermined time through delay units <b>331</b><sub>1 </sub>to <b>331</b><sub>N</sub>, and the sound source signals are generated as an output signal S through an adder <b>340</b>. Here, the delay units <b>331</b><sub>1 </sub>to <b>331</b><sub>N </sub>control the delay value so that a magnitude of an output signal S is maximized. As described with reference to <figref idrefs="DRAWINGS">FIG. 3A</figref>, when the direction of the microphones and the direction of the sound source are aligned, the time delays of the sound source signals are the same, and the magnitudes of the sound source signals are substantially the same. When the sound source signals are added, the sound source signal may be amplified. Therefore, according to the current embodiment of the present invention, the delay units <b>331</b><sub>1 </sub>and <b>331</b><sub>N </sub>control the delay values and calculate a delay value when the output signal S is maximized to calculate the sound source direction.
0074<figref idrefs="DRAWINGS">FIG. 3C</figref> illustrates a process of calculating the sound source direction using the delay value. In <figref idrefs="DRAWINGS">FIG. 3A</figref>, it is assumed that microphones M<sub>1</sub>, . . . , M<sub>k</sub>, M<sub>K+1</sub>, . . . , M<sub>N </sub>are arrayed at a horizontal line <b>360</b>. In addition, slanted lines represent directions in which sound source signals are incident from a sound source. When an interval between the microphones is denoted as r, Equation 7 is obtained.
0000<br />τ<sub>k</sub><i>·c=r </i>sin θ [Equation 7]
0075Here, τ<sub>K </sub>denotes a delay value, c denotes a speed of a sound wave in air, and θ denotes an angle (the sound source direction) between the microphones and the sound source. By arranging Equation 7, Equation 8 can be obtained.
0000<maths id="MATH-US-00007" num="00007"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>θ</mi><mo>=</mo><mrow><msup><mi>sin</mi><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo></mo><mrow><mo>(</mo><mfrac><mrow><msub><mi>τ</mi><mi>k</mi></msub><mo>·</mo><mi>c</mi></mrow><mi>r</mi></mfrac><mo>)</mo></mrow></mrow></mrow></mtd><mtd><mrow><mo>[</mo><mrow><mi>Equation</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mn>8</mn></mrow><mo>]</mo></mrow></mtd></mtr></mtable></math></maths>
0076Specifically, Equation 8 infers that the sound source direction can be calculated through the use of the delay value measured in advance, the speed of the sound wave, and the interval between the microphones.
0077The process of calculating the sound source direction performed by the direction calculator <b>250</b> illustrated in <figref idrefs="DRAWINGS">FIG. 2</figref> is described above. By using the calculated sound source direction and the microphone output signals generated by the microphone output signal generator <b>220</b>, the distance calculator <b>230</b> calculates the sound source distance, and the signal filter <b>240</b> acquires a sound source signal corresponding to a particular distance. This is described above with reference to <figref idrefs="DRAWINGS">FIG. 1</figref>.
0078According to an embodiment of the present invention, it is possible to obtain only sound source signals emitted from a sound source at a particular distance from a microphone array among a plurality of sound source signals input through the microphone array. Particularly, sound source signals emitted from a sound source in the same direction as the microphone array can be clearly identified, so that even if a target sound source and a noise sound source are in the same direction, a target sound source signal and a noise signal can be clearly distinguished by using a sound source distance.
0079<figref idrefs="DRAWINGS">FIG. 8</figref> is a flowchart of a sound source signal filtering method based on a sound source distance, according to an embodiment of the present invention and includes a process as follows.
0080In operation <b>810</b>, two or more microphone output signals are generated by combining sound source signals input through a plurality of microphones. The microphone output signals have different sound attenuation rates according to distances.
0081In operation <b>820</b>, by using distance relationships according to frequencies of the sound source signals of the microphone output signals generated in operation <b>810</b>, distances from the microphones to the sound source from which the sound source signals are emitted are calculated. This process performs the removal of magnitudes of the generated microphone output signals to generate result values independent from the magnitudes of the signals, and this process calculates the distance to the sound source by using the result values.
0082In operation <b>830</b>, the sound source signals are filtered to obtain one or more sound source signals corresponding to a predetermined distance by using the distances calculated in operation <b>820</b>. The process of filtering the sound source signals are performed by comparing the distance calculated in operation <b>820</b> with a predetermined threshold value to calculate weights of the sound source signals, and by obtaining the sound source signals corresponding to the predetermined distance based on the calculated weights. Here, the weight of the sound source signal may be a predetermined value or an output value obtained by inputting a result of the comparison of the distance computed in operation <b>820</b> with a predetermined threshold value to a linear or nonlinear function.
0083Accordingly, it is possible to obtain only sound source signals emitted from a sound source at a particular distance from the microphone array among a plurality of sound source signals input through the microphone array, according to another embodiment of the present invention.
0084An embodiment of the present invention can also be embodied as computer readable codes on a computer readable recording medium. The computer readable recording medium is a data storage device that can store data which can be read by a computer system. Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission through the Internet). The computer readable recording medium can also be distributed over network-coupled computer systems so that the computer readable code can be stored and executed in a distributed fashion. Also, functional programs, codes, and code segments for accomplishing the present invention can be easily construed by programmers skilled in the art to which the present invention pertains.
0085While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. The exemplary embodiments should be considered in descriptive sense only and not for purposes of limitation. Therefore, the scope of the invention is defined not by the detailed description of the invention but by the appended claims, and all differences within the scope will be construed as being included in the present invention.
Contents5
18 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US9668048B2 | Cited by | United States of America | Applicant |
| US9794619B2 | Cited by | United States of America | Applicant |
| US9628908B2 | Cited by | United States of America | Search report |
| US9848222B2 | Cited by | United States of America | Applicant |
| US10264301B2 | Cited by | United States of America | Applicant |
| US2014282663A1 | Cited by | United States of America | Pre-grant |
| US8913757B2 | Cited by | United States of America | Search report |
| US2009226005A1 | Cited by | United States of America | Pre-grant |
| US9197974B1 | Cited by | United States of America | Search report |
| US9736611B2 | Cited by | United States of America | Applicant |
| US9799330B2 | Cited by | United States of America | Applicant |
| US2011194704A1 | Cited by | United States of America | Pre-grant |
| US9912990B2 | Cited by | United States of America | Search report |
| US9924224B2 | Cited by | United States of America | Applicant |
| US9699554B1 | Cited by | United States of America | Applicant |
| US2019206395A1 | Cited by | United States of America | Search report |
| US2010255878A1 | Cited by | United States of America | Pre-grant |
| US8107642B2 | Cited by | United States of America | Search report |
| US10219034B2 | Cited by | United States of America | Search report |
| US2017041667A1 | Cited by | United States of America | Pre-grant |
| US9622012B2 | Cited by | United States of America | Search report |
| US10057639B2 | Cited by | United States of America | Applicant |
| US10694234B2 | Cited by | United States of America | Applicant |
| US9838784B2 | Cited by | United States of America | Applicant |
| US9843880B2 | Cited by | United States of America | Applicant |
| US9197930B2 | Cited by | United States of America | Search report |
| US9503783B2 | Cited by | United States of America | Applicant |
| US10735809B2 | Cited by | United States of America | Applicant |
| US2015208171A1 | Cited by | United States of America | Pre-grant |
| US10991367B2 | Cited by | United States of America | Search report |
| US9640194B1 | Cited by | United States of America | Applicant |
| CN105578097A | Cited by | China | Search report |
| US2014192997A1 | Cited by | United States of America | Pre-grant |
| US9978388B2 | Cited by | United States of America | Applicant |
| US7710826B2 | Cites | United States of America | Pre-grant |
| US8005237B2 | Cites | United States of America | Pre-grant |
8 members in 2 offices
Priority claims3
| Document | Office | Kind | Date |
|---|---|---|---|
| 20070124385 | Republic of Korea | A | |
| 1020070124385 | – | – | – |
| KR20070124385 | – | – | – |
Members8
| Document | Office | Kind | |
|---|---|---|---|
| US2009141908A1 | United States of America | A1 | |
| KR20090057692A | Republic of Korea | A | |
| US8385562B2 | United States of America | B2 | |
| KR101238362B1 | Republic of Korea | B1 | |
| US2013129113A1 | United States of America | A1 | |
| US8577055B2 | United States of America | B2 | |
| US2014056106A1 | United States of America | A1 | |
| US9182475B2 | United States of America | B2 |
9 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Lapsed due to failure to pay maintenance feeLapsedFP | FP | |
| Lapse for failure to pay maintenance feesLapsedPATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYLAPS | LAPS | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Fee payment procedureMAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP | |
| Maintenance fee paymentMAFP | MAFP | |
| Fee paymentFPAY | FPAY | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| Fee payment procedurePAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP | |
| AssignmentAS | AS |
Numbers
- Publication, DOCDB
- 2009141908
- Publication, EPODOC
- US2009141908
- Application
- 12149521
- Application, DOCDB
- 14952108
- Application, EPODOC
- US20080149521
Titles
- English
- Distance based sound source signal filtering method and apparatus
Classification
- CPC, 4
- H04R3/005
- G01S5/20
- H04R3/00
- H04R1/40
- IPC, 1
- H04R3 00
- USPC, 1
- 381092000