Voice control system with a microphone array
5 claims: 1 independent, 4 dependent
- 11つ以上の外部機器を有する消費者電子機器のための、マイクロホンアレイを用いたボイス制御システムであって、 検出した信号を電気信号に変換する複数のマイクロホンであって、1つ以上のマイクロホンが前記外部機器と一体化された複数のマイクロホンと、 前記複数のマイクロホンに接続された中央信号処理ユニットであって、前記信号処理ユニットは前記複数のマイクロホンから受信した前記電気信号を前記 消費者電子機器 に対する それぞれの マイクロホン の位 置に応じてスケーリングまたは処理し、前記それぞれの マイクロホンの 位置は 前記消費者電子機器のスピーカにより再生されたテスト信号の 伝搬遅延の相違により得られ 、前記スケーリングまたは処理は異なる伝搬遅延を合わせる遅延を含む、 中央信号処理ユニットと、 前記信号処理ユニットからの前記電気信号を前記消費者電子機器の操作コマンドに変換する中央音声認識ユニットとを有するシステム。
- 2前記外部 機器は双方向ネットワークを介して 前記消費者電子機器と 接続される、請求項1記載のシステム。
- 3前記 双方向ネットワークはIEEE1394バスに基づくことを特徴とする、請求項2記載のシステム。
- 41つ以上のマイクロホンが追加的に消費者電子機器に一体化される、請求項1または2記載のシステム。
- 5前記消費者電子機器はテレビジョンセットであり、前記外部機器は外部スピーカである、請求項1または2記載のシステム。
Independent claims5
1 paragraph, as filed
[0001] [Technical field to which the invention belongs] The present invention relates to a voice control system having a microphone array and particularly capable of being used to control a device belonging to a consumer electronic device. [0002] [Conventional technology] Voice control systems are used in many technical fields. In this case, the spoken word is usually first detected as a sound signal by one or more microphones and then fed to a speech recognition system. In this case, speech recognition is usually based on acoustic and speech models. Acoustic models utilize a large number of speech patterns and mathematical algorithms are used to indicate the words that best acoustically match the spoken word. The speech model is based on an analysis that uses a large number of document samples to ascertain the context and frequency in which a word is commonly used. Such a speech recognition system makes it possible to recognize not only individual words but also sentences fluently spoken with a high recognition rate. However, in the presence of non-negligible background noise, the recognition rate is greatly reduced. [0003] The resilience to the effects of such acoustic interference can be increased in various ways. Therefore, in a dictation system for a computer, the microphone provided on the headset frame is fixed just in front of the speaker's mouth. In these systems, a very constant signal, and in some circumstances a significant recognition rate, can only be achieved in the immediate vicinity of the mouth. Similarly, it is known to control a television receiver by speaking an operation command to a microphone integrated with a remote control device. However, again, the remote controller must be held just in front of the user's mouth. [0004] [Problems to be Solved by the Invention] It is an object of the present invention to provide a voice control system that enables sufficient safety against interference even in the case of voice input from a relatively long distance. [0005] [Means for solving problems] The above object is achieved by the system according to claim 1. The voice signal must be separated from the disturbing background signal to allow voice control from a relatively long distance . This can be done by separating into space using a microphone array containing two or more microphones. In this case, it is advantageous that the individual microphones in the microphone array are spatially dispersed over the largest possible distance. However, in individual consumer electronic devices, the distance between individual microphones is limited by the dimensions of the device, for example, in the case of television receivers, to 1 meter or less. [0006] In principle, the voice control system according to the present invention has a plurality of microphones that convert voice commands into electric signals, and a central voice recognition unit that converts the electric signals into operation commands. The generated signal is distributed among different interconnected devices so that it can be transmitted to the central speech recognition unit. [0007] In this case, it is particularly advantageous that the devices are connected via a bidirectional network, which is an IEEE1394 bus. [0008] The system is particularly advantageous when one or more microphones are integrated into consumer regenerative electronics, especially television receivers, and one or more additional microphones are integrated into external speakers. [0009] BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described with reference to the accompanying drawings. [0010] FIG. 1 is a diagram schematically showing a system according to the present invention. Two external speakers LS1 and LS2 are connected to the television receiver TV. The internal speakers (not shown) of the television receiver, along with the external speakers, enable surround sound reproduction of multi-channel audio signals, such as the reproduction of corresponding digital audio signals conforming to the MPEG2 or AC3 standards. In this example, the external speakers are connected to the television receiver via an IEEE1394 bus, also known as FireWire, but may be connected to a suitable surround sound receiver. Using the IEEE1394 bus is advantageous because it enables high-speed data transmission and communication between different devices. Further, in the case of an active speaker, power can be supplied simultaneously via this bus. [0011] A microphone array is provided to detect the voice signal. The microphone array includes two microphones MTV1 and MTV2 integrated in the television receiver, and the microphones MLS1 and MLS2 are integrated in the speaker housing. These microphones convert the detected sound signal into an electric signal, which is amplified by an amplifier, converted into a digital signal by an AD converter, and supplied to a signal processing unit. In this example, the signal from the external speaker is similarly supplied to the signal processing unit in the television receiver via the IEEE1394 bus. The signal processing unit takes into account each user's position by different scaling or processing of the detected sound signal. In addition, the microphone signal can be corrected with respect to the sound signal output by the speaker. The signal processed in this way is then supplied to a speech recognition unit that converts the electrical signal into words. Finally, the instructions corresponding to these words are fed to the system manager to control the system. [0012] Scaling or processing of the detected sound signal by the signal processing unit requires that the spatial arrangement of the microphones be known. This is known by the manufacturer for microphones integrated into the television enclosure. On the other hand, in the case of a microphone arranged in a speaker, the position with respect to the television receiver must be determined. This is done by measuring and inputting values determined via the corresponding screen menus. However, measurement and configuration operations can also be performed by the test signal tone being reproduced by the speaker, detected by the microphone, and the position of the microphone being determined from various propagation delays. [0013] The two microphones integrated into the television receiver can be advantageously housed on the left and right sides of the housing of each device. However, the number of microphones and the number of additional microphones is not limited to two. Many combinations are conceivable in which the microphone is integrated. Thus, the microphone may be integrated into a video recorder, DVD player, or remote controller instead of or in addition to the television. It is also possible to incorporate the microphone into devices located in different rooms. [0014] Furthermore, device connections are not limited to bus systems. Therefore, for example, it is conceivable that the speaker of the embodiment of FIG. 1 is driven by a wireless signal. However, in this case, each speaker must have a wireless transmitter in addition to the wireless receiver. [0015] The present invention relates to consumer electronic devices such as television receivers, video recorders, DVD players, satellite receivers, television / video combinations, audio equipment, or similar complete audio systems for personal computers or home appliances. Can be used for voice-operated remote control of a wide range of devices belonging to. [Simple explanation of drawings] FIG. 1 is a diagram showing an arrangement for voice control using a microphone array according to the present invention. [Explanation of symbols] MLS1, MLS2 microphone LS1, LS2 external speaker TV television receiver MTV1, MTV2 microphone
1 sheet
Sheet 1
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| US05255326A | Cites | United States of America |
| JP10282993A | Cites | Japan |
| JP11311996A | Cites | Japan |
| JP04175073A | Cites | Japan |
| JP04119400A | Cites | Japan |
| JP04318798A | Cites | Japan |
8 members in 5 offices
Priority claims5
| Document | Office | Kind | Date |
|---|---|---|---|
| 19943875 | Germany | A | |
| 19943875 | Germany | A | |
| 199438757 | Germany | – | |
| 199919943875 | – | – | – |
| DE1999143875 | – | – | – |
Members8
| Document | Office | Kind | |
|---|---|---|---|
| DE19943875A1 | Germany | A1 | |
| CN1288222A | China | A | |
| EP1085782A2 | European Patent Office (EPO) | A2 | |
| JP2001117587A | Japan | A | |
| EP1085782A3 | European Patent Office (EPO) | A3 | |
| CN1162837C | China | C | |
| US6868045B1 | United States of America | B1 | |
| JP4792156B2This record | Japan | B2 |
30 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Cancellation because of completion of termEXPY | EXPY | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Written notification of registration of transferJAPANESE INTERMEDIATE CODE: R350R350 | R350 | |
| Request for change of ownership or part of ownershipJAPANESE INTERMEDIATE CODE: R313113S111 | S111 | |
| Written request for registration of reclamation of domicileJAPANESE INTERMEDIATE CODE: R313631S631 | S631 | |
| Written request for registration of reclamation of nameJAPANESE INTERMEDIATE CODE: R313633S633 | S633 | |
| Written measure of declining of transfer procedureJAPANESE INTERMEDIATE CODE: R370R370 | R370 | |
| Written notification for declining of transfer of rightsJAPANESE INTERMEDIATE CODE: R360R360 | R360 | |
| Request for change of ownership or part of ownershipJAPANESE INTERMEDIATE CODE: R313113S111 | S111 | |
| Written notification of registration of transferJAPANESE INTERMEDIATE CODE: R350R350 | R350 | |
| Written request for registration of change of domicileJAPANESE INTERMEDIATE CODE: R313531S531 | S531 | |
| Written request for registration of change of nameJAPANESE INTERMEDIATE CODE: R313533S533 | S533 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Transfer withdrawnWithdrawnJAPANESE INTERMEDIATE CODE: R371R371 | R371 | |
| Request for change of ownership or part of ownershipJAPANESE INTERMEDIATE CODE: R313113S111 | S111 | |
| Request for change of ownership or part of ownershipJAPANESE INTERMEDIATE CODE: R313111S111 | S111 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Written amendmentJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Written amendmentJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Written request for application examinationJAPANESE INTERMEDIATE CODE: A621A621 | A621 |
Numbers
- Publication
- 4792156
- Publication, DOCDB
- 4792156
- Publication, EPODOC
- JP4792156B
- Application
- 277687
- Application, DOCDB
- 2000277687
- Application, EPODOC
- JP20000277687
Titles2
- Japanese
- マイクロホンアレイを有するボイス制御システム
- English
- Voice control system with microphone array
Classification
- CPC, 4
- H04R3/005
- G10L2021/02166
- H04R2201/401
- G10L15/26
- IPC, 6
- G10L15 28
- G10L15 20
- H04R1 40
- G10L15 26
- G10L21 0216
- H04R3 00
