Method and apparatus for multi-sensory speech enhancement on a mobile device
Abstract
A mobile device is provided that includes a digit input that can be manipulated by a user's fingers or thumb, an air conduction microphone (108) and an alternative sensor (112,114) that provides an alternative sensor signal indicative of speech. Under some embodiments, the mobile device also includes a proximity sensor (116) that provides a proximity signal indicative of the distance from the mobile device to an object. Under some embodiments, the signal from the air conduction microphone, the alternative sensor signal, and the proximity signal are used to form an estimate of a clean speech value. In further embodiments, a sound is produced through a speaker (110) in the mobile device based on the amount of noise in the clean speech value. In other embodiments, the sound produced through the speaker is based on the proximity sensor signal.

Term
Term ended
Projected expiry passed 14 February 2025, 1.6 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
1 sheet
Sheet 1
Every citation, both waysCites: the store holds 4 of 5
| Document | Relation | Office | Category | Cited during | Relevant claims |
|---|---|---|---|---|---|
| JP2000250577A | Cites | Japan | A | Search report | 1-33 |
| US2003125081A1 | Cites | United States of America | X | Search report | 1,28 |
| WO2004012477A2 | Cites | World Intellectual Property Organization (WIPO) | X | Search report | 1-33 |
| JPH09284877A | Cites | Japan | A | Search report | 1-33 |
| YANLI ZHENG ET AL: "Air- and bone-conductive integrated microphones for robust speech detection and enhancement", AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING, 2003. ASRU '03. 2003 IEEE WORKSHOP ON ST. THOMAS, VI, USA NOV. 30-DEC. 3, 2003, PISCATAWAY, NJ, USA,IEEE, 30 November 2003 (2003-11-30), pages 249 - 254, XP010713318, ISBN: 0-7803-7980-2 | Non-patent | – | – | Search report | – |
30 members in 17 offices
Priority claims5
| Document | Office | Kind | Date |
|---|---|---|---|
| 785768 | United States of America | – | |
| 78576804 | United States of America | A | |
| 78576804 | United States of America | A | |
| 785768 | – | – | – |
| US20040785768 | – | – | – |
Members30
| Document | Office | Kind | |
|---|---|---|---|
| NO20050986D0 | Norway | D0 | |
| CA2494637A1 | Canada | A1 | |
| NO20050986L | Norway | L | |
| US2005185813A1 | United States of America | A1 | |
| KR20050086378A | Republic of Korea | A | |
| CN1662018A | China | A | |
| EP1569422A2 | European Patent Office (EPO) | A2 | |
| AU2005200249A1 | Australia | A1 | |
| JP2005244968A | Japan | A | |
| SG114686A1 | Singapore | A1 | |
| BRPI0500587A | Brazil | A | |
| MXPA05002133A | Mexico | A | |
| TW200601798A | Taiwan Province of China | A | |
| IL166473A0 | Israel | A0 | |
| RU2005104970A | Russian Federation | A | |
| NZ537900A | New Zealand | A | |
| ZA200500691B | South Africa | B | |
| EP1569422A3This record | European Patent Office (EPO) | A3 | |
| US7499686B2 | United States of America | B2 | |
| CN101510905A | China | A | |
| RU2376722C2 | Russian Federation | C2 | |
| CN100583909C | China | C | |
| IL166473A | Israel | A | |
| CN101510905B | China | B | |
| JP4796309B2 | Japan | B2 | |
| KR101137181B1 | Republic of Korea | B1 | |
| NO332636B1 | Norway | B1 | |
| CA2494637C | Canada | C | |
| EP1569422B1 | European Patent Office (EPO) | B1 | |
| ES2775799T3 | Spain | T3 |
77 legal events, as 11 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent expired after termination of 20 yearsExpiredPE20 | PE20 | GB | |
| Announcement of lapse in spainLapsedFD2A | FD2A | ES | |
| Expiry of rightR071 | R071 | DE | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Opt-out of the competence of the unified patent court (upc) registeredP01 | P01 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed because of non-payment of the annual feeLapsedMM | MM | BE | |
| No opposition filedOpposition26N | 26N | EP | |
| Patent ceasedCeasedPL | PL | CH | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Deletion acc. to par. 5 (withdrawal of the translation of the ep patent)MK05 | MK05 | AT | |
| No opposition filed against granted patent, or epo opposition proceedings concluded without decisionGrantedR097 | R097 | DE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Definitive protectionFG2A | FG2A | ES | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Invalidated european patentMG4D | MG4D | LT | |
| Patent invalid in the netherlands as no translation has been filedMP | MP | NL | |
| European patents granted designating irelandGrantedFG4D | FG4D | IE | |
| Dpma publication of mentioned ep patent grantGrantedR096 | R096 | DE | |
| European patent takes effect as a national patent in ch/liEP | EP | CH | |
| Reference to at number (ep patent validated in austria)REF | REF | AT | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: THE PATENT HAS BEEN GRANTEDSTAA | STAA | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Intention to grant announcedINTG | INTG | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: GRANT OF PATENT IS INTENDEDSTAA | STAA | EP | |
| Amendment of ipc main classPREVIOUS MAIN CLASS: H04M0001030000R079 | R079 | DE | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: EXAMINATION IS IN PROGRESSSTAA | STAA | EP | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | EP | |
| Applications withdrawn, deemed to be withdrawn, or refused after publication in hong kongWithdrawnWD | WD | HK | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | EP | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Designation fees paidAKX | AKX | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | EP | |
| Requests to designate patent in hong kongDE | DE | HK | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 1569422
- Publication, DOCDB
- 1569422
- Publication, EPODOC
- EP1569422
- Application
- 5101071
- Application, DOCDB
- 05101071
- Application, EPODOC
- EP20050101071
Titles3
- German
- Verfahren und Vorrichtung zur Sprachverbesserung mit mehreren Sensoren für ein Mobilgerät
- English
- Method and apparatus for multi-sensory speech enhancement on a mobile device
- French
- Méthode et dispositif multisensoriel d'amélioration de la parole pour un terminal mobile
Classification
- CPC, 11
- H04R3/005
- A23N12/023
- G10L21/0208
- H04M1/6008
- H04M1/6016
- H04M1/605
- H04M2250/12
- H04R2460/13
- H04R2499/11
- A47L15/13
- A47L15/0015
- IPC, 5
- H04M1 03
- G10L21 02
- H04R1 00
- H04M1 60
- H04R1 02
Designated states2
- Contracting states, 1
- Türkiye
- Extension states, 1
- Yugoslavia, later Serbia and Montenegro (until 2006)