Automatic haptic generation based on visual odometry
Abstract
Examples of devices (100, 200), systems (236), and methods to automatically generate haptics based on visual odometry are disclosed. In one example, a video having a plurality of frames is received and an optical flow estimate (400) between a first frame from the plurality of frames and a second frame from the plurality of frames is created. In this example, the second frame is subsequent to the first frame. An apparent movement of a stationary object (460) between the first frame and the second frame is detected based at least in part on the optical flow estimate (400) in this example and at least one haptic effect corresponding to the apparent movement of the stationary object (460) is generated based at least in part on the optical flow estimate (400). The generated haptic effect(s) may be output to a haptic file or a haptic output device (118, 218), or both.

Term
Projected expiry 14 December 2037.
- Priority
- Filed
- Published
- Today
- Projected expiry
1 sheet
Sheet 1
Every citation, both waysCites: the store holds 7 of 8
| Document | Relation | Office | Category | Cited during | Relevant claims |
|---|---|---|---|---|---|
| EP1549047A2 | Cites | European Patent Office (EPO) | Y | Search report | 11,12 |
| EP1959675A2 | Cites | European Patent Office (EPO) | Y | Search report | 4-6,8,10 |
| US2009096879A1 | Cites | United States of America | Y | Search report | 11 |
| WO2009139723A1 | Cites | World Intellectual Property Organization (WIPO) | Y | Search report | 2,3 |
| US2012162450A1 | Cites | United States of America | Y | Search report | 4-11 |
| US2015109528A1 | Cites | United States of America | XY | Search report | 1,13-15 |
| US2015262376A1 | Cites | United States of America | X | Search report | 1,14,15 |
7 members in 5 offices
Priority claims4
| Document | Office | Kind | Date |
|---|---|---|---|
| 201615378686 | United States of America | A | |
| 201615378686 | United States of America | – | |
| 201615378686 | – | – | – |
| US201615378686 | – | – | – |
Members7
| Document | Office | Kind | |
|---|---|---|---|
| US2018165926A1 | United States of America | A1 | |
| EP3336660A2 | European Patent Office (EPO) | A2 | |
| KR20180068867A | Republic of Korea | A | |
| CN108230360A | China | A | |
| JP2018109960A | Japan | A | |
| EP3336660A3This record | European Patent Office (EPO) | A3 | |
| US10600290B2 | United States of America | B2 |
24 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Application deemed to be withdrawnWithdrawn18D | 18D | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWNSTAA | STAA | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: EXAMINATION IS IN PROGRESSSTAA | STAA | |
| First examination report despatched17Q | 17Q | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: EXAMINATION IS IN PROGRESSSTAA | STAA | |
| Request for examination filed17P | 17P | |
| Designated contracting states (corrected)RBV | RBV | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: REQUEST FOR EXAMINATION WAS MADESTAA | STAA | |
| Designated contracting statesAK | AK | |
| Request for extension of the european patentAX | AX | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | |
| Designated contracting statesAK | AK | |
| Request for extension of the european patentAX | AX | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: THE APPLICATION HAS BEEN PUBLISHEDSTAA | STAA |
Numbers
- Publication
- 3336660
- Publication, DOCDB
- 3336660
- Publication, EPODOC
- EP3336660
- Application
- 172074585
- Application, DOCDB
- 17207458
- Application, EPODOC
- EP20170207458
Titles3
- German
- AUTOMATISCHE HAPTIKERZEUGUNG AUF BASIS VON VISUELLER ODOMETRIE
- English
- AUTOMATIC HAPTIC GENERATION BASED ON VISUAL ODOMETRY
- French
- GÉNÉRATION HAPTIQUE AUTOMATIQUE BASÉE SUR L'ODOMÉTRIE VISUELLE
Classification
- CPC, 7
- G06T7/246
- G08B6/00
- G06F3/016
- G06T2207/10016
- G06K9/00335
- G06T7/269
- H04N5/145
- IPC, 9
- G06F3 01
- G06K9 46
- G06K9 48
- G06K9 62
- G06T7 00
- G06T7 20
- G06T7 246
- G08B6 00
- H04N5 14
Designated states40
- Contracting states, 38
- Albania
- Austria
- Belgium
- Bulgaria
- Switzerland
- Cyprus
- Czechia
- Germany
- Denmark
- Estonia
- Spain
- Finland
- France
- United Kingdom
- Greece
- Croatia
- Hungary
- Ireland
- Iceland
- Italy
- Liechtenstein
- Lithuania
- Luxembourg
- Latvia
and 14 moreShow fewer
- Monaco
- North Macedonia
- Malta
- Netherlands (Kingdom of the)
- Norway
- Poland
- Portugal
- Romania
- Serbia
- Sweden
- Slovenia
- Slovakia
- San Marino
- Türkiye
- Extension states, 2
- Bosnia and Herzegovina
- Montenegro