Tracking a surface in a 3-dimensional scene using natural visual features of the surface
Abstract
A facility for determining the 3-dimensional location and orientation of a subject surface in a distinguished perspective image of the subject surface is described. The subject surface has innate visual features, a subset of which are selected. The facility uses the location of the selected visual features in a perspective image of the subject surface that precedes the distinguished perspective image in time to identify search zones in the distinguished perspective image. The facility searches the identified search zones for the selected visual features to determine the 2-dimensional locations at which the selected visual features occur. Based on the determined 2-dimensional locations, the facility determines the 3-dimensional location and orientation of the subject surface in the distinguished perspective image.
Term
Term ended
Projected expiry passed 22 October 2023, 2.9 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
Every citation, both ways
| Reference | Relation | Cited during |
|---|---|---|
| ULRICH NEUMANN ET AL: "Natural Feature Tracking for Augmented Reality", IEEE TRANSACTIONS ON MULTIMEDIA, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 1, no. 1, 1 March 1999 (1999-03-01), XP011036279, ISSN: 1520-9210 | Non-patent | Search report |
| SIMON G ET AL: "Markerless tracking using planar structures in the scene", AUGMENTED REALITY, 2000. (ISAR 2000). PROCEEDINGS. IEEE AND ACM INTERN ATIONAL SYMPOSIUM ON MUNICH, GERMANY 5-6 OCT. 2000, PISCATAWAY, NJ, USA,IEEE, US, 5 October 2000 (2000-10-05), pages 120 - 128, XP010520321, ISBN: 978-0-7695-0846-7 | Non-patent | Search report |
| JETHWA M ET AL: "Real-time panoramic mosaics and augmented reality", BMVC 98. PROCEEDINGS OF THE NINTH BRITISH MACHINE VISION CONFERENCE UNIV. SOUTHAMPTON SOUTHAMPTON, UK, vol. 2, 1998, pages 852 - 862 VOL.2, XP002534480, ISBN: 1-901725-04-9 | Non-patent | Search report |
| FORSTNER, W. AND GULCH, E.: "A fast operator for detection and precise location of distinct points, corners and centres of circular features", ISPRS INTERCOMMISSION CONFERENCE ON FAST PROCESSING OF PHOTOGRAMMETRIC DATA, 1 June 1987 (1987-06-01), interlaken, Switzerland, pages 281 - 305, XP002534481 | Non-patent | Search report |
17 members in 7 offices
Priority claims5
| Document | Office | Kind | Date |
|---|---|---|---|
| 420638P | United States of America | – | |
| 42063802 | United States of America | P | |
| 513725P | United States of America | – | |
| 0306418 | International Bureau of the World Intellectual Property Organization (WIPO) | W | |
| 51372503 | United States of America | P |
Members17
| Document | Office | Kind | |
|---|---|---|---|
| WO2004038657A2 | World Intellectual Property Organization (WIPO) | A2 | |
| AU2003298491A1 | Australia | A1 | |
| AU2003298491A8 | Australia | A8 | |
| WO2004038657A8 | World Intellectual Property Organization (WIPO) | A8 | |
| US2004136567A1 | United States of America | A1 | |
| WO2004038657A9 | World Intellectual Property Organization (WIPO) | A9 | |
| WO2004038657A3 | World Intellectual Property Organization (WIPO) | A3 | |
| EP1556805A2 | European Patent Office (EPO) | A2 | |
| JP2006507722A | Japan | A | |
| NZ539632A | New Zealand | A | |
| US7343278B2 | United States of America | B2 | |
| US2008232645A1 | United States of America | A1 | |
| EP1556805A4This record | European Patent Office (EPO) | A4 | |
| US7987079B2 | United States of America | B2 | |
| EP1556805B1 | European Patent Office (EPO) | B1 | |
| AT521953T | Austria | T | |
| ATE521953T1 | Austria | T1 |
64 legal events, as 8 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent expired after termination of 20 yearsExpiredPE20 | PE20 | GB | |
| Opt-out of the competence of the unified patent court (upc) registeredP01 | P01 | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)REGISTERED BETWEEN 20210603 AND 20210609732E | 732E | GB | |
| Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)REGISTERED BETWEEN 20150827 AND 20150902732E | 732E | GB | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Notification of lapseLapsedST | ST | FR | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| No opposition filedOpposition26N | 26N | EP | |
| Patent lapsedLapsedMM4A | MM4A | IE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent ceasedCeasedPL | PL | CH | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Deletion acc. to par. 5 (withdrawal of the translation of the ep patent)MK05 | MK05 | AT | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Discontinued in the netherlands as no translation has been filedVDEP | VDEP | NL | |
| Dpma publication of mentioned ep patent grantGrantedR096 | R096 | DE | |
| European patents granted designating irelandGrantedFG4D | FG4D | IE | |
| European patent takes effect as a national patent in ch/liEP | EP | CH | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Supplementary search report drawn up and despatchedA4 | A4 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Request for extension of the european patent (deleted)DAX | DAX | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 1556805
- Application
- 37962362
Titles3
- German
- VERFOLGUNG EINER OBERFLÄCHE IN EINERDREIDIMENSIONALEN SZENE UNTER VERWENDUNG NATÜRLICHER VISUELLER MERKMALE DEROBERFLÄCHE
- English
- TRACKING A SURFACE IN A 3-DIMENSIONAL SCENE USING NATURAL VISUAL FEATURES OF THE SURFACE
- French
- LOCALISATION D'UNE SURFACE DANS UNE SCENE TRIDIMENSIONNELLE A L'AIDE DE CARACTERISTIQUES VISUELLES NATURELLES DE CETTE SURFACE
Classification
- CPC, 4
- G06T7/74
- G06T2207/10016
- G06T7/248
- G06V10/24
- IPC, 10
- G06F7 60
- G06F17 10
- G06F17 50
- G06G7 48
- G06T
- G06T7 00
- G06T7 20
- G06V10 24
- G09G5 00
- G06T15 00
Designated states27
- Contracting states, 27
- Austria
- Belgium
- Bulgaria
- Switzerland
- Cyprus
- Czechia
- Germany
- Denmark
- Estonia
- Spain
- Finland
- France
- United Kingdom
- Greece
- Hungary
- Ireland
- Italy
- Liechtenstein
- Luxembourg
- Monaco
- Netherlands (Kingdom of the)
- Portugal
- Romania
- Sweden
and 3 moreShow fewer
- Slovenia
- Slovakia
- Türkiye