Method and apparatus for image-based photorealistic 3D face modeling
Abstract
An apparatus and method for image-based 3D photorealistic head modeling are provided. The method for creating a 3D photorealistic head model includes: detecting frontal and profile features in input frontal and profile images; generating a 3D head model by fitting a 3D genetic model using the detected facial features; generating a realistic texture from the input frontal and profile images; and mapping the texture onto the 3D head model. In the apparatus and method, data obtained using a relatively cheap device, such as a digital camera, can be processed in an automated manner, and satisfactory results can be obtained even from imperfect input data. In other words, facial features can be extracted in an automated manner, and a robust "human-quality" face analysis algorithm is used.

Term
Term ended
Projected expiry passed 27 August 2024, 2.1 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
1 sheet
Sheet 1
Every citation, both waysCites: the store holds 1 of 2
| Document | Relation | Office | Category | Cited during | Relevant claims |
|---|---|---|---|---|---|
| WO0217234A1 | Cites | World Intellectual Property Organization (WIPO) | Y | Search report | 3,34 |
| SARRIS N ET AL: "BUILDING THREE DIMENSIONAL HEAD MODELS", GRAPHICAL MODELS, ELSEVIER, SAN DIEGO, CA, US, vol. 63, no. 5, September 2001 (2001-09-01), pages 333 - 368, XP001085516, ISSN: 1524-0703 | Non-patent | – | – | Search report | – |
| MING-SHING SU ET AL: "An automatic construction of a person's face model from the person's two orthogonal views", GEOMETRIC MODELING AND PROCESSING, 2002. PROCEEDINGS 10-12 JULY 2002, PISCATAWAY, NJ, USA,IEEE, 10 July 2002 (2002-07-10), pages 179 - 186, XP010599553, ISBN: 0-7695-1674-2 | Non-patent | – | – | Search report | – |
| IN KYU PARK ET AL: "Image-based photorealistic 3-D face modeling", PROCEEDINGS. SIXTH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION IEEE COMPUT. SOC LOS ALAMITOS, CA, USA, 2004, pages 49 - 54, XP007900798, ISBN: 0-7695-2122-3 | Non-patent | – | – | Search report | – |
| CHEN LING ET AL: "Using stereo camera system to realize realistic video avatar in virtual environment", SIGNAL PROCESSING, 2002 6TH INTERNATIONAL CONFERENCE ON AUG. 26-30, 2002, PISCATAWAY, NJ, USA,IEEE, vol. 1, 26 August 2002 (2002-08-26), pages 707 - 710, XP010628086, ISBN: 0-7803-7488-6 | Non-patent | – | – | Search report | – |
| SINGH S ET AL: "Monitoring driver fatigue using facial analysis techniques", INTELLIGENT TRANSPORTATION SYSTEMS, 1999. PROCEEDINGS. 1999 IEEE/IEEJ/JSAI INTERNATIONAL CONFERENCE ON TOKYO, JAPAN 5-8 OCT. 1999, PISCATAWAY, NJ, USA,IEEE, US, 5 October 1999 (1999-10-05), pages 314 - 318, XP010369866, ISBN: 0-7803-4975-X | Non-patent | – | – | Search report | – |
12 members in 6 offices
Priority claims10
| Document | Office | Kind | Date |
|---|---|---|---|
| 498695P | United States of America | – | |
| 49869503 | United States of America | P | |
| 49869503 | United States of America | P | |
| 20040064323 | Republic of Korea | A | |
| 20040064323 | Republic of Korea | A | |
| 2004064323 | Republic of Korea | – | |
| 2004064323 | – | – | – |
| 498695P | – | – | – |
| KR20040064323 | – | – | – |
| US20030498695P | – | – | – |
Members12
| Document | Office | Kind | |
|---|---|---|---|
| EP1510973A2 | European Patent Office (EPO) | A2 | |
| KR20050022306A | Republic of Korea | A | |
| JP2005078646A | Japan | A | |
| US2005063582A1 | United States of America | A1 | |
| CN1607551A | China | A | |
| RU2004126185A | Russian Federation | A | |
| EP1510973A3This record | European Patent Office (EPO) | A3 | |
| KR100682889B1 | Republic of Korea | B1 | |
| CN100345165C | China | C | |
| RU2358319C2 | Russian Federation | C2 | |
| US7835568B2 | United States of America | B2 | |
| JP4723834B2 | Japan | B2 |
16 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Application refused18R | 18R | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: THE APPLICATION HAS BEEN REFUSEDSTAA | STAA | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | |
| Designation fees paidAKX | AKX | |
| First examination report despatched17Q | 17Q | |
| Request for examination filed17P | 17P | |
| Designated contracting statesAK | AK | |
| Request for extension of the european patentAX | AX | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | |
| Information on inventor provided before grant (corrected)RIN1 | RIN1 | |
| Information on inventor provided before grant (corrected)RIN1 | RIN1 | |
| Information on inventor provided before grant (corrected)RIN1 | RIN1 | |
| Information on inventor provided before grant (corrected)RIN1 | RIN1 | |
| Designated contracting statesAK | AK | |
| Request for extension of the european patentAX | AX | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI |
Numbers
- Publication
- 1510973
- Publication, DOCDB
- 1510973
- Publication, EPODOC
- EP1510973
- Application
- 4255190
- Application, DOCDB
- 04255190
- Application, EPODOC
- EP20040255190
Titles3
- German
- Verfahren und Gerät zur bildbasierten fotorealistischen 3D Gesichtsmodellierung
- English
- Method and apparatus for image-based photorealistic 3D face modeling
- French
- Procédé et dispositif de modélisation tridimensionnelle photoréaliste de visage basée sur des images
Classification
- CPC, 2
- G06T17/10
- G06T2200/08
- IPC, 6
- G06T17 00
- G06T1 00
- G06T15 00
- G06T15 04
- G06T17 10
- G06T19 00
Designated states2
- Contracting states, 1
- Türkiye
- Extension states, 1
- North Macedonia