Method and device for identifying an object in an image of a camera
Abstract
A mobile telephone (M) mixed into a pedestrian zone's section has an integrated camera available and a processor unit. Moving the camera at an angular range records and stores e.g. a pedestrian zone as an environment. A church tower (KT) and a flag (F) are detected e.g. as significant objects in recorded surroundings. A first position (x0,y0) is assigned to the church tower along with an Eberhard-type picture analysis method and a second position (x1,y1) is assigned to the flag along with a texture-based picture analysis method. An independent claim is also included for a radio communications terminal/mobile telephone with a camera and devices for carrying out the method of the present invention.

Term
Term ended
Projected expiry passed 16 December 2023, 2.8 years ago.
- Priority and filed
- Published
- Projected expiry
- Today
6 claims: 6 independent, 0 dependent
- 1A method for identification of an object in a camera image,recorded in the camera by an environment becomes,wherein recorded in the area or in a the recorded environment corresponding model objects are determined, each of which position information assigned and a specific image analysis method will,in which a current camera image recorded with the or modeled environment is compared,at the relative position of the current camera image determined on the recorded or modeled environment is, andin which, for identification of objects in the current camera image the image analysis method is used, the its assigned position in the recorded or modeled environment in accordance with the determined position the current camera image is closest. Verfahren zur Identifikation eines Objekts in einem Kamerabild, - bei dem durch eine Kamera eine Umgebung aufgezeichnet wird,- bei dem in der aufgezeichneten Umgebung oder in einem der aufgezeichneten Umgebung entsprechenden Modell Objekte bestimmt werden, denen jeweils Positionsinformationen und ein spezifisches Bildanalyseverfahren zugeordnet werden,- bei dem ein aktuelles Kamerabild mit der aufgezeichneten oder modellierten Umgebung verglichen wird,- bei dem die Position des aktuellen Kamerabildes bezogen auf die aufgezeichnete oder modellierte Umgebung ermittelt wird, und- bei dem zur Identifikation von Objekten im aktuellen Kamerabild das Bildanalyseverfahren verwendet wird, das seiner zugeordneten Position in der aufgezeichneten oder modellierten Umgebung entsprechend der ermittelten Position des aktuellen Kamerabildes am nächsten liegt.
- 2The method of claim 1, wherein upon a change the current camera image to select the image analysis method Updating position dependent and adaptive. Verfahren nach Anspruch 1, bei dem bei einer Veränderung des aktuellen Kamerabildes die Auswahl des Bildanalyseverfahrens positionsabhängig und adaptiv aktualisiert wird.
- 3A method according to claim 1 or 2, wherein the position-dependent associated image analysis method for detecting Characteristics of adjacent objects are dynamically adjusted. Verfahren nach Anspruch 1 oder 2, bei dem die positionsabhängig zugeordneten Bildanalyseverfahren zur Erkennung von Merkmalen benachbarter Objekte dynamisch angepasst werden.
- 4The method of claim 1, wherein the modeling of the Near undersampled objects are used. Verfahren nach Anspruch 1, bei dem zur Modellierung der Umgebung unterabgetastete Objekte verwendet werden.
- 5Method according to one of the preceding claims, thereby in that the camera image by a video or formed frame camera a radio communication terminal is and the object identification by means of a processor unit carried out of the radio communication terminal becomes. Verfahren nach einem der vorhergehenden Ansprüche, dadurch gekennzeichnet, dass das Kamerabild durch eine Video- oder Einzelbild-Kamera eines Funkkommunikationsendgeräts gebildet wird und die Objektidentifikation mit Hilfe einer Prozessoreinheit des Funkkommunikationsendgeräts durchgeführt wird.
- 6Funkkommunikationsendgerät mit Kamera mit Mitteln zur Durchführung des Verfahrens nach einem der Ansprüche 1 bis 5. Radio communication terminal with camera means for Carrying out the method according to any one of claims 1 to . 5
Independent claims6
24 paragraphs, as filed
The invention relates to a method for identifying a Object in a camera image.
The term "augmented reality application" are camera applications known in which, for example, text information or modeled artificial objects in a filmed real environment at respective associated real objects are also displayed. For display of additional Information in a current camera image, make the necessary objects associated with the real environment quickly and be reliably identified. known for this purpose are Methods of digital image processing used, the particularly in edge-based and texture-based image analysis methods are divided.
While the former designed for detection of edges of an object are, are the latter to detect a texture or a Pattern of the object optimized. For example, there is a Texture analysis using a Fourier analysis in the frequency domain. A reliable object detection and object identification is with the methods of conventional digital image processing only to ensure when used in each case Image analysis methods to the respective object-specific Features tuned.
For the simultaneous detection of a plurality of objects a recorded using a camera real environment has gained an image information from the environment and both are examined gradually as well as feature-dependent. Below then is a suitable image analysis methods selected for object recognition. Such investigation methods generally cause a high amount of calculation and for this reason commercial in a variety Camera applications not in use. This applies in particular For single or video cameras with wireless communication terminal, Augmented Reality applications include.
Conventional methods for augmented reality applications for this reason using predefined markers performed in a filmed or recorded around are installed. The image analysis methods used are tuned to geometric properties of the markers. This makes it possible that a picture information according to the specific Properties of the markers are analyzed. disadvantageous is the installation to be carried out only with great effort the marker.
In addition, the above image analysis methods must at a rapidly occurring change of the recorded Environment are initialized again, as in this case a product obtained result is falsified or lost.
It is therefore an object of the present invention, a fast to be implemented, reliable method for object identification specify.
This object is achieved by a method having the features of Patent claim 1. Advantageous developments are specified in the subclaims.
In the present process, for example by filmed camera motion an environment or recorded. In the recorded ambient significant objects determines which one hand respective position information and on the other hand to a suitable object identification Image analysis methods are specifically assigned.
If now at a later time, a section of the real Environment using the camera as the current camera image recorded, so the current image with the recorded is Environment compared.
With the help of a machine vision-based motion estimator, consisting of augmented reality gaming applications on wireless communication terminals is known, the position of the environment section is determined in the recorded environment. For the identification of objects of the environment section is the image analysis method used, which its associated Position in the recorded environment according to the determined Position the ambient cutout closest lies.
The inventive method thus increases the probability a faultless object identification, since the selected image identification method depending on position becomes.
By continuously comparing a once recorded Environment with the current camera images will be compared the prior art, saves computing time.
Fast camera movements or disruptions in the current camera image have in the selection of the object identification process not interfere, since the respective positioning is rapidly repeatable.
The inventive method is an identification security individual objects increases without markers having to place objects around.
The invention based on a drawing is closer explained.
Here 1 shows a section of a pedestrian street in the inner city Area as recorded environment. An unhidden in the section of the pedestrian area radio communication terminal M has an integrated camera and a processor unit. By moving the Camera in an angular range, the pedestrian environment as recorded and stored.
In the recorded ambient example be as significant objects a steeple KT and a flag F detected. The steeple KT is a first position x0, y0 and assigned an edge-based image analysis techniques, while the flag F to a second position x1, y1 and a texture-based Image analysis method is assigned.
Displays a current camera image after a few screen changes to the steeple KT, as the current image with the will recorded around compared. As the current position Camera image, with respect to the modeled environment x0 the first position y0 determined. Since this position x0, y0 is an edge-based image analysis methods associated is this selected and identification of the church tower KT used.
This is for example at a augmented reality application allows text or object information that the Steeple KT associated, fixed in the current camera image see the church tower KT.
Advantageously, in the selection of the image analysis method an environment likely considered. For the first Position x0, y0 and their surroundings is preferred an edge-based image analysis method for object recognition used, while for the second position x1, y1 and their surroundings preferably a texture-based image analysis methods used for object recognition or -Identification becomes. The feature analysis is thus on the respective image content optimally tuned.
Advantageously carried out a dynamic, adaptive adjustment of Image analysis method to the objects of the current camera image. This has the consequence that with a change of the camera image from the first position x0, y0 to the second position x1, y1, the image analysis of an edge-based analysis method gradually to a texture-based analysis method is changed and thus adaptively adjusted to the environment.
The relevant data for the positions x0, y0 above and x1, y1 and the respective associated image analysis method advantageously in a look-up table of the radio communication terminal stored and are thus available at any time quickly.
Above it was a current camera image with the recorded Environment compared. Alternatively, it is also possible one of the recorded environment appropriate model form and modeled the current camera Image compare environment. The environment might, for example, are modeled as mathematical model in three dimensions. For the Inventive process steps is thus in place of recorded around the replicated as a model environment used.
2 sheets
Sheet 1 Sheet 2
Every citation, both waysCites: the store holds 0 of 1
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US10580162B2 | Cited by | United States of America | Applicant |
| US10229511B2 | Cited by | United States of America | Applicant |
| EP3550516A1 | Cited by | European Patent Office (EPO) | Search report |
| WO2011047924A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US9218665B2 | Cited by | United States of America | Applicant |
| US10062169B2 | Cited by | United States of America | Applicant |
| US8837779B2 | Cited by | United States of America | Applicant |
| EP2219155A3 | Cited by | European Patent Office (EPO) | Search report |
| US10650546B2 | Cited by | United States of America | Applicant |
| WO2011047924A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US10739142B2 | Cited by | United States of America | Applicant |
| WO2009047335A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| WO2009047335A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US8942418B2 | Cited by | United States of America | Applicant |
| CN102667855A | Cited by | China | Search report |
| EP2219155A2 | Cited by | European Patent Office (EPO) | Search report |
2 priority claims, no other members on record
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 03029034 | European Patent Office (EPO) | A | |
| EP20030029034 | – | – | – |
29 legal events, as 4 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Gb: european patent ceased through non-payment of renewal feeCeasedGBPC | GBPC | EP | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Fee paymentPLFP | PLFP | FR | |
| Fee paymentPLFP | PLFP | FR | |
| Fee paymentPLFP | PLFP | FR | |
| No opposition filedOpposition26N | 26N | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Fr: translation filedET | ET | EP | |
| Corresponds to:REF | REF | EP | |
| Gb: translation of ep patent filed (gb section 77(6)(a)/1977)GBT | GBT | EP | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedNOT ENGLISHFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| Designation fees paidAKX | AKX | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 1544795
- Publication, DOCDB
- 1544795
- Publication, EPODOC
- EP1544795
- Application
- 3029034
- Application, DOCDB
- 03029034
- Application, EPODOC
- EP20030029034
Titles3
- German
- Verfahren und Gerät zur Identifikation eines Objektes in einem Kamerabild
- English
- Method and device for identifying an object in an image of a camera
- French
- Procédé et appareil pour identifier un objet dans une image d'une caméra
Classification
- CPC, 5
- G06K9/00671
- G06T7/75
- G06K9/72
- G06V20/20
- G06V10/768
- IPC, 3
- G06K9 00
- G06K9 72
- G06T7 00
Designated states31
- Contracting states, 27
- Austria
- Belgium
- Bulgaria
- Switzerland
- Cyprus
- Czechia
- Germany
- Denmark
- Estonia
- Spain
- Finland
- France
- United Kingdom
- Greece
- Hungary
- Ireland
- Italy
- Liechtenstein
- Luxembourg
- Monaco
- Netherlands (Kingdom of the)
- Portugal
- Romania
- Sweden
and 3 moreShow fewer
- Slovenia
- Slovakia
- Türkiye
- Extension states, 4
- Albania
- Lithuania
- Latvia
- North Macedonia