Motor vehicle including function actuation by eye tracking
Abstract
Kraftfahrzeug (1) umfassend Symbolflächen (3) mit jeweils einem eine kfzseitig ausführbare Funktion darstellenden Symbol im Sichtbereich des Fahrers, eine Einrichtung (5) zur Erfassung der Blickrichtung des Fahrers (2) bezüglich der Symbolflächen, zur Bestimmung einer betrachteten Symbolfläche (3) und zur Auslösung der einer Symbolfläche (3) zugeordneten Funktion in Abhängigkeit des Erfassungsergebnisses sowie eine Bestätigungseinrichtung (4) für die Blickauswahl, wobei wenigstens eine Symbolfläche (3) als unveränderbares festes Symbol mit einer fest zugeordneten Funktion und wenigstens eine weitere Symbolfläche (3) als variables Symbol mit jeweils wenigstens einer variabel zugeordneten Funktion ausgebildet ist.

Term
Term ended
Projected expiry passed 21 January 2025, 1.7 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
9 claims: 7 independent, 2 dependent
- 1Kraftfahrzeug umfassend Symbolflächen mit jeweils einem eine kfz-seitig ausführbare Funktion darstellenden Symbol im Sichtbereich des Fahrers, eine Einrichtung zur Erfassung der Blickrichtung des Fahrers bezüglich der Symbolflächen, zur Bestimmung einer betrachteten Symbolfläche und zur Auslösung der einer Symbolfläche zugeordneten Funktion in Abhängigkeit des Erfassungsergebnisses sowie eine Bestätigungseinrichtung für die Blickauswahl, dadurch gekennzeichnet, dass wenigstens eine Symbolfläche (3) als unveränderbares festes Symbol mit einer fest zugeordneten Funktion und wenigstens eine weitere Symbolfläche (3) als variables Symbol mit jeweils wenigstens einer variabel zugeordneten Funktion ausgebildet ist.
- 2Kraftfahrzeug nach Anspruch 1, dadurch gekennzeichnet, dass wenigstens eine der der einen oder den mehreren Symbolflächen (3) zugeordneten Funktionen eine Fahrerassistenzfunktion ist und/oder dass wenigstens eine der der einen oder den mehreren Symbolflächen (3) zugeordneten Funktionen eine Komfortfunktion, insbesondere Radio und/oder CD und/oder Kassette und/oder DVD und/oder Navigation und/oder Info und/oder Telefon und/oder E-Mail und/oder Internet, ist.
- 3Kraftfahrzeug nach Anspruch 1 oder 2, dadurch gekennzeichnet, dass die wenigstens eine als variables Symbol ausgebildete Symbolfläche (8) Teil eines Displays, insbesondere eines Head-Up-Displays oder eines Flüssigkristalldisplays, ist.
- 4Kraftfahrzeug nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, dass die Bestätigungseinrichtung (4) für die Blickauswahl als Taster und/oder als Rändelrad und/oder als Schieber und/oder als Drehknopf ausgebildet ist, wobei durch Betätigung der Bestätigungseinrichtung (4) zwischen verschiedenen Symbolflächen (3) zwecks Auswahlkorrektur und/oder innerhalb einer Symbolfläche (3) zwecks Feinabstimmung der Auswahl navigiert werden kann.
- 5Kraftfahrzeug nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, dass die Einrichtung (5) zur optischen Hervorhebung der im Rahmen der Erfassung der Blickrichtung des Fahrers bestimmten Symbolfläche (3), insbesondere durch einen Rahmen und/oder einen Schatten und/oder eine Farbänderung und/oder ein Aufblinken der Symbolfläche (3), ausgebildet ist.
- 6Kraftfahrzeug nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, dass die Einrichtung (5) zur akustischen Information des Fahrers bei einer im Rahmen der Erfassung der Blickrichtung bestimmten Symbolfläche (3), insbesondere durch einen Signalton und/oder eine Sprachausgabe, ausgebildet ist.
- 7Kraftfahrzeug nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, dass wenigstens eine Symbolfläche (3) zur alternativen manuellen Auswahl als Stellelement ausgebildet ist, bei dessen Betätigung eine zugeordnete Funktion direkt ausgelöst wird.
- 8Kraftfahrzeug nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, dass wenigstens eine Symbolfläche (3) an der A-Säule und/oder der Schalttafeloberkante und/oder der Windschutzscheibe und/oder der Motorhaube lokalisiert ist.
- 9Kraftfahrzeug nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, dass die Einrichtung (5) wenigstens zwei Kameras (6) und/oder eine Speichereinheit zur Ablage möglicher zur Erfassung und Bestimmung der Blickrichtung erforderlicher Daten und/oder Algorithmen und/oder eine Recheneinheit zur Durchführung möglicher im Rahmen der Erfassung und Bestimmung erforderlicher Berechnungen umfasst.
Independent claims9
17 paragraphs, as filed
The invention relates to a motor vehicle comprising symbol faces each a one-sided fcc executable function representative symbol or the like in view of the driver, a device for detecting the the driver's viewing direction with respect to the symbol space to determine a considered symbol surface and to trigger a symbol surface assigned function depending on the detection result and confirming means for the view selection.
In recent motor vehicles there for triggering fcc-side functions for a conventional control elements that detect the driver with his look shall, before it is possible to bring the hand or a finger trigger by pressing or turning movement a function. These Adjusting elements must be positioned in the immediate reach of the driver, yet their hands from the steering wheel for a time. On the other hand contact lately more and more concepts by which on a View selection is based. z It is especially in displays. B. on cameras the driver's line of sight detected, a considered symbol surface with an illustrated symbol determined and after a confirmation assigned function triggered. Such shown on a display Symbol is variable, can according to the assigned functions vary. These two concepts of function triggering exist previously in parallel, in conventional actuators through the necessary exit the steering wheel position, the restriction in the arrangement of the actuating element in drivers reach and the large time requirement between function desired and function triggering restrictions ease of use and the operational safety are given.
The invention is thus based on the object, a motor vehicle with specify abovementioned characteristics, in which an improved function selection and -auslösung is possible.
To achieve this object is in a motor vehicle of the aforementioned Type according to the invention provided that at least one symbol field as unchangeable solid icon with a dedicated function and at least one other symbol surface as variable symbol with each is formed at least one variable associated function.
The term "symbol" is to be understood in the broadest sense; are meant z. B. pictograms, images, text images, graphics o. ä., and mixed forms image and text etc.
The driver has therefore in the motor vehicle according to the invention not only as usual in view selection systems, a variable symbol with a variable assigned function available, but in addition there are also least an unchangeable fixed symbol, the assigned function fixed is. So there is both functional "hard keys" and "soft keys". These concepts previously treated differently are now in the present invention Motor vehicle in a concept to view selection and subsequent Shutter function together. The restriction in Safety and comfort, which may in conventional actuators are, can thus be avoided. A symbol surface with an unchangeable fixed symbol and a dedicated function should no longer The driver's reach to be positioned, whereby larger vehicle areas than previously available for icon space. Still Remember the benefits of a fixed function assignment, namely that the position often for use of solid features is learned by habit and then almost "automatic" is available, obtain. The function selection and -auslösung same way for both fixed and variable symbols, so that Greater consistency is given.
In a first embodiment of the invention it is provided that at least one of the one or more functions associated icon surfaces a driver assistance function, and / or that at least one of the one or more functions associated with a symbol surfaces Comfort function, in particular radio and / or CD and / or cassette and / or DVD and / or navigation and / or information and / or telephone and / or E-mail and / or Internet. It should be noted that so far in front of especially the so-called comfort functions, in particular from the infotainment area, realized as "hard keys" in the form of conventional control elements are. Since it is precisely the information and entertainment area in motor vehicles will become even more important in future, z. B. in a increased Internet usage for obtaining information about the Weather or traffic conditions, it is particularly important to the security benefits a function selection to use in my view. In connection with driver assistance functions, which usually complex Information shall be collected, the time savings can be achieved by View selection be important. When the function selection for driver assistance functions and carried convenience functions in the same manner, provides this is a significant relief is for the driver, who is no longer must notice how a certain function is to be selected. Correspondingly it is expedient if the motor vehicle to the invention allows, if possible to determine many features per view choices, since the driver at such standardized operation used and therefore the Security quickly is increased.
Furthermore, it is provided in the motor vehicle according to the invention that the at least one trained as a variable symbol symbol surface part a display, in particular a head-up display or a liquid crystal display, is. It is particularly expedient to motor vehicle existing displays, for. example, for a navigation system to use. Such existing displays are today usually liquid crystal displays, For example, in conjunction with a DVD player. Head-up displays, in which a projection of the image on the windshield takes place, have the advantage that the driver's eyes from the road must turn away. This is a particularly convenient and safe operation guaranteed. Other display types are of course also for display the variable symbols suitable.
In one embodiment of the motor vehicle according to the invention is provided, that the confirmation means for the view selection as a button formed and / or as a knurled wheel and / or a slider and / or as a rotary knob , where between by pressing the confirmation means different symbol spaces for the selection correction and / or within be a symbol surface navigated for fine tuning of the selection can. On Approval means accidental firing a function prevents. The confirmation means should be centered, for example, be arranged on the steering wheel, so that the driver's hand does not must be removed from the steering wheel. For a button, for example, by a short press a recognized selection be confirmed over a long or repeatedly pressing a selection correction possible. A similar Operation is via the rotating or moving at a thumbwheel, Slider or knob possible. In an analogous manner, the confirmation means be used for fine tuning of the selection, if the higher-level function has been detected. Thus, over the Turning a knob different channels can be selected at the radio, Repeatedly pressing a button allows the selection of an appropriate CD with that number in the CD changer or the position of a Slider indicates the selected functionality of a driver assistance system. The focus is in the confirmation means a possible simple and intuitive operation. Since only the position of a verification device must be remembered, it is not necessary in most cases be that the driver to avert his eyes from the road.
Suitably, the invention provides that the device for optical highlighting in response to the detection of visual axis the driver specific symbol surface, in particular by a frame and / or a shadow and / or a color change and / or a blinking the symbol surface is formed. In this manner, the Driver recognize his selection directly. The confirmation may without further Delay directly connected to this optical highlight will. The way the visual highlighting can to the significance or importance of the associated function to be adjusted, For example, turning on the radio can rather "unremarkable" highlighted , while setting the indicator is used or the setting a driver assistance system should be clearly emphasized, z. B. by using appropriate warning colors or flashing with changing time intervals. As solid symbols trained Symbol surfaces surrounded able z. B. are backlit or having a bright-line frame be, with a flash of the light elements in alternating colors is possible. With variable symbols z. B. display allows the presentation oversight. Color shades, shadows, frames or alterations the symbol z. B. by supplementing the text "selection" or by supplementing graphical components are possible.
In addition, the device to audibly inform the driver at a certain frame in the visual axis detecting symbol surface, , Formed in particular by an acoustic signal and / or a voice output be. Here, a short constant beep signal, that ever a selection has taken place, while characteristic, possible easy to learn beeps or melodies for certain functions can stand. By a voice to let ambiguities Avoid, also, the driver can directly to the consequences of a function selection or on different options as part of a fine-tuning be pointed.
An embodiment of the invention provides that at least one symbol field is designed for alternative manual selection as an adjusting element, when operated an assigned function is triggered directly. This may be beneficial in some situations, for example if the same another symbol field will be selected via a selection view should. Such simultaneous selection is not possible only with a view selection. Especially has the alternative manual selection for drivers who can not take the View selection are used, the advantage that a slow gradual is familiarization possible without the current ease of use and security are limited.
Furthermore it can be provided that at least one symbol on the surface A-column and / or the control panel upper edge and / or the windshield is located and / or the hood. In this way used vehicle surfaces that are not in the direct grip of the driver There are therefore far hardly is functional. This offers considerable Benefits, as the number of functions implemented in modern vehicles will continue to increase in the near future. By symbol faces in these areas not previously used is also in solid icons a further differentiation possible.
Finally, in one embodiment of the invention it is provided that the Means at least two cameras and / or a memory unit for Storage potential for detecting and determining the line of sight required Data and / or algorithms and / or an arithmetic unit for carrying out possible within the framework of detection and determination required includes calculations. can By using multiple cameras Error in the detection of the viewing direction are minimized. This fact a function can be triggered, is an analysis and evaluation the line of sight is required, such as a comparison with a stored "Map" of the driver's sight range. Under certain circumstances, are also certain calculations required, including control calculations may include verification of eye tracking etc.. to Simplification, it is expedient, both the cameras as well as a possible Storage and calculation unit in the central device for recording the line of sight, to determine an observed symbol surface and Triggering the associated function to be integrated.
Further advantages, features and details of the invention will be made the embodiments described hereinafter and with reference to the Drawings. They show:<dl tsize="6"><dt>Fig. 1</dt><dd>a schematic diagram of a motor vehicle according to the invention, and</dd><dt>FIG. 2</dt><dd>a sketch of the driver of an inventive visual range Motor vehicle.</dd></dl>
FIG. 1 shows a schematic diagram of a motor vehicle according to the invention 1. In view of the driver 2 are different symbol faces 3, of which at least one fixed symbol or the like as immutable with a dedicated function and at least one more than variable symbol with at least one respective variable associated function is trained. In addition, the confirmation means 4 is in the grip area the driver displayed. The device 5 is for detecting the line of sight of the driver with respect to the symbol surfaces 3, for determining a considered symbol surface 3 and to trigger an icon area 3 assigned function depending on the detection result formed. So here come together the various data, for example, Data from the cameras 6 which are part of the device 5, data confirmation means, the 4 provides, as well as in the device 5 stored data. The device 5 may further include a calculation unit configured to Comparing the detected line of sight with a stored "map" of the Visual range of the driver 2 is necessary, but also control calculations can perform to potential errors in determining the direction of view to minimize. The device 5 then triggers the respective selected solid or variable function, here represented by an arrow P. In addition, are speakers 7, which likewise again part of the device 5 are, and the acoustic driver 2 information about an under the detection of visual axis are certain symbol surface. About the Speakers 7 may tones, melodies or even complete sentences or Texts are displayed, it is equally conceivable that the driver between can choose these different acoustic information types. The acoustic Information, an optical highlighting the symbol faces 3 support. Like the visual emphasis can the current customized driving situation and the importance of the selected function be.
Fig. 2 shows a sketch of the driver of a visual range according to the invention Motor vehicle 1 is. On the top panel are as variable Symbols Symbol trained surfaces 8 shown. located along the A-pillar is designed as a solid icons Icon surfaces 9. The as unchangeable solid symbols formed symbol faces 9 are here Supplementary features is, in this case can firmly frequently used information and Entertainment functions are selected. Since these areas are not in the immediate reach of the driver are, they are in conventional motor vehicles usually not functionally occupied. The symbol surfaces with solid Symbols 9 are practically "hard keys", for example, a fixed backlit may include labeling, in which case a view selection highlighted by a flashing or changing the background color can be. Alternatively or additionally, an optical Highlighting by flashing or color changes of the symbol surface 9 surrounding frame or another luminescent area on or near the symbol surface 9 z. B. in circular or rectangular shape can be achieved. The Symbol faces 8 with variable associated features can be part of his displays, in the case, for example, a liquid crystal display shown. Symbol surfaces with variable symbols 8 can contribute to visual highlighting flash in view selection, change the color, with a shade be provided or pictograms, texts like "choice" or the like be supplemented. Similarly, an inversion of the foreground and Background colors o. Ä. Possible. Moreover, the confirmation means 4 shown for the view selection, here in the form of a thumbwheel or knob, the course can act as a switch in parallel. The driver 2 looks in the case shown on the fixed telephone icon to confirm the Selection could blink, while through the speakers 7 can be carried out a sound or voice, for example, the word "Telephone" is announced or the driver may be requested to provide a to choose number. On the icon faces 8 with variable symbols and Functions can be displayed in accordance with paragraphs and view selection or the confirmation means 4 be selected. The driver can thus z. B. easily make calls without removing a hand from the steering wheel having to take or his eyes completely from the street events. The safety and ease of use are increased. Fixed and variable Functions can be selected in the context of a coherent approach and be triggered.
2 sheets
Sheet 1 Sheet 2
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| WO2015090485A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| DE102014002493B4 | Cited by | Germany | Search report |
| DE102014222752A1 | Cited by | Germany | Search report |
| CN101876752A | Cited by | China | Search report |
| WO2015039746A1 | Cited by | World Intellectual Property Organization (WIPO) | Applicant |
| DE102013015204A1 | Cited by | Germany | Applicant |
| DE102012006966A1 | Cited by | Germany | Applicant |
| US10162411B2 | Cited by | United States of America | Applicant |
| DE102012212217B4 | Cited by | Germany | Search report |
| US2015232033A1 | Cited by | United States of America | Pre-grant |
| DE102013015634A1 | Cited by | Germany | Search report |
| DE102013021929A1 | Cited by | Germany | Search report |
| DE102013021929B4 | Cited by | Germany | Applicant |
| WO2009049975A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| DE102013015634B4 | Cited by | Germany | Search report |
| US9835861B2 | Cited by | United States of America | Applicant |
| DE102013015204A1 | Cited by | Germany | Search report |
| EP3001289A4 | Cited by | European Patent Office (EPO) | Search report |
| DE102013218917A1 | Cited by | Germany | Search report |
| US9626072B2 | Cited by | United States of America | Applicant |
| DE102013022035A1 | Cited by | Germany | Search report |
| DE102013003059A1 | Cited by | Germany | Search report |
| DE102024117123A1 | Cited by | Germany | Search report |
| DE102013022035A1 | Cited by | Germany | Applicant |
| WO2014072827A2 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| DE102013015204B4 | Cited by | Germany | Search report |
| WO2014033042A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| DE102013015205B3 | Cited by | Germany | Search report |
| US9703375B2 | Cited by | United States of America | Applicant |
| DE102013015634A1 | Cited by | Germany | Applicant |
| WO2022089696A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US10248193B2 | Cited by | United States of America | Applicant |
| DE102013003059A1 | Cited by | Germany | Applicant |
| WO2014072827A3 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US9446716B2 | Cited by | United States of America | Search report |
| DE102013022035B4 | Cited by | Germany | Search report |
| US9835861B2 | Cited by | United States of America | Applicant |
| US11436847B2 | Cited by | United States of America | Search report |
| DE102013021929A1 | Cited by | Germany | Applicant |
| US10481757B2 | Cited by | United States of America | Applicant |
| DE10121392A1 | Cites | Germany | Search report |
| EP1123842A2 | Cites | European Patent Office (EPO) | Search report |
| DE19807410A1 | Cites | Germany | Search report |
| US4827520A | Cites | United States of America | Search report |
6 members in 2 offices
Priority claims5
| Document | Office | Kind | Date |
|---|---|---|---|
| 102004005816 | Germany | A | |
| 102004005816 | Germany | A | |
| 102004005816 | Germany | – | |
| 102004005816 | – | – | – |
| DE20041005816 | – | – | – |
Members6
| Document | Office | Kind | |
|---|---|---|---|
| EP1562102A2This record | European Patent Office (EPO) | A2 | |
| DE102004005816A1 | Germany | A1 | |
| EP1562102A3 | European Patent Office (EPO) | A3 | |
| DE102004005816B4 | Germany | B4 | |
| EP1562102B1 | European Patent Office (EPO) | B1 | |
| DE502005003259D1 | Germany | D1 |
34 legal events, as 4 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| Opt-out of the competence of the unified patent court (upc) registeredP01 | P01 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Gb: european patent ceased through non-payment of renewal feeCeasedGBPC | GBPC | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Fee paymentPLFP | PLFP | FR | |
| Fee paymentPLFP | PLFP | FR | |
| Fee paymentPLFP | PLFP | FR | |
| No opposition filedOpposition26N | 26N | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Fr: translation filedET | ET | EP | |
| Corresponds to:REF | REF | EP | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedNOT ENGLISHFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| Designation fees paidAKX | AKX | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 1562102
- Publication, DOCDB
- 1562102
- Publication, EPODOC
- EP1562102
- Application
- 5001161
- Application, DOCDB
- 05001161
- Application, EPODOC
- EP20050001161
Titles3
- German
- Kraftfahrzeug mit Funktionsauslösung durch Blickauswahl
- English
- Motor vehicle including function actuation by eye tracking
- French
- Automobile à actuation de fonctions par détection de mouvements oculaires
Classification
- CPC, 5
- B60K35/10
- G01C21/3664
- G06F3/013
- B60K2360/149
- B60K2360/21
- IPC, 3
- G06F3 00
- B60K35 10
- G06F3 01
Designated states2
- Contracting states, 1
- Türkiye
- Extension states, 1
- Yugoslavia, later Serbia and Montenegro (until 2006)