Method and device for estimating workload for a driver of a vehicle
14 claims: 6 independent, 8 dependent
- 1Method for estimating workload for a driver of a vehicle comprising the following method steps:- identifying a demanding event from a signal indicative of a task requiring driver attention, said demanding event occurring between a demanding event starting point and a demanding event end point in time, and - generating a high workload output signal under said demanding event, characterised in that the method includes the further steps of: - generating a workload delay time frame which extends a period in time from said demanding event end point in time until a workload delay end point in time, and - maintaining a high workload output signal under said workload delay time frame.
- 6Method according to any of the preceding claims, characterised in that at least two different tasks has different periods of duration of the workload delay time frame.
- 7Method according to any of the preceding claims, characterised in that the method includes the further step of:- inhibiting access to incoming calls and/or sms messages and/or internally generated messages for a period of time in the event a high workload signal is present at reception of the incoming call, sms message or internally generated message.
- 8Workload estimator comprising:- means for identifying a demanding event from a signal indicative of a task requiring driver attention, said demanding event occurring between a demanding event starting point and a demanding event end point in time, and - means for generating a high workload output signal under said demanding event, characterised in that the workload estimator further includes: - means for generating a workload delay time frame which extends a period in time from said demanding event end point in time until a workload delay end point in time, and - means for maintaining a high workload output signal under said workload delay time frame.
- 14Workload estimator according to any of claims 8-13, characterised in that the workload estimator further includes means for inhibiting access to incoming calls and/or sms messages and/or internally generated messages for a period of time in the event a high workload signal is present at reception of the incoming call, sms message or internally generated message.
Independent claims6
73 paragraphs in 5 sections, as filed
TECHNICAL FIELD
0001The invention relates to a method for estimating workload for a driver of a vehicle according to the preamble of claim 1. The invention further relates a workload estimator according to the preamble of claim 8.
BACKGROUND ART
0002Workload is defined as the portion of a driver's limited capacity which is required to handle a specific traffic scenario. Workload depends on situation demand and also on driver characteristics. The driver characteristics include slowly changing variables such as age and driving skills, temporary driver state such as fatigue, alcohol influence and emotional state and further invariable characteristics such as talent for driving. Workload is thus a subjective measure of the load on a specific driver. Situation demand, that is the objective load on the driver, includes primary task demand, that is demand related to driving and secondary task demand, which is tasks that are not related to driving. Examples of primary task demand can be gear change, acceleration, braking, steering wheel control etcetera, that is all tasks that are related to driving for handling different traffic situations such as negotiation of intersections and turns, overtaking, avoiding obstacles etc. Examples of secondary task demand can be handling of cellular phones, handling of infotainment systems, handling of climate control, handling of vehicle seat position etcetera.
0003Workload estimators in the context of the description can be used to both estimate workload and demand.
0004Workload estimation is normally used in workload management systems where a workload estimator provides information about whether the driver is considered to be under high workload or not. In the event the estimator concludes that the driver is under high workload an information system temporary blocks or reschedules information to be presented to the driver if temporary blocking or rescheduling is allowed for the type of information to be presented. Normally such temporary blocking and rescheduling can be allowed unless the information relates to safety related messages.
0005Workload estimation is a well established technology. For a more general presentation refer to the reports of the EC projects Generic Intelligent Driving Support; Michon 1993 and Centralised management of Vocal Interfaces; 1999.
0006Normally workload is estimated on the basis of performance related measures, i.e. the demand of an actual traffic situation. The performance related measures can be estimated from information relating to driving related tasks and non-driving related tasks.
0007For examples of demand based workload estimation systems references are given to Bellet, T. et al. 2002. "Real-time" Analysis of the Driving Situation in Order to Manage On-board Information. <i>e-Safety Conference Proceedings,</i> Lyon.
0008Secondary task demand, that is distraction related tasks, can be estimated by recording in vehicle system operation or by means of eye- and head movement tracking, see for instance "Integrated Safety System", Delphi 2001, exhibited at Frankfurt motor show 2001.
0009A workload management system using estimation of demand from driving related tasks and distraction related tasks is given in SE 515699. In the event the workload estimator detects a demanding event a high workload output signal is generated. The high workload signal is received by an information filter, which in is set to block out information messages for a predetermined period of time, regardless of what happens during this period of time. Since the period is predetermined and set from the start of an event generating a high workload condition for the driver, the information filter does not adapt well to real life traffic situations where the high workload remains under different time spans for different situations.
DISCLOSURE OF INVENTION
0010Short time scale demanding scenarios may be described in terms of a hierarchy of events, situations and driving environments. These terms are defined as follow: <ol id="ol0001" compact="compact" ol-style=""><li>1. Event A short time scale change in demand. This may be related to changes in the vehicle dynamic state (e.g. accelerations or turns) or in vehicle operations requiring attentional demand.</li><li>2. Situation A cluster of events. For example, manoeuvring through an intersection may consist of a deceleration, a short stop and a turn. A parking situation may consist of several turns and reversals, and operating a radio generally involves several consecutive button presses and/or knob turns.</li><li>3. Environment A cluster of situations. For example, inner city driving may involve sequences of intersections, roundabouts and parking situations.</li></ol>
0011At each level, the periods between the events, situations or environments are referred to as gaps.
0012It is an object of the invention to provide an improved workload estimator, which is able to maintain a high workload output signal under a traffic situation constituted by a cluster of events. It is furthermore an object of the invention to provide a workload estimator which allows high workload to remain under different time spans for different situations These objects are achieved by a method for estimating workload according to the characterising portion of claim 1. The objects are furthermore achieved by a workload estimator according to the characterising portion of claim 8.
0013The invention makes use of a workload delay time frame, which extends a period in time from end point in time of a demanding event until a workload delay end point in time. A high workload output signal generated under the demanding event is maintained under the workload delay time frame. The workload delay time frame will make sure that a high workload output signal will remain under a situation including a cluster of demanding events each generating a high workload output signal.
0014By use of the method for estimating workload according to the invention and a workload estimator according to the invention together with a workload delay of adequate length, that is 0.1 - 20 s, preferably 2 - 15 s and yet more preferred 3 - 7 s, the workload estimate will more precisely correspond to the actual workload experienced by a driver.
BRIEF DESCRIPTION OF DRAWINGS
0015The invention will be described in further detail with references to drawings, where: <dl id="dl0001"><dt>fig. 1</dt><dd>shows a workload manager using a workload estimator according to the invention,</dd><dt>fig. 2</dt><dd>shows an illustration of conditional rules for workload computation including a workload delay period,</dd><dt>fig. 3</dt><dd>shows a CAN bus giving access to signals indicative of tasks requiring driver attention,</dd><dt>fig. 4</dt><dd>shows an example of a hierarchical taxonomy for describing demanding driving scenarios,</dd><dt>fig. 5</dt><dd>shows a flow chart for a method for estimating work load according to the invention,</dd><dt>fig. 6</dt><dd>shows an embodiment of a workload estimator according to the invention,</dd><dt>fig.7</dt><dd>shows a flow chart for a method for estimating work load according to an embodiment of the invention,</dd><dt>fig.8</dt><dd>shows a flow chart for a method for handling an incoming call or a sms message according to an embodiment of the invention, and</dd><dt>fig. 9</dt><dd>shows a vehicle on board arrangement for handling an incoming call or a sms message according to an embodiment of the invention.</dd></dl>
DETAILED DESCRIPTION OF THE INVENTION
0016In figure 1 a schematic drawing of a workload manager 1 is shown. The workload manager includes a workload estimator 2 and an information filter 3. The workload estimator 2 receives information regarding tasks requiring driver attention. The information is provided as an input signal 4. The input signal can be of different types including physiological indicators such as heart rate sensors or eye movement indicators, see for instance "Assessment of cardiovascular reactivity by means of spectral analysis", Mulder, L. J. M., PhD thesis, Rijksuniveristetet Groningen, Groningen 1988 or "Automatic Driver Visual Behaviour Measurement", Victor, T., Blomberg, O. And Zelinsky, Vision in vehicles 9, Elsevier Science B.V. Other alternatives for signals that may be used are road map information and information from external sensors such as radar etc.
0017Preferably the input signal is based on performance related measures which are estimated from information relating to primary task demand and secondary task demand.
0018The following input signals 4 may be used as a basis for estimation if a demanding event is present: <ol id="ol0002" compact="compact" ol-style=""><li>1. Acceleration The vehicle acceleration is obtainable from the vehicle speed signal which is available on a vehicle multiplex system, such as a CAN bus. The signal can also be retrieved from an acceleration sensor.</li><li>2. Steering angle The steering angle is recorded by a steering angle sensor provided in the steering system. The signal is available on the multiplex system, such as the CAN bus.</li><li>3. Steering angle velocity The steering angle velocity can be calculated from the steering angle. Preferably the steering angle velocity is obtained from differentiating a filtered steering angle signal.</li><li>4. Lateral acceleration the lateral acceleration is recorded by a sensor. The signal is available on the multiplex system, such as the CAN bus.</li><li>5. Brake pressure It is possible to use either only the binary signal of existence of brake pressure or a signal corresponding to the magnitude of the brake pressure. The signal is available on the multiplex system, such as the CAN bus.</li><li>6. Turn indicator Information regarding use of the turn indicator is available on the multiplex system, such as the CAN bus.</li><li>7. Gear position Information regarding gear position and or change of gear position is available on the multiplex system, such as the CAN bus.</li><li>8. Vehicle navigation system activity buttons. Information regarding use of control buttons of the Vehicle navigation system is available on the multiplex system, such as the CAN bus.</li><li>9. Infotainment buttons Information regarding use of infotainment control buttons, such as phone buttons or audio control buttons is available on the multiplex system, such as the CAN bus.</li><li>10. Mirror control buttons Information regarding use of mirror control buttons is available on the multiplex system, such as the CAN bus.</li><li>11. Window control buttons Information regarding use of window control buttons is available on the multiplex system, such as the CAN bus.</li><li>12. Seat control buttons Information regarding use of seat control buttons is available on the multiplex system, such as the CAN bus.</li></ol>
0019Further input signals may be used, for instance control buttons for infotainment systems of the vehicle.
0020In different embodiments of the invention, the person skilled in the art may contemplate to use any combination of the signals available above. The invention is particularly useful for situations where the signal has a varying magnitude and where the magnitude of the signal is compared to a threshold in order to judge if a demanding event is present or not. In these circumstances the length of the period during which the driver is under a high workload condition will vary in time. The workload will remain high during this period and still remain high during a workload delay time frame. Signals 1 - 4 listed above are of this type.
0021The input signals are used to determine if a demanding event is present or not. A demanding event is an event which takes the driver's attention and where additional requests on the driver's attention, such as informational messages or incoming phone calls (for instance) will be experienced as distracting to the drivers most-important purpose, driving the vehicle.
0022The following conditions for classifying the signals as indicating a demanding event can be used: <tables id="tabl0001" num="0001"><table frame="all"><tgroup cols="3" colsep="1" rowsep="1"><colspec colnum="1" colname="col1" colwidth="53mm" colsep="1" /><colspec colnum="2" colname="col2" colwidth="23mm" colsep="1" /><colspec colnum="3" colname="col3" colwidth="60mm" colsep="1" /><thead><row><entry namest="col1" nameend="col1" align="left" valign="top">PARAMETER (TASK)</entry><entry namest="col2" nameend="col2" align="left" valign="top">CONDITION</entry><entry namest="col3" nameend="col3" align="left" valign="top">VALUE</entry></row></thead><tbody><row><entry namest="col1" nameend="col1" align="left" valign="top">Positive Longitudinal Acceleration</entry><entry namest="col2" nameend="col2" align="left" valign="top">S> T</entry><entry namest="col3" nameend="col3" align="left" valign="top">1.5<T<3 m/s<sup>2</sup></entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Negative Longitudinal Acceleration</entry><entry namest="col2" nameend="col2" align="left" valign="top">S> T</entry><entry namest="col3" nameend="col3" align="left" valign="top">-2.5<T<-1 m/s<sup>2</sup></entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Steering angle threshold</entry><entry namest="col2" nameend="col2" align="left" valign="top">S> T</entry><entry namest="col3" nameend="col3" align="left" valign="top">90<T<130 degrees</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Steering angle velocity threshold</entry><entry namest="col2" nameend="col2" align="left" valign="top">S> T</entry><entry namest="col3" nameend="col3" align="left" valign="top">120<T<170 degrees/s</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Lateral acceleration</entry><entry namest="col2" nameend="col2" align="left" valign="top">S> T</entry><entry namest="col3" nameend="col3" align="left" valign="top">2<T<3 m/s<sup>2</sup></entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Brake pedal activity</entry><entry namest="col2" nameend="col2" align="left" valign="top" /><entry namest="col3" nameend="col3" align="left" valign="top">Brake pedal used</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Gear lever position</entry><entry namest="col2" nameend="col2" align="left" valign="top" /><entry namest="col3" nameend="col3" align="left" valign="top">Gear lever in reverse</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Turn indicator</entry><entry namest="col2" nameend="col2" align="left" valign="top" /><entry namest="col3" nameend="col3" align="left" valign="top">Turn indicator used</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Vehicle navigation system buttons</entry><entry namest="col2" nameend="col2" align="left" valign="top" /><entry namest="col3" nameend="col3" align="left" valign="top">Vehicle navigation system buttons used</entry></row><row rowsep="0"><entry namest="col1" nameend="col1" align="left" valign="top">Phone buttons</entry><entry namest="col2" nameend="col2" align="left" valign="top" /><entry namest="col3" nameend="col3" align="left" valign="top">Phone buttons used and/or phone in use</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Mirror control buttons</entry><entry namest="col2" nameend="col2" align="left" valign="top" /><entry namest="col3" nameend="col3" align="left" valign="top">Mirror control buttons used</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Window control buttons</entry><entry namest="col2" nameend="col2" align="left" valign="top" /><entry namest="col3" nameend="col3" align="left" valign="top">Window control buttons used</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Seat control buttons</entry><entry namest="col2" nameend="col2" align="left" valign="top" /><entry namest="col3" nameend="col3" align="left" valign="top">Seat control buttons used</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Infotainment system buttons</entry><entry namest="col2" nameend="col2" align="left" valign="top" /><entry namest="col3" nameend="col3" align="left" valign="top">Infotainment system buttons used</entry></row></tbody></tgroup></table></tables>
0023Here S is signal value and T is the chosen threshold value, which should be chosen within the suggested interval.
0024If the criteria for a demanding event is fulfilled, the workload estimator generates a high workload output signal 5 which is used as an input signal to the information filter 3.
0025The workload estimator will continue to generate a high workload output signal under the demanding event and under a workload delay time frame which extends a period in time from the end point in time of the demanding event until a workload delay end point in time.
0026System tests has shown that a workload delay time frame extending for up to 3 seconds maintains a high workload indication during events, a workload delay time frame extending between 3 and 15 seconds maintains a high workload during situations and a workload delay time frame extending more than 20 second has the possibility of maintaining high workload during demanding driving environments.
0027In one embodiment of the invention the workload delay time frame is set between 0.1 and 20 seconds, preferably between 2 and 15 seconds and still more preferred between 3 and 7 seconds.
0028When the workload estimator generates a high workload output signal, the information reschedules or delays system initiated information 6 so that information 7 appears in a controlled fashion via means for communication 8 included in the vehicle.
0029In figure 2 an illustration of conditional rules for workload computation including a workload delay period is shown.
0030The lower diagram shows the steering angle as a function of the time. A threshold value T indicates the limit over which a demanding event is considered to be present. The demanding event occurs between a demanding event starting point t<sub>0</sub> and a demanding event end point t<sub>1</sub> in time. The workload estimator generates a high workload output signal at the demanding event starting point t<sub>0</sub>. In the upper figure it is shown that the high workload output signal HW is maintained under the demanding event DE and under the workload delay time frame D.
0031The workload delay time frame can be carried out into effect by a counter, which triggers when the demanding event condition is set to fault. The workload delay time frame can have the same duration for all conditions or alternatively have different duration for different conditions. In one embodiment at least two conditions have different duration of the workload delay time frame.
0032In figure 3 a schematic drawing of a CAN bus 9 in a vehicle is shown. For a general description of CAN bus systems for vehicles see the following U.S. Patents, U.S. Pat. Nos. 5,574,848, 5,551,053, 5,323,385, 5,539,778, 5,600,782, 5,675,830, and 5,448,180. The CAN bus is controlled by a central processor unit 10 which may include the workload estimator 2 and the information filter 3. The CAN bus 9 communicates with different control system in the vehicle such as an engine control unit 11, which provides information about acceleration of the car, a steering control system 12, which provides information about steering angle, a brake control system 13, which provides information about brake pressure, a gear box control system 14, which provides information about gear position, a turn indicator communication switch 15, which provides information about use of the turn indicator, a phone control system 16 , which provides information about the use of the phone, an infotainment control system 17, which provides information about use of control buttons of the infotainment system, furthermore any additional control system 18 may be attached to the bus such as seat control switches, mirror control switches, window control switches, vehicle navigation system control system etc.
0033By coupling the workload manager 1 to the CAN bus the workload manager can have access to all information of importance for correctly determining if a high workload condition is present or not.
0034In figure 4 an example of a hierarchical taxonomy for describing demanding driving scenarios is shown.
0035The lower portion of the figure shows series of events, from left to right a period of deceleration followed by a gap and a period of acceleration together with a sharp turn. An intermediate period, which does not constitute a demanding event, is followed by a deceleration, a gap and a period of an acceleration.
0036The events are grouped into two different situations: a turn at a T intersection followed by a gap and a pedestrian crossing.
0037The traffic environment is classified as inner city driving.
0038The workload delay time frame according to the invention is preferably set to extend so that events making up a situation are grouped together and that a high workload delay will remain under a situation. The workload delay time frame shall preferably not be so long so that separate situations are grouped together. For this reason the workload delay time frame shall have duration of between 2 and 15 seconds, preferably between 3 and 7 seconds.
0039In a table below a set of different events that should be identified by the workload estimator as demanding events: <tables id="tabl0002" num="0002"><table frame="all"><tgroup cols="3" colsep="1" rowsep="1"><colspec colnum="1" colname="col1" colwidth="69mm" colsep="1" /><colspec colnum="2" colname="col2" colwidth="28mm" colsep="1" /><colspec colnum="3" colname="col3" colwidth="70mm" colsep="1" /><thead><row><entry namest="col1" nameend="col1" align="left" valign="top">EVENT</entry><entry namest="col2" nameend="col2" align="left" valign="top">DEMAND TYPE</entry><entry namest="col3" nameend="col3" align="left" valign="top">Relevant CAN bus information</entry></row></thead><tbody><row><entry namest="col1" nameend="col1" align="left" valign="top">Lane change</entry><entry namest="col2" nameend="col2" align="left" valign="top">Primary task</entry><entry namest="col3" nameend="col3" align="left" valign="top">Turn activity signal</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Braking when approaching front obstacle</entry><entry namest="col2" nameend="col2" align="left" valign="top">Primary task</entry><entry namest="col3" nameend="col3" align="left" valign="top">Acceleration, brake pedal position, brake pressure</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Sharp acceleration (For instance at traffic lights or when overtaking.)</entry><entry namest="col2" nameend="col2" align="left" valign="top">Primary task</entry><entry namest="col3" nameend="col3" align="left" valign="top">Acceleration</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Low speed turn</entry><entry namest="col2" nameend="col2" align="left" valign="top">Primary task</entry><entry namest="col3" nameend="col3" align="left" valign="top">Steering wheel angle, yaw rate, turn indicator signal.</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">High speed curve taking</entry><entry namest="col2" nameend="col2" align="left" valign="top">Primary task</entry><entry namest="col3" nameend="col3" align="left" valign="top">Lateral acceleration</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Reverse</entry><entry namest="col2" nameend="col2" align="left" valign="top">Primary task</entry><entry namest="col3" nameend="col3" align="left" valign="top">Gear mode</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Splash on windshield</entry><entry namest="col2" nameend="col2" align="left" valign="top">Primary task</entry><entry namest="col3" nameend="col3" align="left" valign="top">Activity of front wipers</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Infotainment operation</entry><entry namest="col2" nameend="col2" align="left" valign="top">Secondary task</entry><entry namest="col3" nameend="col3" align="left" valign="top">Infotainment buttons and knobs activity</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Vehicle navigation system operation</entry><entry namest="col2" nameend="col2" align="left" valign="top">Secondary task</entry><entry namest="col3" nameend="col3" align="left" valign="top">Vehicle navigation system buttons activity</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Seat adjustment operation</entry><entry namest="col2" nameend="col2" align="left" valign="top">Secondary task</entry><entry namest="col3" nameend="col3" align="left" valign="top">Seat control operation</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Mirror adjustment operation</entry><entry namest="col2" nameend="col2" align="left" valign="top">Secondary task</entry><entry namest="col3" nameend="col3" align="left" valign="top">Driver mirror control</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Window adjustment operation</entry><entry namest="col2" nameend="col2" align="left" valign="top">Secondary task</entry><entry namest="col3" nameend="col3" align="left" valign="top">Driver window control</entry></row></tbody></tgroup></table></tables>
0040The demanding events listed above are frequently clustered into demanding situations. Examples of demanding situations are listed below: <tables id="tabl0003" num="0003"><table frame="all"><tgroup cols="2" colsep="1" rowsep="1"><colspec colnum="1" colname="col1" colwidth="76mm" colsep="1" /><colspec colnum="2" colname="col2" colwidth="72mm" colsep="1" /><thead><row><entry namest="col1" nameend="col1" align="left" valign="top">Demanding Situation</entry><entry namest="col2" nameend="col2" align="left" valign="top">Cluster of events</entry></row></thead><tbody><row><entry namest="col1" nameend="col1" align="left" valign="top">Overtaking</entry><entry namest="col2" nameend="col2" align="left" valign="top">Left lane change, acceleration, right lane change</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Stop and go situations (traffic lights, crosswalks etc)</entry><entry namest="col2" nameend="col2" align="left" valign="top">Deceleration, acceleration</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">intersection</entry><entry namest="col2" nameend="col2" align="left" valign="top">Deceleration, low speed turn, acceleration</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Roundabout</entry><entry namest="col2" nameend="col2" align="left" valign="top">Deceleration, low speed turn</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Parking</entry><entry namest="col2" nameend="col2" align="left" valign="top">Reverse, low speed turn</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Infotainment task execution</entry><entry namest="col2" nameend="col2" align="left" valign="top">Infotainment button presses</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Vehicle navigation system task execution</entry><entry namest="col2" nameend="col2" align="left" valign="top">Vehicle navigation system button presses</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Seat adjustment task operation</entry><entry namest="col2" nameend="col2" align="left" valign="top">Seat control operations</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Mirror adjustment task operation</entry><entry namest="col2" nameend="col2" align="left" valign="top">Mirror control operations</entry></row><row><entry namest="col1" nameend="col1" align="left" valign="top">Window adjustment task operation</entry><entry namest="col2" nameend="col2" align="left" valign="top">Window control operations</entry></row></tbody></tgroup></table></tables>
0041In figure 5 a flow chart for operating a method for estimating workload for a driver of a vehicle is shown.
0042In a first method step 20 signals 21 indicative of a tasks requiring driver attention are collected. In a second method step 22 the signals are compared with threshold values and/or indication of presence of demanding activity. In a third method step 24 it is determined if a demanding event is present or not. If a demanding event is not present a new set of input signal data is collected. If a demanding event is present a high workload output signal is generated at a fourth method step 26. After the demanding event has been identified it is determined in a fifth method step 28 if the demanding event is still ongoing or if it has ended. The fifth method step is repeated while the demanding event is ongoing. The fifth method step can be replaced with an immediate recollection of a new set of input signal input data, as is indicated by the dashed line. When the demanding event is no longer present the workload delay time frame is started at a sixth method step 30. Different time frames can be used for different tasks. New data are collected under the running of the workload delay time frame. A new identified demanding event will reset the workload delay time frame, which will again start to run after the new demanding event has expired.
0043In one embodiment of the invention, the method for estimating workload will include a method step of determining if stationary or nearly stationary. The vehicle will be considered to be stationary if the vehicle is at standstill, that is has a zero speed, for a period of time exceeding a time period threshold value. The time period threshold value is preferably set to between 10 - 40 seconds. The vehicle will be considered to be stationary only first after the workload estimator has identified that the vehicle has been at standstill for a period exceeding the threshold value. The vehicle will be considered to be nearly stationary if a vehicle speed input signal is below a predetermined vehicle speed threshold value for a time period exceeding a time period threshold value. The time period threshold value for the condition "nearly stationary" may be the same as the time period threshold value for the condition "stationary. However, a different longer time period threshold value may be used for the condition "nearly stationary" than for the condition "stationary". The time period threshold value for the condition "nearly stationary" is preferably set to between 20 s and 2 minutes for a vehicle speed threshold value of 4 kilometres per hour. If the workload estimator has determined that the vehicle is stationary or nearly stationary, the means for generating an output signal generates a low workload output signal regardless of if a demanding event has initiated a high workload output signal or not.
0044After evaluating if the vehicle is stationary or nearly stationary, the actual evaluation of the workload level will continue as set out above with reference to the flow chart of figure 5. In the event it is identified that the vehicle is stationary or nearly stationary it is possible to skip running through the remaining parts of the algorithm for determining the workload level since the workload estimator will generate a low workload output signal regardless of the status of the input signal indicative of tasks requiring driver attention. In this even no changes are performed until a new sampling of input signals is performed. It is also possible to run through the remaining part of the algorithm, without resetting the workload level and first thereafter perform a new sampling of input signals.
0045In figure 6 an embodiment of a workload estimator 2 according to the invention is shown. The workload estimator 2 includes means 30 for retrieving a signal 7 indicative of a task requiring driver attention, said signal being used to determine a workload level of an output signal of a workload estimator. The workload estimator may further include means 31 for identifying that the vehicle is stationary if the vehicle is at standstill for a period in time exceeding a threshold value. The condition that the vehicle is stationary may be identified from a speed signal 32 together with a timing condition, that parking or zero speed must has been ongoing for a period exceeding a threshold value. These means 31 may further identify if the vehicle is nearly stationary. The vehicle will be judged to be nearly stationary if the vehicle speed is less than a vehicle speed threshold value for a period of time exceeding a time period threshold value.
0046The workload estimator also includes means 33 for generating a workload output signal. The means for generating a workload output signal 33 will, in the event means for identifying if the vehicle is stationary or nearly stationary are included, generate a low workload output signal as long as vehicle remains stationary or nearly stationary regardless of if the signal indicative of a task requiring driver attention has initiated a high workload output signal or not.
0047The workload estimator further includes means for identifying a demanding event 34 from a signal indicative of a task requiring driver attention. The demanding event will occur between a demanding event starting point and a demanding event end point in time. The workload estimator also includes means 35 for generating a workload delay time frame. The workload delay time frame extends a period in time from said demanding event end point in time until a workload delay end point in time. The means for generating a workload output signal 33 will generate a high workload output signal under the demanding event and maintain the high workload output signal under the workload delay time frame.
0048In figure 7 a flowchart of a method for determining workload according to an embodiment of the invention is shown. The method may be used in a workload manager 1 as shown in figure 1. According to this method a high workload output signal will be discriminated if the vehicle is stationary or nearly stationary. A low workload output signal will be generated regardless of if a demanding event is detected if the vehicle is stationary or nearly stationary. In a first method step 100 information regarding tasks requiring driver attention is retrieved from an input signal. This information also includes information relating to whether the vehicle is considered to be stationary or nearly stationary. In a second method 101 step it is determined if the vehicle is stationary or nearly stationary. The condition that the vehicle is stationary is identified if the vehicle is as standstill and has been at standstill for a period in time exceeding a threshold value. There are several ways of determining that a vehicle is at standstill. A straightforward possibility is to use the velocity signal and determine that a vehicle is at standstill if the signal indicates zero velocity. It is also possible to use a signal identifying the use of a parking brake. As soon as it is first identified if the vehicle is at standstill, for instance by noting that the vehicle has zero velocity, a timer starts running or alternatively a flag indicating a starting time is set. In the second method step 101 it is determined if the vehicle speed is zero, and in the event the vehicle speed is zero, for how long the vehicle speed has been zero. This is used by the timer, which started to run when first noting that the vehicle speed was zero or by comparing a value attached to the flag with a timer who set the flag.
0049If it is noted that the vehicle speed has been zero for a period exceeding a threshold value, preferably 10 - 40 seconds, the vehicle is considered to be stationary and a low workload signal is generated at a third method step 102 regardless of whether a demanding event has initiated a high workload output signal or not.
0050In the event the method includes detection of a condition identified as nearly stationary, the vehicle speed will be determined in the method step 101. In the event the vehicle speed has been identified to be below a vehicle speed threshold value for a time period exceeding a time period threshold value, the vehicle will be considered to be nearly stationary.
0051If the vehicle is considered to be nearly stationary a low workload signal is generated at a third method step 102 regardless of whether a demanding event has initiated a high workload output signal or not.
0052If the vehicle is neither stationary nor nearly stationary the method continues with estimating the workload of the current traffic situation. This is done in a fourth method step 103 by comparing signals indicative of tasks requiring driver attention with threshold values or by noting that a task requiring driver attention is ongoing. If a demanding event is identified, that is if a signal relating to certain types of tasks exceeds a threshold value or if a signal relating to other tasks indicates that a task requiring driver attention is ongoing, a high workload output signal is generated at a fifth method step 104, otherwise a low workload output signal is generated at a sixth method step 105.
0053The method is restarted at the first method step 100 with a new set of collected data after having finished the third method step 102, the fifth method step 104 or the sixth method step 105.
0054The workload estimator and its means may be constituted by a state of the art microcomputer having a signal input gate, a signal output gate, processors capable of handling logic structure and timers or reference clock signals. The input gate can be arranged to handle analog as well as digital signals. The output gate can optionally be an analog or digital output gate. Preferably the input gate is coupled to a CAN bus. In this event, the input gate need only be able to handle digital signals. The workload estimator can also be constituted by a logic circuit including transistor elements arranged to perform the necessary signal comparisons and logic decisions.
0055In figures 8 and 9 a method for handling incoming calls and a vehicle on board arrangement for handling an incoming call is described. According to this method and arrangement, an incoming call will be inhibited for a period of time if a high workload output signal is generated by a workload estimator at reception of the call.
0056Figure 8 shows a flow chart of a method for handling an incoming call to a telephone connected to an internal data communication system of a vehicle. At a first method step 200 the workload for the driver is estimated. The workload estimation can be performed by any known workload estimation technique. However, preferably a workload estimator as disclosed below will be used. The workload estimator will generate a high workload output signal 201 in the event a demanding event is detected in the workload estimation. In the event a demanding event is not detected, a low workload output signal 202 will be generated.
0057In the event a high workload signal is present at reception of the incoming call, the incoming call is in a second method step maintained connected for a period of time from reception of the incoming call while inhibiting access to said incoming call as long as a high workload signal is present under said period of time.
0058If the workload estimator change its output signal from indicating high workload to in stead indicate low workload before the predetermined period of time runs out, access to the telephone call will be allowed at a third step 203a.
0059If the high workload signal remains when said predetermined period of time runs out, according to different embodiments of the invention one of the following method steps will be taken:
0060According to a first embodiment the incoming call is disconnected in a third method step 203b if a high workload output signal is present when said period of time runs out.
0061According to a second embodiment the incoming call is routed to an answering machine in a third method step 203c if a high workload output signal is present when said period of time runs out. Optionally, the answering machine informs the caller that the driver is in a demanding event.
0062According to a third embodiment t access to the incoming call is allowed in a third method step 203d regardless of whether a high workload output signal is present or not when said period of time runs out
0063The predetermined period of time has preferably a duration of between 2 - 20 seconds. In a still more preferred embodiment the duration is set to between 4 - 6 seconds. According to one embodiment of the invention, the access to the incoming call is inhibited by turning off the phone signal.
0064If a call has already been received before a demanding event occurs, the call will not be interrupted.
0065In figure 9 a vehicle on board arrangement 204 for handling an incoming call or is shown. The vehicle on board arrangement include an internal data communication system 205 of a vehicle. The internal data communication system can be arranges as a multiplex system as for instance a CAN bus. The internal data communication system is controlled by a central processor unit 210. The internal data communication system 205 is connected to a telephone 206 and a workload estimator 207.The workload estimator 206 may be of any type know to a person skilled in the art, but is preferably of the type which is disclosed in more detail below. The workload estimator 206 is arranged to generate a high workload output signal in the event the workload estimator 206 detects a demanding event. The arrangement 204 further includes means 208 for inhibiting access to said incoming call for a period of time in the event a high workload signal is present at the reception of the incoming call. The means for inhibiting access can be included in the workload estimator 207, in an information filter included in a workload manager as described below, or be separately arranged, for instance as means for inhibiting the ring signal arranged in connection with a loudspeaker arrangement which normally produces the ring signal at reception of a call.
0066The means for inhibiting access operates according to the method disclosed in relation to figure 1. The mean for inhibiting access are arranged according to the following:
0067The vehicle on board arrangement includes means for maintaining the incoming call connected for a period of time from reception of the while, in the event a high workload signal is present at reception of the incoming call, inhibiting access to said incoming call as long as a high workload signal is present under said period of time. These means can be arranged by allowing the incoming call to be connected while letting said means for inhibiting the ring signal to cancel the ring signal.
0068The means for inhibiting access 208 is according to one embodiment of the invention is arranged to disconnect the incoming call if a high workload output signal is present when said period of time runs out.
0069The means for inhibiting access 208 is according to another embodiment of the invention is arranged to route the incoming call to an answering machine if a high workload output signal is present when said period of time runs out. Preferably, the arrangement 204 according to this embodiment includes or is connected to an answering machine 209, which has a communication path to the workload estimator. In the event the answering machine 209 is informed of that the workload estimator generates a high workload output signal, a message indication that the driver is under high workload will be generated.
0070The means for inhibiting access 208 is according to still another embodiment of the invention is arranged to allow access to the incoming call regardless of whether a high workload output signal is present or not when said period of time runs out
0071The predetermined period of time has a preferably a duration of between 2 - 10 seconds. In a still more preferred embodiment the duration is set between 4 - 6 seconds.
0072If a call has already been received before a demanding event occurs, the call will not be interrupted.
0073The invention is not restricted to the embodiments described above, but can be varied within the scope of the appended claims. In particular it is possible to amend the way the way data is collected and recollected. Furthermore it is possible to use the invention together with workload estimators which make use of physiological indicators. The invention is however preferably used together with workload estimators using performance related measures.
Contents5
6 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US8924079B2 | Cited by | United States of America | Applicant |
| US8849512B2 | Cited by | United States of America | Applicant |
| US9141584B2 | Cited by | United States of America | Applicant |
| US8886397B2 | Cited by | United States of America | Applicant |
| US8914192B2 | Cited by | United States of America | Applicant |
| DE19723922A | Cites | Germany | – |
| US2002120371A1 | Cites | United States of America | – |
| US2003050740A1 | Cites | United States of America | – |
4 members in 2 offices
Members4
| Document | Office | Kind | |
|---|---|---|---|
| EP1512374A1 | European Patent Office (EPO) | A1 | |
| EP1512374B1This record | European Patent Office (EPO) | B1 | |
| DE60306378D1 | Germany | D1 | |
| DE60306378T2 | Germany | T2 |
29 legal events, as 4 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Expiry of rightR071 | R071 | DE | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Ep patent has lapsedLapsedEUG | EUG | SE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Gb: european patent ceased through non-payment of renewal feeCeasedGBPC | GBPC | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Change of applicant/patenteeR081 | R081 | DE | |
| Change of representativeR082 | R082 | DE | |
| Change of representativeR082 | R082 | DE | |
| Change of representativeR082 | R082 | DE | |
| Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)REGISTERED BETWEEN 20111020 AND 20111025732E | 732E | GB | |
| No opposition filedOpposition26N | 26N | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Translation of granted ep patentGrantedTRGR | TRGR | SE | |
| Corresponds to:REF | REF | EP | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Designation fees paidAKX | AKX | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 1512374
- Application
- 30777650
Titles3
- German
- Verfahren und Gerät zur Bestimmung der Arbeitsbelastung eines Fahrzeugfahrers
- English
- Method and device for estimating workload for a driver of a vehicle
- French
- Procédé et dispositif pour l'estimation de la charge de travail d'un conducteur dans un véhicule
Classification
- IPC, 3
- A61B5 18
- B60R16 02
- B60R16 023
Designated states3
- Contracting states, 3
- Germany
- United Kingdom
- Sweden
