Apparatus for displaying driving state of vehicle, system including the same and method thereof

<u>CROSS-REFERENCE TO RELATED APPLICATION</u>

0001The present application claims priority to and the benefit of <patcit id="pcit0001" dnum="US62655831A"><text>U.S Patent Application No. 62/655,831, filed on April 11, 2018</text></patcit> in the U. S. Patent Office and Korean Patent Application No.<patcit id="pcit0002" dnum="KR1020180157360"><text> 10-2018-0157360, filed on December 7, 2018</text></patcit>, in the Korean Intellectual Property Office, which is incorporated herein in its entirety by reference.

<u>TECHNICAL FIELD</u>

0002The present disclosure relates to an apparatus for displaying a driving state of a vehicle, a system including the same and a method thereof, and more particularly, to a technology of displaying a state of a lane change assistance function.

<u>BACKGROUND</u>

0003The statements in this section merely provide background information related to the present disclosure and may not constitute prior art.

0004Recently, a system for assisting the driving of a vehicle such as an advanced driver assistance system (ADAS) has been developed and spotlighted in the automobile industry.

0005Such an advanced driver assistance system assists the vehicle driving, rather than the driver, and assists the lane change of a vehicle or the like by using various sensors and advanced logic.

0006In particular, when the lane change of a vehicle is assisted, the state of a lane change function such as normal operation, restriction, interruption, and like is changed from time to time depending on a surrounding situation and a current state of the vehicle. In this case, there is a need to accurately inform the driver of the change in a state of the lane change function, thereby allowing the driver to response safely to it.

<u>SUMMARY</u>

0007The present disclosure provides an apparatus for displaying a driving state of a vehicle, which is capable of accurately determining a change in a state of a lane change assistance function and promptly and quickly displaying the state change to allow a user to know the state change, a system including the same, and a method thereof.

0008In one aspect of the present disclosure, an apparatus for displaying a driving state of a vehicle is provided, which includes a processor that determines a change in a state of a lane change assistance function and controls a step-by-step notification based on the change in the state of the lane change assistance function, and a display controlled by the processor to display the step-by-step notification based on the change in the state of the lane change assistance function.

0009The state of the lane change assistance function may include at least one of a first state in which the lane change assistance function is turned off to be disabled, a second state in which a vehicle enters an operating section of the lane change assistance function, a third state in which a lane changeable condition is unmet, a fourth state in which the lane changeable condition is met, a fifth state in which a lane change is able to be performed, a sixth state in which a lane change cancel condition is met, and a seventh state in which a failure condition of the lane change assistance function is met.

0010The processor may control the display to separately display each of the first to seventh states by using at least one of a symbol, whether a light is turned on, a light color, whether a light is blinked, and a blink rate.

0011The processor may control the display to output a screen without displaying the lane change assistance function in the first state, turn on a symbol of the lane change assistance function in a first color in the second state, turn on the symbol of the lane change assistance function in a color different from the first color in the third state, and turn on and blink the symbol of the lane change assistance function in the fourth state.

0012The processor may perform a notification by using at least one of visual, tactile and auditory outputs in the sixth or seventh state.

0013The processor may immediately perform a notification by using a tactile or auditory output together with a visual output when a transition to the sixth or seventh state is performed, and stop the tactile or auditory output and maintain the visual output after a preset time elapses.

0014The processor may perform the tactile output through a steering wheel haptic or a seat vibration, and perform the auditory output through a beep or voice guidance.

0015The processor may determine that a sensor is in normal operation and transition the lane change assistance function from the first state to the second state when information about a surrounding object, which is received at a position apart by a specified distance or more rearward of the vehicle, exists when a sensor measured value is received after the vehicle starts.

0016The processor may transition the lane change assistance function to the fifth state when a user input is generated in the fourth state and a risk of collision does not exist, and transition the lane change assistance function to the fourth state when a lane change is completed in the fifth state.

0017The processor may determine that the failure condition of the lane change assistance function is met and transition the lane change assistance function from the first state to the seventh state when a sensor fails or when an error occurs in a controller area network (CAN) signal when the lane change assistance function is performed.

0018The processor may transition the lane change assistance function from the second state to the third state when a lane change-on operation is performed and an object by which activation of the lane change assistance function is impossible is not sensed in a lane change-off operation state, or when, in the change-on operation state, a lateral control-off operation state is transitioned to a later control-on operation state and, the object by which activation of the lane change assistance function is impossible is not sensed.

0019The processor may determine whether the lane changeable condition is met by using one or more of whether a lane exists, a curvature of a road on which the vehicle travels, a current speed of the vehicle, whether a lateral control is operated, and road condition.

0020The processor may determine that the lane changeable condition is met when a lane exists and the vehicle travels on a road having a curvature equal to or less than a lane change limiting curvature, when the vehicle travels at a lane changeable speed, when a lateral control is operated, and when the road is not a road on which a lane change is impossible within a specified distance in front of the vehicle or at a current vehicle location.

0021The processor may determine that the lane change cancel condition is met when at least one of cases is met, wherein the cases include a case where an emergency light switch is turned on before the vehicle crosses a lane mark, a case where a user setting menu (USM) is turned off before the vehicle crosses the lane mark, a case where a hands-off is sensed before the vehicle crosses a lane mark, a case where a speed of the vehicle deviates from a lane changeable speed before the vehicle crosses a lane mark, a case where a forward collision-avoidance assist (FCA) or a blind-spot collision-avoidance assist (BCA), which is a safety system, is operated before the vehicle crosses a lane mark, a case where a lane mark disappears, a case where the vehicle does not cross a lane mark within a specified period of time after a turn light signal is input, a case where the vehicle crosses a lane mark within the specified period of time after the turn light signal is input, a case where the vehicle does not get out of a lane mark even through a specified period of time elapses after the vehicle crosses the lane mark, a case where a lateral control is released, and a case where collision with a nearby vehicle is expected.

0022The processor may transition the lane change assistance function from the third state to the second state when the vehicle is in a lane change-off operation state, or an object by which activation of the lane change assistance function is impossible is sensed.

0023The processor may control the display to output a pop-up window for confirming to a user whether to enter a lane change operation mode when a lane change-on operation is performed in transition from the first state to the second state, or the object disappears in a state where the object by which activation of the lane change assistance function is impossible is sensed such that the third state is transitioned to the second state.

0024In another aspect of the present disclosure, a vehicle system is provided, which includes a vehicle driving state display device configured to determine a change in a state of a lane change assistance function and output a step-by-step notification based on the change in the state of the lane change assistance function, and a tactile output device or an auditory output device controlled by the vehicle driving state display device, wherein the tactile output device is configured to tactually output the step-by-step notification, and the auditory output device is configured to auditorily output the step-by-step notification.

0025The step-by-step notification may be separately displayed by using at least one of a symbol, whether a light is turned on, a light color, whether a light is blinked, and a blink rate.

0026The tactile output device may output a steering wheel haptic or a seat vibration, and the auditory output device may output a beep or voice guide.

0027According to still another aspect of the present disclosure, there is provided a method of displaying a driving state of a vehicle, which includes determining a change in a state of a lane change assistance function by using at least one of whether a sensor is in normal operation, a lane changeable condition and a lane change cancel condition, outputting a step-by-step notification based on the change in the state of the lane change assistance function.

0028According to the present technology, it may be possible to accurately determine the change in the state of the lane change assistance function and promptly and rapidly display the change to allow a user to know the change state of the lane change assistance function, thereby improving the convenience of the user.

0029In addition, various effects that are directly or indirectly understood through the present disclosure may be provided.

0030Further areas of applicability will become apparent from the description provided herein. It should be understood that the description and specific examples are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure.

<u>DRAWINGS</u>

0031In order that the disclosure may be well understood, there will now be described various forms thereof, given by way of example, reference being made to the accompanying drawings, in which: <ul id="ul0001" list-style="none" compact="compact"><li><figref idref="f0001">FIG. 1</figref> is a block diagram illustrating a configuration of an apparatus for displaying a driving state of a vehicle in one form of the present disclosure;</li><li><figref idref="f0002">FIG. 2</figref> is a view illustrating a method of determining an operation state of a sensor in one form of the present disclosure;</li><li><figref idref="f0003">FIG. 3</figref> is a view illustrating an exemplary operation of a state transition of a lane change assistance function in one form of the present disclosure;</li><li><figref idref="f0004">FIG. 4</figref> is a view illustrating an example of a method of displaying each lane change assistance function state in one form of the present disclosure;</li><li><figref idref="f0005">FIG. 5</figref> is a diagram illustrating an example of a case in which the lane change assistance function in one form of the present disclosure is in an off state;</li><li><figref idref="f0006">FIG. 6</figref> is a diagram illustrating an example of a case in which the lane change assistance function in one form of the present disclosure is in a standby state;</li><li><figref idref="f0007">FIG. 7</figref> is a diagram illustrating an example of a case in which the lane change assistance function in one form of the present disclosure is in a ready state;</li><li><figref idref="f0008">FIG. 8</figref> is a diagram illustrating an example of a case in which the lane change assistance function in one form of the present disclosure is in an active state;</li><li><figref idref="f0009">FIG. 9A</figref> is a diagram illustrating an example of a case in which the lane change assistance function in one form of the present disclosure is in a cancel state;</li><li><figref idref="f0010">FIG. 9B</figref> is a diagram illustrating an example of a popup window displayed for a user when the lane change assistance function in one form of the present disclosure is in the cancel state;</li><li><figref idref="f0011">FIG. 10</figref> is a diagram illustrating an example of a case in which the lane change assistance function in one form of the present disclosure is in the failure state; and</li><li><figref idref="f0012">FIG. 11</figref> is a block diagram illustrating a computer system in one form of the present disclosure.</li></ul>

0032The drawings described herein are for illustration purposes only and are not intended to limit the scope of the present disclosure in any way.

<u>DETAILED DESCRIPTION</u>

0033The following description is merely exemplary in nature and is not intended to limit the present disclosure, application, or uses. It should be understood that throughout the drawings, corresponding reference numerals indicate like or corresponding parts and features.

0034Hereinafter, some forms of the present disclosure will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals will be used throughout to designate the same or equivalent elements. In addition, a detailed description of well-known features or functions will be ruled out in order not to unnecessarily obscure the gist of the present disclosure.

0035In describing the components of the present disclosure, terms like first, second, "A", "B", (a), and (b) may be used. These terms are intended solely to distinguish one component from another, and the terms do not limit the nature, sequence or order of the constituent components. In addition, unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meanings as those generally understood by those skilled in the art to which the present disclosure pertains. Such terms as those defined in a generally used dictionary are to be interpreted as having meanings equal to the contextual meanings in the relevant field of art, and are not to be interpreted as having ideal or excessively formal meanings unless clearly defined as having such in the present application.

0036The present disclosure provides a configuration for accurately determining a change in state transition of a lane change assistance function when a lane change assistance function is operated and promptly informing a user of the state change, thereby allowing a user to accurately and quickly recognize the state change.

0037Hereinafter, some forms of the present disclosure will be described in detail with reference to <figref idref="f0001 f0002 f0003 f0004 f0005 f0006 f0007 f0008 f0009 f0010 f0011 f0012">FIGS. 1 to 11</figref>.

0038<figref idref="f0001">FIG. 1</figref> is a block diagram illustrating a configuration of a vehicle system including a vehicle driving state display device in some forms of the present disclosure. <figref idref="f0002">FIG. 2</figref> is a view illustrating a method of determining an operation state of a sensor in some forms of the present disclosure.

0039Referring to <figref idref="f0001">FIG. 1</figref>, a vehicle system in some form of the present disclosure may include a vehicle driving state display device 100, a sensing module 200, a the auditory output device 300, and a tactile output device 400.

0040The vehicle driving state display device 100 determines a lane change assistant state according to whether a sensor is normally operated, a failure condition of a lane change function, a lane changeable condition, a lane change cancel condition, whether a risk of collision exists, whether a lane change is completed, and the like, and controls a step-by-step notification according to a change in a state of the lane change assistance function.

0041The state of the lane change assistance function may include at least one of a first state (off state) in which the lane change assistance function is turned off to be disabled, a second state (operation section entrance state) in which a vehicle enters an operating section of the lane change assistance function, a third state (standby state) in which a lane changeable condition is unmet, a fourth state (ready state) in which the lane changeable condition is met, a fifth state (active state) in which a lane change is able to be performed, a sixth state (cancel state) in which a lane change cancel condition is met, and a seventh state (failure state) in which a failure condition of the lane change assistance function is met.

0042The off state of the lane change assistance function means a state where the lane change assistance function is turned off so that the operation is impossible. The operation section entrance state of the lane change assistance function means a state in which the lane change assistance function is operable.

0043When the lane change assistance function is in the standby state, it means a state in which the lane changeable condition is unmet, and when the lane changing assistance function is in the ready state, it means a state in which the lane changeable condition is met. That is, when the lane change assistance function is in the standby state, it means a state in which at least one of the lane changeable conditions is not met, and when the lane change assistance function is in the ready state, it means a state in which all the lane changeable conditions are met. When the lane change assistance function is in the active state, it means a state in which the lane change is performable so that the lane change operation may be performed in the active state. When the lane change assistance function is in the cancel state, it means a state in which at least one of the lane change cancellation conditions is met, and when the lane change assistance function is in the fail state, it means a state in which the failure condition of the lane change assistance function is met, so that it is impossible to operate the system performing the lane change assistance function.

0044The vehicle driving state display device 100 may include a communication device 110, storage 120, a display 130, and a processor 140.

0045The communication device 110, which is a hardware device implemented by various electronic circuits for transmitting and receiving a signal through a wireless or wired connection, may perform the communication in a vehicle through CAN communication, LIN communication, or the like in the present disclosure and may communicate with the sensing module 200, the auditory output device 300, the tactile output device 400, and the like.

0046The storage 120 may store the sensing result of the sensing module 200, the result of determining the state of the lane change assistance function obtained by the processor 140, and the like. The storage 120 may include a storage medium having at least one type of a flash memory type, a hard disk type, a micro type, a card type of a memory (for example, an SD, XD memory, or the like), RAM (Random Access Memory), SRAM (Static RAM), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), MRAM (Magnetic RAM), a magnetic disc, and an optical disc.

0047The display 130 may be controlled by the processor 140 to display a step-by-step notification based on the change in the state of the lane change assistance function and to display a symbol (icon) indicating the state of the lane change assistance function by turning on or blinking the symbol, or by changing the color of the symbol based on the change in the state of the lane change assistance function. A detailed display example according to the state of the lane change assistance function will be described later with reference to <figref idref="f0004 f0005 f0006 f0007 f0008 f0009 f0010 f0011">FIGS. 4 to 10</figref>. The display 130 may be implemented as a head-up display (HUD), a cluster, an audio video navigation (AVN), or the like. In addition, the display 130 may include at least one of a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), a light emitting diode (LED), an organic light emitting diode (OLED), an active matrix OLED (AMOLED), a flexible display, a bended display, and a three-dimensional (3D) display. Some of these displays may be implemented as transparent displays that are transparent or optically transparent to allow viewing of an outside. In addition, the display 130 may be provided as a touch screen including a touch panel, and may be used as an input device as well as an output device. Although an example in which the display 130 is included in the vehicle driving state display device 100 is described in the present disclosure, the form of the disclosure is not limited thereto and the display 130 may be implemented as a display device which is already mounted in a vehicle and is independent separated from the communication device 110, the storage 120, and the processor 140.

0048The processor 140 may be electrically connected to the communication device 110, the storage 120, the display 130, and the like, and may electrically control each component. The processor 140 may be an electric circuit that executes software commands and may perform various data processing and calculations described below.

0049The processor 140 may determine the change in the state of the lane change assistance function and control a step-by-step notification based on the change in the state of the lane change assistance function.

0050The processor 140 may control to separately display each of the first to seventh states by using at least one of a symbol, whether a light is turned on, a light color, whether a light is blinked, and a blink rate.

0051The processor 140 may control the display 130 to output a screen without displaying the lane change assistance function in the first state, turn on a symbol of the lane change assistance function in a first color in the second state, turn on the symbol of the lane change assistance function in a color different from the first color in the third state, and turn on and blink the symbol of the lane change assistance function in the fourth state. The processor 140 may control the display 130 to blink the symbol of the lane change assistance function in the fifth state while turning on the symbol of the lane change assistance function in a color different from those in the second and third states. In addition, the processor 140 may control the display 130, the auditory output device 300, and the tactile output device 400 to perform the notification by using at least one of visual, tactile and auditory outputs in the sixth or seventh state. An example of a visual output for each state will be described in more detail later with reference to <figref idref="f0004 f0005 f0006 f0007 f0008 f0009 f0010">FIGS. 4 to 9</figref>.

0052The processor 140 may increase the speed of the blinking period of the display 130 immediately after transition to the fifth state which is an active state, and gradually decrease the speed of the blinking period as the lane change proceeds. Thus, the processor 140 may visually inform the user of the lane change progress information through the blinking cycle change. That is, since the lane change is more dangerous in the driving situation than the lane maintenance, the processor 140 may speed up the blinking at the start time point of the lane change to inform the user of the situation. In addition, since the completion of the lane change of the vehicle means the transition to the lane maintenance state (the safer situation in the driving situation), the processor 140 may speed down the blinking to inform the user of the situation.

0053In addition, when the lane change is canceled so that the vehicle returns to the original lane along a cancel path, the processor 140 may gradually decrease the blinking speed in the lane change cancel situation in the same manner as the lane change activation state, and may inform the user of the dangerous situation by continuously increasing the blinking speed in a situation where the lane change is cancelled due to the dangerous situation such as the release of the lateral control. However, it is possible to output the auditory output or tactile output equally.

0054Referring to <figref idref="f0002">FIG. 2</figref>, when the processor 140 receives a sensor measurement value after the start of the vehicle, the processor 140 may determine that the sensor is normally operated when there is information about a surrounding object at least once, which is received at a specified distance (e.g., 55 m) or more rearward of the vehicle, and may transition the lane change assistance function from the first state to the second state.

0055When a lane change-on operation is performed and an object by which activation of the lane change assistance function is impossible is not sensed in a lane change-off operation state, or when, in the lane change-on operation state, a lateral control-off operation state is transitioned to a lateral control-on operation state and, the object by which activation of the lane change assistance function is impossible is not sensed, the processor 140 may transition the lane change assistance function from the second state to the third state.

0056The processor 140 may transition the lane change assistance function from the third state to the fourth state when the vehicle changeable condition is met, and may transition the lane change assistance function to the fifth state when a user input (e.g., a turn signal lamp is turned on) occurs in the fourth state and there is no risk of collision. In this case, the processor 140 may determine that there is no risk of collision when the collision estimated time (TTC) with the surrounding vehicle exceeds a reference time and the distance from the surrounding vehicle exceeds a reference distance. In addition, when the risk of collision occurs in the state in which the turn signal lamp is turned on, the transition to the fifth state may be impossible.

0057In addition, when the lane change is completed in the fifth state, the processor 140 may transition the lane change assistance function to the fourth state. In this case, the processor 140 may determine that the lane change is completed when the vehicle enters a specified range of the center of the target lane or the lane change path ends.

0058In addition, when the lane change cancel condition is met during the lane change in the fifth state, the processor 140 may immediately transition to the sixth state which is the cancel state and outputs a notification.

0059The processor 140 may determine that the failure condition of the lane change assistance function is met when the sensor fails or when the CAN communication signal is abnormally generated when the lane change assistance function is performed, and may transition from the first state to the seventh state. The processor 140 may transition the lane change assistance function from the third state to the second state when the lane change assistance function is in the lane change-off operation state or when an object by which the activation of the lane change assistance function is impossible is sensed.

0060The processor 140 may determine whether the lane changeable condition is met by using one or more of whether a lane exists, a curvature of a road on which the vehicle travels, a current speed of the vehicle, whether the lateral control is operated, and road condition.

0061The processor 140 may determine that the lane changeable condition is met when a lane exists and the vehicle travels on a road having a curvature equal to or less than a lane change limiting curvature, when the vehicle travels at a lane changeable speed, when a lateral control is operated, and when it is not a road on which a lane change is impossible within a specified distance in front of the vehicle or at a current vehicle location.

0062The processor 140 may determine that the lane change cancel condition is met when at least one of cases is met, where the cases include a case where an emergency light switch is turned on before the vehicle crosses a lane mark, a case where a user setting menu (USM) is turned off before the vehicle crosses a lane mark, a case where a hands-off is sensed before the vehicle crosses a lane mark, a case where a speed of the vehicle deviates from a lane changeable speed before the vehicle crosses a lane mark, a case where a forward collision-avoidance assist (FCA) or a blind-spot collision-avoidance assist (BCA), which is a safety system, is operated before the vehicle crosses a lane mark, a case where a lane mark disappears, a case where the vehicle does not cross a lane mark within a specified period of time after a turn light signal is input, a case where the vehicle crosses a lane mark within the specified period of time after the turn light signal is input, a case where the vehicle does not get out of a lane mark even through a specified period of time elapses after the vehicle steps on the lane mark, a case where a lateral control is released, and a case where collision with a nearby vehicle is expected. In this case, the vehicle driving state display device 100 may determine that the vehicle is in the hands-off state when the driver's steering torque is lower than a hands-off reference torque for a specified time, and may determine that the driver has willingness to operate directly (override) when the driver's steering torque exceeds a reference torque.

0063The sensing module 200 may include a plurality of sensors for sensing an object outside the vehicle, and may obtain information about a location, a speed, a moving direction and/or a kind of an external object (e.g., a vehicle, a pedestrian, a bicycle, a motorcycle, or the like). To this end, the sensing module 200 may include an ultrasonic sensor, a radar, a camera, a laser scanner and/or a corner radar, a lidar, an acceleration sensor, a yaw rate sensor, a torque measurement sensor, a wheel speed sensor, a steering angle sensor, and the like.

0064The auditory output device 300 is controlled by the vehicle driving state display device 100 to perform auditory output through beep sound or voice guidance. In this case, the vehicle driving state display device 100 may differently adjust the volume or tone of the auditory output through the auditory output device 300 to notify the state change of the lane change assistance function step by step.

0065The tactile output device 400 may be controlled by the vehicle driving state display device 100 to perform tactile output through steering wheel haptic or seat vibration. In this case, the vehicle driving state display device 100 may adjust the intensity of the vibration through the tactile output device 400 to notify the state change of the lane change assistance function step by step.

0066<figref idref="f0003">FIG. 3</figref> is a view illustrating an exemplary operation of a state transition of a lane change assistance function in some forms of the present disclosure.

0067Referring to <figref idref="f0003">FIG. 3</figref>, when the vehicle starts up and the lane change assistance function is in an off state in operation S100, the vehicle driving state display device 100 determines whether the system failure condition is met. When the failure condition of the lane change assistance function is met, in operation S200, the lane change assistance function is transitioned to the failure state. Then, when the failure condition of the lane change assistance function is released, in operation S100,the lane change assistance function state is transitioned to the off state again. In this case, the failure condition of the lane change assistance function may include whether the sensing module (e.g., a front radar, a front camera, a rear side radar, and the like) 200 is out of order, and whether at least one of CAN signals is faulty.

0068The vehicle driving state display device 100 may determine whether the vehicle enters the operation section by determining whether the sensor is normally operated in the off state. When the sensor is normally operated, in operation S300, the vehicle driving state display device 100 may transition the lane change assistance function from the off state to the operation section entrance state.

0069In the operation section entrance state, since the vehicle driving state display device 100 is in a state where the lane change assistance function has already been turned on through the lane change user setting menu (USM), when an object by which it is impossible to activate the lane change assistance function disappears, in operation S301, a lane change operation screen popup window is displayed to confirm again whether the user is willing to change the lane. Thus, when the user presses confirmation in the pop-up window, in operation S400, the state of the lane change assistance function is transitioned to the standby state. Meanwhile, when the user exceeds the time to press confirmation in the pop-up window or turns off the lane change assistance function through the lane change USM, in operation S300, the state of the lane change assistance function is transitioned to the operation section entrance state again.

0070Meanwhile, when the lane change-on operation is performed through the lane change USM in the off state of the lane change assistance function and an object by which it is impossible to activate the lane change assistance function is not sensed, in operation S400, the vehicle driving state display device 100 transitions the state of the lane change assistance function from the operation section entrance state to the standby state. In addition, in operation S400, when the lateral control is turned on and an object by which it is impossible to activate the lane change assistance function is not sensed in the state in which the lane change assistance function is turned on through the lane change USM, the vehicle driving state display device 100 transitions the state of the lane change assistance function from the operation section entrance state to the standby state.

0071In the standby state, in operation S300, the vehicle driving state display device 100 allows the state of the lane change assistance function to return to the operation section entrance state when a lane change USM off operation is performed or an object (e.g., a pedestrian, a cyclist) by which it is impossible to activate the lane change assistance function is sensed.

0072In the standby state, in operation S500, the vehicle driving state display device 100 may determine whether the lane changeable condition is met and may transition the state of the lane change assistance function to the ready state when the lane changeable condition is met. In this case, the lane changeable condition may include whether a lane exists, whether the current vehicle speed is in a lane changeable vehicle speed range, whether the lateral control is being operated, and road condition. The road condition may include whether the lane change assistance function is operable on a road (e.g., a driveway, an expressway, a high speed way, or the like), whether the lane change assistance function is not operable on a road (e.g., a highway exit point, a tunnel, a toll gate, an interchange (IC), a junction change (JC), or the like), whether the curvature of the current road is less than or equal to a specified reference value, and the like. That is, the vehicle driving state display device 100 determines that the lane changeable condition is met in cases where a lane exists, the current speed of the vehicle is in the lane changeable range, the vehicle travels on a road having a curvature equal to or less than a lane change limiting curvature, the lateral control is operated, and it is not a road on which a lane change is impossible within a specified distance in front of the vehicle or at a current vehicle location.

0073In the ready state, in operation S400, the vehicle driving state display device 100 continuously checks the lane changeable condition, and when the lane changeable condition is not met, the state of the lane change assistance function is returned to the standby state again. In this case, the vehicle driving state display device 100 determines that the lane changeable condition is not met when at least one of the lane changeable conditions is not met.

0074In the ready state, in operation S600, the vehicle driving state display device 100 determines whether a user input (e.g., turning on/off of turn signal lamp) occurs and whether the risk of collision exists, and transitions the state of the lane change assistance function to the active state when the user input occurs and there is no risk of collision.

0075In this case, the occurrence of the user input may include a state in which the turn signal lamp is turned on, and the vehicle driving state display device 100 may determine that there is no risk of collision when the collision estimated time (TCC) is greater than or equal to a reference time and a distance from a surrounding vehicle is greater than or equal to a reference distance.

0076When the lane change assistance function is in the active state, the lane change may be performed.

0077In the active state, the vehicle driving state display device 100 determines whether the lane change is completed, and when the lane change is completed, the state of the lane change assistance function is returned to the ready state (S500).

0078In the active state, in operation S700, the vehicle driving state display device 100 determines whether the lane change cancellation condition is met, and transitions the state of the lane change assistance function to the cancel state when the lane change cancellation condition is met. In this case, the lane change cancel condition includes a case which satisfies at least one of cases which includes a case where an emergency light switch is turned on before the vehicle crosses a lane mark, a case where a user setting menu (USM) is turned off before the vehicle crosses a lane mark, a case where a hands-off is sensed before the vehicle crosses a lane mark, a case where a speed of the vehicle deviates from a lane changeable speed before the vehicle crosses a lane mark, a case where a forward collision-avoidance assist (FCA) or a blind-spot collision-avoidance assist (BCA), which is a safety system, is operated before the vehicle crosses a lane mark, a case where a lane mark disappears, a case where the vehicle does not cross a lane mark within a specified period of time after a turn light signal is input, a case where the vehicle crosses a lane mark within the specified period of time after the turn light signal is input, a case where the vehicle does not get out of a lane mark even through a specified period of time elapses after the vehicle crosses the lane mark, a case where a lateral control is released, and a case where collision with a nearby vehicle is expected.

0079In this case, the vehicle driving state display device 100 may determine that the vehicle is in the hands-off state when the driver's steering torque is lower than a hands-off reference torque for a specified time, and may determine that the driver has willingness to operate directly (override) when the driver's steering torque exceeds a reference torque.

0080In the cancel state, the vehicle driving state display device 100 determines whether the lane changeable condition is met or not. In operation S500, the vehicle driving state display device 100 transitions the state of the lane change assistance function to the ready state when the lane changeable condition is met, and, in operation S400, transitions the state of the lane change assistance function to the standby state when the lane changeable condition is not met.

0081As described above, the vehicle driving state display device 100 may determine whether the state transition of the lane changeable condition occurs, based on whether the lane changeable condition is met, whether the lane change cancellation condition is met, whether the lane change is completed, and whether the failure condition of the lane change assistance function is met, and may display the result of determining whether the state transition of the lane change assistance function occurs through the display 130 step by step.

0082Hereinafter, with reference to <figref idref="f0004 f0005 f0006 f0007 f0008 f0009 f0010 f0011">FIGS. 4 to 10</figref>, a display method for each state of the lane change assistance function will be described in detail. However, as an example of the step-by-step notification according to the change in the state of the lane change assistance function, the form of the present disclosure is not limited to those of <figref idref="f0004 f0005 f0006 f0007 f0008 f0009 f0010 f0011">FIGS. 4 to 10</figref> and the step-by-step notification may be performed in various schemes.

0083<figref idref="f0004">FIG. 4</figref> is a table illustrating an example of a method of displaying each lane change assistance function state in some forms of the present disclosure.

0084Referring to <figref idref="f0004">FIG. 4</figref>, the vehicle driving state display device 100 does not display anything when the lane change assistance function is in the off state. <figref idref="f0005">FIG. 5</figref> is a diagram illustrating an example of a case in which the lane change assistance function in some forms of the present disclosure is in the off state, where there is no indication of the lane change assistance function as shown by reference numeral 'A'.

0085When the lane change assistance function is in the standby state, a symbol (icon) indicating the lane change assistance function is displayed in a first color (e.g., white) (visual output). <figref idref="f0006">FIG. 6</figref> is a diagram illustrating an example of a case in which the lane change assistance function in some forms of the present disclosure is in the standby state, where the symbol is turned on as shown by reference numeral 'B'.

0086In addition, the vehicle driving state display device 100 turns on and displays a symbol indicating the lane change assistance function in a second color (e.g., green) when the lane change assistance function is in the ready state. <figref idref="f0007">FIG. 7</figref> is a diagram illustrating an example of a case in which the lane change assistance function in some forms of the present disclosure is in the ready state, where the symbol is turned on as shown by reference numeral 'C'.

0087When the lane change assistance function is in the active state, the vehicle driving state display device 100 turns on and blinks the symbol indicating the lane change assistance function in the second color as in the ready state (visual output). <figref idref="f0008">FIG. 8</figref> is a diagram illustrating an example of a case in which the lane change assistance function in some forms of the present disclosure is in the active state, where the symbol is turned on as shown by reference numeral 'D'.

0088In addition, when the lane change assistance function is in the cancel state, the vehicle driving state display device 100 may turn on and blink the symbol indicating the lane change assistance function in the first color as in the ready state of the lane change assistance function, and may perform the tactile or auditory output together with the visual indication. In this case, the vehicle driving state display device 100 may output the steering wheel haptic, the seat vibration, and the like for the tactile output and output the beep sound, the voice guidance, and the like for the auditory output, so that the user may be informed that the lane change assistance function is the cancel state. In this case, the vehicle driving state display device 100 may perform the visual output and the auditory output, the visual output and the tactile output, or the visual output, the audible output and the tactile output at the same time as soon as the lane change assistance function is transitioned to the cancel state, and may maintain the visual output after the auditory output and the tactile output are performed for a specified time (e.g., 2 seconds). In addition, the vehicle driving state display device 100 may perform blinking in a blinking period of the visual output, which is the same as that in the active state, or more slowly in a blinking cycle having the same visual output as the active state. However, when the lane change assistance function enters the cancel state due to a dangerous situation such as the cancellation of the lateral control, the user may be informed of the dangerous situation by continuously increasing the blinking cycle, and the auditory or tactile output may continue to be performed in the dangerous situation. <figref idref="f0009">FIG. 9A</figref> is a diagram illustrating a case where the lane change assistance function in some forms of the present disclosure is in the cancel state. <figref idref="f0010">FIG. 9B</figref> is a diagram illustrating an example of a popup window displayed for a user when the lane change assistance function in some forms of the present disclosure is in the cancel state, where it may be known that the symbol is turned on and blinked as shown by reference numeral 'E'. When the lane change assistance function is transitioned to the cancel state due to the hands-off of the user, a phrase to induce the user to perform hands-on as shown in <figref idref="f0010">FIG. 9B</figref> may be output after a notification of the cancel state is output as shown in <figref idref="f0009">FIG. 9A</figref>, and the contents shown in <figref idref="f0009">FIGS. 9A</figref> and <figref idref="f0010">9B</figref> may be simultaneously output to the main screen of the display 130.

0089In addition, the vehicle driving state display device 100 may turn on the symbol indicating the lane change assistance function in a third color (e.g., orange) when the lane change assistance function is in the failure state, and may perform the tactile or auditory output together or simultaneously perform the visual, auditory and tactile outputs so that the user is actively informed that the lane change assistance function is in the failure state. In addition, the vehicle driving state display device 100 may perform the visual and tactile outputs, or the visual and auditory outputs immediately after the lane change assistance function is transitioned to the failure state, and then maintain the visual output. In this case, the vehicle driving state display device 100 may perform the tactile and audible outputs for a specified time (e.g., three seconds), and may perform the tactile or auditory output for a longer time than when the lane change assistance function is in the cancel state. <figref idref="f0011">FIG. 10</figref> is a diagram illustrating an example of a case in which the lane change assistance function in some forms of the present disclosure is in the failure state. Thus, as shown by reference numeral 'F', it may be known that the symbol is turned on and blinked.

0090As described above, in some forms of the present disclosure, the state of the vehicle driving assistance function is segmented and displayed so that the user may recognize it at a glance while driving, and the audible and tactile outputs are performed as well as the visual output so that the user may intuitively and quickly ascertain the state of the vehicle driving assistance function.

0091<figref idref="f0012">FIG. 11</figref> is a block diagram illustrating a computer system in some forms of the present disclosure.

0092Referring to <figref idref="f0012">FIG. 11</figref>, a computing system 1000 may include at least one processor 1100, a memory 1300, a user interface input device 1400, a user interface output device 1500, storage 1600, and an interface 1700, which are connected to each other through a bus 1200.

0093The processor 1100 may be a central processing unit (CPU) or a semiconductor device which performs processing for instructions stored in the memory device 1300 and/or the storage 1600. The memory 1300 and the storage 1600 may include various types of volatile or non-volatile storage media. For example, the memory 1300 may include a read only memory (ROM) and a random access memory (RAM).

0094The operations of a method or algorithm described in connection with some forms of the present disclosure disclosed herein may be embodied directly in hardware, in a software module executed by the processor 1100, or in a combination of the two. The software module may reside in a storage medium (that is, the memory 1300 and/or the storage 1600) such as a random access memory (RAM), a flash memory, a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), registers, hard disk, a removable disk, a compact disc-ROM (CD-ROM), etc.

0095An exemplary storage medium is coupled to the processor 1100 such that the processor 1100 may read information from, and write information to, the storage medium. Alternatively, the storage medium may be integrated into the processor 1100. The processor and the storage medium may reside in an ASIC. The ASIC may reside within a user terminal. Alternatively, the processor and the storage medium may reside in the user terminal as individual components.

0096Although some forms of the present disclosure have been described for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the disclosure.

0097The description of the disclosure is merely exemplary in nature and, thus, variations that do not depart from the substance of the disclosure are intended to be within the scope of the disclosure. Such variations are not to be regarded as a departure from the spirit and scope of the disclosure.