Safely navigating on roads through maintaining safe distance from other vehicles
20 claims: 5 independent, 15 dependent
- 1コンピュータシステムにより、車両が走行中の道路の車線の推定位置を提供する車線情報を取得するステップであって、該コンピュータシステムが該車両を自律モードで制御することを特徴とするステップと、 前記コンピュータシステムにより、前記車線情報が利用できないか又は信頼性がないことを判断するステップと、 車線情報が利用できなくなったか又は信頼性がなくなったとの判断に応答して、前記コンピュータシステムが、 少なくとも1つの隣接車両を監視するために、少なくとも1つのセンサーを用いるステップと、 前記車両と前記隣接する少なくとも1つの車両との距離を制御し、少なくともあらかじめ定めた最小距離に維持するよう前記車両を制御するステップと、 を具備する方法。
- 2前記車線情報は、道路の車線区分線、車両の地理的位置、及び、道路のあらかじめ定められた地図のうちの少なくとも1つに基づくことを特徴とする請求項1に記載の方法。
- 3前記車線情報が利用できないか又は信頼性がないことを判断するステップは、車線情報の信頼度があらかじめ定められた閾値以下であることを検出するステップを具備することを特徴とする請求項1に記載の方法。
- 4前記車線情報が利用できないか又は信頼性がないことを判断するステップは、少なくともあらかじめ定められた期間、車線情報の信頼度が閾値より低いことを検出するステップを具備することを特徴とする請求項1に記載の方法。
- 5前記少なくとも1つの隣接車両は 、 第1の隣接車両 と 第2の隣接車両 とからなり 、 前記車両と前記少なくとも1つの隣接車両との距離を少なくともあらかじめ定めた最小距離に維持することは、前記車両と前記第1の隣接車両との間の第1の距離及び前記車両と前記第2の隣接車両との間の第2の距離の両方を最大化するステップを具備し、前記第1の距離と前記第2の距離の各々は前記あらかじめ定めた最小距離以上であることを特徴とする請求項1に記載の方法。
- 6少なくとも1つのセンサーを用いて少なくとも1つの隣接車両を監視するステップは、前記少なくとも1つの隣接車両までの 、相異なる時刻における、 少なくとも第1の距離及び第2の距離を監視する少なくとも1つのセンサーを用いるステップを具備し、前記方法は、 前記第1の距離及び第2の距離に基づき、前記少なくとも1つの隣接車両の第1の相対位置と第2の相対位置とを判断するステップと、 前記第1の相対位置及び第2の相対位置に基づき、前記少なくとも1つの隣接車両の進路を推定するステップと、 前記推定した進路に基づき、更新された前記車線の推定位置を判断するステップと、 をさらに具備することを特徴とする請求項1に記載の方法。
- 7前記車両と前記隣接する少なくとも1つの車両との距離を少なくともあらかじめ定めた最小距離に維持するよう前記車両を制御するステップは、 前記少なくとも1つの隣接車両の速度を監視するために速度センサーを用いるステップと、 前記少なくとも1つの隣接車両の速度より遅くなるよう前記車両の速度を変更するステップと、 を具備することを特徴とする請求項1に記載の方法。
- 8コンピュータシステムにより、更新された前記車線の推定位置を提供する更新された車線情報を周期的に取得するステップと、 コンピュータシステムにより、前記更新された車線情報は信頼できるようになったと判断するステップと、 前記更新された車線情報は信頼できるようになったとの判断に応答して、前記車両と前記少なくとも1つの隣接車両との距離を少なくとも前記あらかじめ定めた最小距離に維持するための制御をやめるステップと、 をさらに具備することを特徴とする請求項1に記載の方法。
- 9前記更新された車線情報は信頼できるようになったと判断するステップは、前記更新された車線情報の信頼性があらかじめ定められた閾値より高いことを検出するステップをさらに具備することを特徴とする請求項8に記載の方法。
- 10自律モードで運転するよう構成された車両であって、該車両は、 少なくとも1つのセンサーと、 少なくとも1つのプロセッサーと、 あらかじめ定められた最小距離、及び、 前記車両が走行する道路の推定車線位置を提供する車線情報を取得し、 前記車線情報が利用できなくなったか又は信頼性がなくなったとの判断を行い、 前記車線情報が利用できなくなったか又は信頼性がなくなったとの判断に応答して、 前記少なくとも1つの隣接車両を監視するために、前記少なくとも1つのセンサーを用い、 前記車両と前記少なくとも1つの隣接車両との間を少なくともあらかじめ定められた最小距離に維持するために前記車両を制御するための、 前記少なくとも1つのプロセッサーにより実行可能な命令を具備するデータ記憶装置と、を具備することを特徴とする車両。
- 11前記少なくとも1つのセンサーは、レーザーを具備することを特徴とする請求項10に記載の車両。
- 12前記少なくとも1つのセンサーは、道路上の車線区分線を検出するよう構成された少なくとも1つの車線区分線センサーと、前記車両の地理的位置を検出するよう構成された位置センサーとを具備することを特徴とする請求項10に記載の車両。
- 13前記車線情報は、前記道路上の車線区分線、及び、前記車両の地理的位置のうちの少なくとも1つに基づくことを特徴とする請求項12に記載の車両。
- 14前記データ記憶装置は、前記道路のあらかじめ定められた地図をさらに具備することを特徴とする請求項10に記載の車両。
- 15前記車線情報は、前記あらかじめ定められた地図に基づくことを特徴とする請求項14に記載の車両。
- 16前記少なくとも1つの隣接車両の速度を検出するよう構成された速度センサーをさらに具備することを特徴とする請求項10に記載の車両。
- 17前記車両と前記隣接する少なくとも1つの車両との距離を少なくともあらかじめ定めた最小距離に維持するために、 前記少なくとも1つの隣接車両の速度より遅くなるよう前記車両の速度を変更するよう構成されたスロットルをさらに具備することを特徴とする請求項10に記載の車両。
- 18計算装置に機能を実行させるために、該計算装置により実行可能な命令を記憶させる持続性のあるコンピュータ読み取り可能記憶媒体であって、該機能は、 車両が走行中の道路の車線位置の予測を行う車線情報を取得する機能と、 前記車線情報が利用できないか又は信頼性がないことを判断する機能と、 車線情報が利用できなくなったか又は信頼性がなくなったとの判断に応答して、 少なくとも1つの隣接車両を監視するために、少なくとも1つのセンサーを用いる機能と、 前記車両と前記隣接する少なくとも1つの車両との距離を少なくともあらかじめ定めた最小距離に維持するよう前記車両を制御する機能と、 を具備することを特徴とする持続性のあるコンピュータ読み取り可能記憶媒体。
- 19少なくとも1つのセンサーを用いて少なくとも1つの隣接車両を監視する機能は、 前記少なくとも1つの隣接車両までの 、相異なる時刻における、 少なくとも第1の距離及び第2の距離を監視する少なくとも1つのセンサーを用いる機能を具備し、前記機能は、 前記第1の距離及び第2の距離に基づき、前記少なくとも1つの隣接車両の第1の相対位置と第2の相対位置とを判断する機能と、 前記第1の相対位置及び第2の相対位置に基づき、前記少なくとも1つの隣接車両の進路を推定する機能と、 前記推定した進路に基づき、更新された前記車線の推定位置を判断する機能と、 をさらに具備することを特徴とする請求項18に記載の持続性のあるコンピュータ読み取り可能記憶媒体。
- 20前記機能は、 更新された前記車線の推定位置を提供する更新された車線情報を周期的に取得する機能と、 前記更新された車線情報は信頼できるようになったと判断する機能と、 前記更新された車線情報は信頼できるようになったとの判断に応答して、前記車両と前記少なくとも1つの隣接車両との距離を少なくとも前記あらかじめ定めた最小距離に維持するための制御をやめる機能と、 をさらに具備することを特徴とする 請求項18又は請求項19 に記載の持続性のあるコンピュータ読み取り可能記憶媒体。
Independent claims20
122 paragraphs, as filed
0001Some vehicles are configured to drive in an autonomous mode in which the vehicle travels with little or no input from the driver. These vehicles typically include one or more sensors that are configured to detect surrounding information. The vehicle can use the detected information to travel in the environment. For example, if the sensor detects that the vehicle is approaching an obstacle, the vehicle will bypass the obstacle.
0002According to one form, a system in which a computer system acquires lane information that provides an estimated position of the lane of the road on which the vehicle is traveling, and the computer system controls the vehicle in an autonomous mode. An exemplary method is disclosed that includes. This exemplary method further comprises a computer system in response to the step of determining that the lane information is unavailable or unreliable and the determination that the lane information is no longer available or unreliable. The system controls the vehicle to maintain at least a predetermined minimum distance between the vehicle and the at least one adjacent vehicle and a step using at least one sensor to monitor at least one adjacent vehicle. Including steps to do.
0003According to another form, an exemplary persistent computer-readable medium is disclosed that stores instructions that can be executed by the arithmetic unit for causing the arithmetic unit to perform the functions of the exemplary method described above.
0004According to yet another embodiment, an exemplary vehicle including at least one sensor, at least one processor, and a data storage device with predetermined minimum distances and instructions is disclosed. By executing these instructions by at least one processor, lane information that provides the estimated lane position of the road on which the vehicle travels is acquired, and it is determined that this lane information is no longer available or unreliable. In response to the determination that this lane information is no longer available or unreliable, at least one sensor is used to monitor at least one adjacent vehicle and between the vehicle and the at least one adjacent vehicle. The vehicle can be controlled to maintain at least a predetermined minimum distance.
0005These, along with other features, advantages, and alternatives, will become apparent to those skilled in the art by referring to the appropriate attachments and reading the detailed description below.
0006<figref num="1">It is a flowchart which shows the exemplary method by one Embodiment.</figref><figref num="2">An exemplary embodiment of an exemplary method, according to one embodiment, is shown.</figref><figref num="3">An exemplary embodiment of an exemplary method, according to one embodiment, is shown.</figref><figref num="4A">An exemplary embodiment of an exemplary method, according to one embodiment, is shown.</figref><figref num="4B">An exemplary embodiment of an exemplary method, according to one embodiment, is shown.</figref><figref num="4C">An exemplary embodiment of an exemplary method, according to one embodiment, is shown.</figref><figref num="5A">An exemplary embodiment of an exemplary method, according to one embodiment, is shown.</figref><figref num="5B">An exemplary embodiment of an exemplary method, according to one embodiment, is shown.</figref><figref num="5C">An exemplary embodiment of an exemplary method, according to one embodiment, is shown.</figref><figref num="6">An exemplary vehicle according to one embodiment is shown.</figref><figref num="7">FIG. 6 is a simplified block diagram of an exemplary vehicle according to one embodiment.</figref><figref num="8">FIG. 6 is a simplified block diagram of an exemplary computer program product according to one embodiment.</figref>
0007In the following detailed description, various forms and functions of the disclosed systems and methods will be described with reference to the reference drawings. In drawings, similar symbols usually indicate similar components unless otherwise noted. The embodiments described herein for the illustrated systems and methods are not intended to be limiting. It is clear that the disclosed systems and methods can be arranged and combined in a variety of different configurations, all of which are considered herein.
0008The vehicle can include a computer system configured to control the vehicle in autonomous mode. For this purpose, a computer system can be configured to acquire lane information that provides an estimated position of the lane of the road on which the vehicle travels. Lane information can be based, for example, on the lane markings of the road, the geographical location of the vehicle, and / or a predetermined map of the road. Other forms of lane information are also possible.
0009At some point, the vehicle can determine that lane information is no longer available or reliable. For example, a vehicle may no longer be able to detect lane markings on the road, a vehicle may detect lane marking inconsistencies on the road, and a vehicle may no longer detect the geographical location of the vehicle. It may not be possible to determine and / or the vehicle may not be able to access a predetermined map of the road. Other examples are possible.
0010In response to the determination that lane information is no longer available or unreliable, the computer system monitors at least one adjacent vehicle, such as an adjacent vehicle in an adjacent lane or an adjacent vehicle behind the vehicle. At least one sensor can be used for this. The computer system can then be controlled to maintain the distance between the vehicle and at least one adjacent vehicle at at least a predetermined minimum distance.
0011In this way, the vehicle can avoid a collision with at least one adjacent vehicle, even if the lane information that estimates the position of the lane on the road becomes unreliable.
0012FIG. 1 is a flowchart showing an exemplary method 100 according to one embodiment.
0013Method 100, shown in FIG. 1, represents, for example, an embodiment of a method that can be used in the vehicles described herein. Method 100 may include one or more of the operations, functions, or actions shown in one or more of blocks 102-106. Although the blocks are shown in a series of orders, these blocks can be executed in parallel and / or in a different order than described herein. Also, the various blocks can be combined into fewer blocks, split into additional blocks, and / or removed according to preferred embodiments.
0014In addition, for Method 100 and the other processes and methods disclosed herein, the flowchart shows the function and operation of one possible embodiment of the current embodiment. In this regard, each block can represent a module, segment, or part of each program code and contains one or more instructions that can be executed by a processor performing a logical function or step in processing. The program code can be stored on a computer-readable medium of any format, for example, a storage device including a disk or hard drive. Computer-readable media can include persistent computer-readable media such as computer-readable media that store data for short periods of time, such as register memory, processor cache, and random access memory (RAM). .. Computer-readable media include, for example, read-only memory (ROM), optical or magnetic disks, and secondary or persistent long-term storage devices such as compact disk read-only memory (CD-ROM). , A medium of sustainability can also be included. Computer-readable media can also include other volatile or non-volatile storage systems. As a computer-readable medium, for example, a computer-readable storage medium, a tangible storage device, or other product can be considered.
0015In addition, for Method 100 and the other processes and methods disclosed herein, each block may represent a circuit configured to perform a specific logical function of the process.
0016Method 100 begins at block 102, where a computer system configured to control the vehicle in autonomous mode obtains lane information that provides an estimated position of the lane of the road on which the vehicle is traveling. Lane information can be provided in many formats.
0017In some embodiments, the lane information can include a lane divider on the road, and the computer system can use one or more sensors to detect this lane divider. For example, a computer system can take an image of a road using an imaging device, analyze this image, and predetermine the color, shape, and / or brightness of the lane divider. Lane divisions can be detected by examining whether the color, shape, and / or brightness is not maintained. As another example, a computer system radiates a laser onto a road and analyzes the reflected light from the road to see if the reflected light from the lane dividing line has an intensity similar to a predetermined intensity. The line can be detected. Other examples are possible. In any case, once the computer system detects the lane dividing line, the computer system estimates the position of the lane based on the detected lane dividing line.
0018In other embodiments, the lane information may include the geographical location of the vehicle and a predetermined map of the road. The computer system can determine the geographic location of the vehicle, for example, by asking the location server for the geographic location of the vehicle. Alternatively, if a predetermined map shows the geographical location of at least two objects near the vehicle, the computer system may use, for example, a laser rangefinder or a lidar (LIDAR) unit to at least near the vehicle. The distance between two objects can be estimated and triangulation can be used to determine the geographical location of the vehicle. Other examples are possible. In any case, the computer system then identifies the vehicle's geographic location on a predetermined map and determines the lane position relative to the vehicle's geographic location.
0019In yet another embodiment, the lane information may include a leading vehicle in front of a vehicle in the lane. The computer system can, for example, use a laser rangefinder and / or a LIDAR unit to estimate the course of the leading vehicle. Other examples are possible. Once the computer system estimates the course of the leading vehicle, the computer system can estimate the position of the lane based on the estimated course. For example, a computer system can estimate the position of a lane, including the estimated course (eg, extending to both sides of the estimated course by half the predetermined lane width). Other examples are possible.
0020Lane information can be provided in other formats.
0021At block 104, the computer system can determine that the lane information is unavailable or unreliable. For example, in an embodiment in which the lane information includes a lane divider, the computer system detects that there is no lane divider or (eg, because the lane divider is worn out or removed for construction). When it is difficult and / or when there are conflicting lane dividers (eg, because the lane dividers have been repainted for construction), it can be determined that the lane information is unavailable or unreliable. .. As another example, in an embodiment in which the lane information includes the geographic location of the vehicle, the computer system determines that the lane information is unavailable or unreliable when the computer system becomes unable to communicate with the location server. can do. As yet another example, in an embodiment in which the lane information includes a predetermined map of the road, the computer system becomes available only when the map of the road no longer exists or only an incomplete map of the road is available. At that time, it can be determined that the lane information is not available or the reliability is lost. As yet another example, in an embodiment in which the lane information includes a leading vehicle, the computer system may be used when the leading vehicle is too far away or (eg, due to a lane change, sharp turn, etc. of the leading vehicle). ) When the leading vehicle takes a course that cannot be estimated, it can be judged that the lane information is not available or the reliability is lost. Other examples are possible.
0022In some embodiments, the computer system can hold a predetermined threshold for lane information, and the reliability of the lane information (eg, how much the computer system relies on whether the lane information is reliable). When the computer system detects that the lane information is less than or equal to a predetermined threshold, the computer system can determine that the lane information is not available or is unreliable. In some embodiments, the computer system can also retain a predetermined period of time as lane information, and the computer states that the reliability of the lane information is below the threshold, at least for a predetermined period of time. When the system detects it, the computer system can determine that the lane information is unavailable or unreliable.
0023At block 106, the computer system may use at least one sensor to monitor at least one adjacent vehicle in response to the determination that lane information is unavailable or unreliable. The at least one adjacent vehicle may include, for example, an adjacent vehicle in a lane adjacent to the lane in which the vehicle is traveling. As another example, at least one adjacent vehicle may include a vehicle adjacent behind the vehicle in the lane in which the vehicle is traveling. As yet another example, at least one adjacent vehicle is a first adjacent vehicle and a second adjacent vehicle, each of which is in a lane adjacent to the lane in which the vehicle is traveling, or a vehicle. It can include a first adjacent vehicle and a second adjacent vehicle, such as being either behind the vehicle in the lane in which the vehicle is traveling.
0024At block 106, further, in response to the determination that lane information is unavailable or unreliable, the computer system sets the distance between the vehicle and at least one adjacent vehicle to at least a predetermined distance. The vehicle can be controlled to maintain. The predetermined distance can be, for example, a distance determined to be a safe distance and / or a distance substantially equal to the difference between the predetermined lane width and the width of the vehicle. Other predetermined distances are also possible.
0025In order to maintain the distance between the vehicle and at least one adjacent vehicle at least a predetermined distance, a computer system is attached to the vehicle to monitor the distance between the vehicle and at least one adjacent vehicle. At least one sensor can be used continuously or periodically. The computer system can monitor the distance between the vehicle and at least one adjacent vehicle, for example, using a laser rangefinder and / or a lidar unit. If the distance between the vehicle and at least one adjacent vehicle is less than a predetermined distance, a computer to maintain the distance between the vehicle and at least one adjacent vehicle at least a predetermined distance. The system can move the vehicle away from at least one adjacent vehicle.
0026In some embodiments, in addition to maintaining a distance between the vehicle and at least one adjacent vehicle at at least a predetermined distance, the computer system further provides the vehicle with at least one adjacent vehicle. The distance between them can be maintained within a predetermined range of predetermined distances. In these embodiments, the computer system if the distance between the vehicle and at least one adjacent vehicle becomes too long (eg, no longer within a predetermined range of predetermined distances). Can move the vehicle closer to at least one adjacent vehicle. In this way, for example, it is possible to prevent the vehicle from being so far away from the adjacent vehicle that the vehicle enters the lane opposite to the side of the adjacent vehicle.
0027As mentioned above, in some embodiments, the at least one vehicle may include a first adjacent vehicle and a second adjacent vehicle. In such an embodiment, maintaining the distance between the vehicle and at least one adjacent vehicle is such that the first distance between the vehicle and the first adjacent vehicle and the vehicle and the second adjacent vehicle It may involve maximizing both of the second distances between and (eg, keeping the vehicle approximately halfway between the first and second adjacent vehicles). .. Each of the first distance and the second distance can be at least a predetermined distance.
0028In some embodiments, in addition to maintaining the distance between the vehicle and at least one adjacent vehicle at at least a predetermined distance, the computer system may determine the update of the estimated lane position. it can. For this purpose, at least one sensor can be used to monitor the first distance to at least one adjacent vehicle and the second distance to at least one vehicle. Based on the first distance and the second distance, the computer system can determine the first relative position and the second relative position (eg, in relation to the vehicle) of at least one adjacent vehicle. Based on the first relative position and the second relative position, the computer system can estimate the course of at least one adjacent vehicle. The computer system can then use this estimated course to determine the estimated position of the updated lane. For example, in an embodiment in which at least one adjacent vehicle is traveling in a lane adjacent to the lane in which the vehicle is traveling, the computer system (eg, the lane is predetermined from, for example, the estimated course). It is possible to determine the estimated position of a lane that is substantially parallel to the estimated lane (by defining the lane shifted by the lane width as the center and expanding it to both sides of the lane by half the predetermined lane width). As another example, in an embodiment in which at least one adjacent vehicle is running behind the vehicle in the lane in which the vehicle is running, the computer system extrapolates the estimated course (eg, with the same curvature). The estimated position of the lane can be determined. Other examples are possible.
0029In some embodiments, the computer system can further use speed sensors to monitor the speed of at least one adjacent vehicle, changing the speed of the vehicle to be slower than the speed of at least one adjacent vehicle. can do. This allows at least one adjacent vehicle to overtake the vehicle. Once at least one adjacent vehicle has overtaken the vehicle, the at least one adjacent vehicle is either the lane adjacent to the lane in which the vehicle is traveling or the leading vehicle in front of the vehicle in the lane in which the vehicle is traveling. It can be a leading vehicle, and the computer system can estimate the position of the lane on the road based on the estimated course of the leading vehicle, as described above.
0030In some embodiments, monitoring of at least one adjacent vehicle may be initiated only upon determination that the lane information is unavailable or unreliable. In these embodiments, the computer system can rely solely on lane information to estimate the position of the lane before it is determined that the lane information is unavailable or unreliable. In other embodiments, the computer system can also monitor at least one adjacent vehicle before it is determined that the lane information is unavailable or unreliable. In these embodiments, the distance to at least one adjacent vehicle can be additionally used to estimate the position of the lane in which the vehicle is traveling. For example, if at least one adjacent vehicle is in a lane adjacent to the lane in which the vehicle is traveling, the computer system can determine that the lane does not extend to this at least one adjacent vehicle. .. As another example, if at least one adjacent vehicle is traveling behind the vehicle in the lane in which the vehicle is traveling, the computer system can determine that there is at least one adjacent vehicle in the lane. .. Other examples are possible. Alternatively, in these embodiments, the computer system simply has at least one to avoid a collision with at least one adjacent vehicle before it is determined that the lane information is unavailable or unreliable. The distance to two adjacent vehicles can be used.
0031Further, in some embodiments, once the vehicle begins monitoring at least one adjacent vehicle, the computer system ceases to use lane information to estimate the position of the lane in which the vehicle is traveling. be able to. In these embodiments, the computer system simply distances to at least one adjacent vehicle in order to avoid collision with at least one adjacent vehicle until lane information becomes available or reliable. Can be used. For example, a computer system can periodically attempt to obtain updated lane information. Once the computer system determines that the lane information is available or reliable, the lane information is available or reliable, and the computer system relies on the re-estimated lane position. You will have little (or no) confidence in the distance to at least one adjacent vehicle. For example, when the computer system determines that the reliability of the updated lane information is higher than a predetermined threshold value, the computer system can determine that the updated lane information is reliable. The predetermined threshold value may be the same value as the predetermined threshold value described above, or may be a different value.
0032In another embodiment, however (eg, if lane information is available but unreliable), once the vehicle has begun monitoring at least one adjacent vehicle, the computer system will be in the lane in which the vehicle is traveling. Continue to use lane information to estimate position, but with little confidence in the estimated lane position and more confidence in the distance to this at least one adjacent vehicle to avoid collisions with at least one adjacent vehicle. Can be done. Similar to the embodiments described above, the computer system can attempt to acquire periodically updated lane information. Once the computer system determines that lane information is available or reliable, the computer system relies on the re-estimated lane position (or only on this lane position) and at least one adjacency. The distance to the vehicle is almost (or not) reliable.
0033For illustrative purposes, many exemplary embodiments of Method 100 are described in the context of FIGS. 2-5B. However, as a matter of course, the exemplary embodiments are for explanatory purposes only and do not imply limitation. Other exemplary embodiments are also possible.
0034FIG. 2 shows an exemplary embodiment of an exemplary method, according to one embodiment. As shown in FIG. 2, vehicle 202 is traveling in lane 200 on the road. Vehicle 202 has a computer system configured to control the vehicle in autonomous mode (not shown). For this purpose, vehicle 202 can use lane information such as lane dividers to estimate the position of lane 200 on the road.
0035As shown, vehicle 202 includes sensor 204. The sensor 204 can include, for example, an imaging device, a laser rangefinder, and / or a LIDAR unit. It is also possible to include other sensors. The vehicle 202 can use the sensor 204 to acquire lane information about the lane 200. For example, vehicle 202 can use the sensor 204 to detect lane markings on the road, as described above.
0036At some point, lane information can be unreliable. For example, as shown in the figure, the lane dividing lines 206A and 206B are inconsistent. This may be the result of on-site work, for example, to reposition lane 200. Due to the contradiction of the lane dividing lines 206A and 206B, the vehicle 202 can reduce the reliability of the lane information, and therefore it can be determined that the lane information is unreliable.
0037In response to the determination that the lane information is unreliable, the vehicle 202 monitors the adjacent vehicle 208 traveling in the adjacent lane 214, as indicated by the shaded triangle 210. Alternatively, in some embodiments, another sensor (not shown) can be used. In particular, the vehicle 202 can monitor the distance 212 between the vehicle 202 and the adjacent vehicle 208 in order to maintain the distance 212 at least at a predetermined distance. For this purpose, when the distance 212 is less than or equal to a predetermined distance, the vehicle 202 moves away from the adjacent vehicle 208 until the distance 212 is again greater than the predetermined distance.
0038While vehicle 202 is monitoring distance 212, vehicle 202 can periodically receive updated lane information. At some point, the vehicle 202 can determine that the updated lane information is reliable. For example, lane dividing lines 206A and 206B may merge in front of the road, and there may be no contradiction in the lane dividing lines. Other examples are possible. Once the vehicle 202 determines that the updated lane information is reliable, the vehicle 202 uses the updated lane information to estimate the updated position of the lane 200. In addition, once the vehicle 202 determines that the updated lane information is reliable, the vehicle 202 may or may not continue to monitor between the vehicle 202 and the adjacent vehicle 208 as described above.
0039In the exemplary embodiment described in relation to FIG. 2, the vehicle monitors the distance to only one adjacent vehicle, whereas in other exemplary embodiments, it will be described below in relation to FIG. As such, a vehicle can monitor the distance to two or more vehicles.
0040FIG. 3 shows an exemplary embodiment of an exemplary method according to one embodiment. As shown in FIG. 3, vehicle 302 is traveling in lane 300 on the road. Vehicle 302 includes a computer system (not shown) configured to control the vehicle in autonomous mode. For this purpose, vehicle 302 can use lane information such as lane dividers to estimate the position of lane 300 on the road.
0041As shown, vehicle 302 includes a first sensor 304 and a second sensor 306. Each of the first sensor 304 and the second sensor 306 can include, for example, an imaging device, a laser rangefinder, and / or a LIDAR unit. Other sensors can also be included. The vehicle 302 can use the first sensor 304 and the second sensor 306 to acquire lane information about the lane 300. For example, the vehicle 304 can use the first sensor 304 and the second sensor 306 to detect the lane dividing line on the road as described above.
0042At some point, lane information can be unreliable. For example, as shown in the figure, the vehicle 302 can detect the lane dividing line 308 using the first sensor 304, while the lane dividing line cannot be found and the second sensor 306 can detect the lane dividing line. It may not be possible. This may be the result, for example, that the lane dividers have disappeared over time. Since the lane dividing line is eliminated, the vehicle 302 can reduce the reliability of the lane information, and therefore it can be determined that the lane information is no longer reliable.
0043In response to the determination that the lane information has become unreliable, vehicle 302 monitors the first adjacent vehicle 310 in the first adjacent lane 322, as shown by the shaded triangle 312. Sensor 304 (or, in some embodiments, another sensor (not shown)) can be used. In particular, the vehicle 302 can monitor the first distance 314 between the vehicle 302 and the first adjacent vehicle 310 in order to maintain the first distance 314 at least at a predetermined distance. For this purpose, when the first distance 314 is less than or equal to a predetermined distance, the vehicle 302 will start from the first adjacent vehicle 310 until the first distance 314 is again greater than the predetermined distance. Move away.
0044In addition, the vehicle 302 has a second sensor 306 (or some embodiments) that monitors the second adjacent vehicle 316 in the second adjacent lane 324, as indicated by the shaded triangle 318. Then, another sensor (not shown) can be used. In particular, the vehicle 302 can monitor the second distance 320 between the vehicle 302 and the second adjacent vehicle 316 in order to maintain the second distance 320 at least at a predetermined distance. For this purpose, when the second distance 320 is less than or equal to the predetermined distance, the vehicle 302 will start from the second adjacent vehicle 316 until the second distance 320 is again greater than the predetermined distance. Move away.
0045Alternatively or additionally, the vehicle 302 can use the first sensor 304 and the second sensor 306 to monitor the first distance 314 and the second distance 320, respectively. The vehicle 302 can be controlled to maximize each of the first distance 314 and the second distance 320 while keeping each of the distance 314 and the second distance 320 above a predetermined distance. As a result, vehicle 302 can remain approximately halfway between the first adjacent vehicle 310 and the second adjacent vehicle 316, thereby colliding with either the first adjacent vehicle 310 or the second adjacent vehicle 316. You can avoid doing it.
0046While vehicle 302 is monitoring the first distance 314 and the second distance 320, vehicle 302 can receive periodic updated lane information. At some point, vehicle 302 may determine that the updated lane information is reliable. For example, in front of the road, the disappearing lane dividing line may be repaired so that the second sensor 306 can detect the lane dividing line. Other examples are possible. Once the vehicle 302 determines that the updated lane information is reliable, the vehicle 302 can use the updated information to estimate the updated position of the lane 300. In addition, once the vehicle 302 determines that the updated lane information is reliable, the vehicle 302 may or may not continue to monitor the first distance 314 and the second distance 320.
0047In some embodiments, in addition to monitoring the distance between the vehicle and the adjacent vehicle to avoid collision with the adjacent vehicle, the vehicle is the distance between the vehicle and the adjacent vehicle to estimate the course of the adjacent vehicle. Can be used, and this estimated course can be used to determine the updated estimated position of the lane.
00484A-4C show exemplary embodiments of the exemplary method, according to one embodiment. As shown in FIG. 4A, vehicle 402 is traveling in lane 400 on the road. Vehicle 402 includes a computer system (not shown) configured to control the vehicle in autonomous mode. To this end, vehicle 402 can use lane information, such as lane dividers, to estimate the position of lane 400 on the road.
0049As shown, vehicle 402 includes sensor 404. The sensor 404 includes, for example, an imaging device, a laser rangefinder, and / or a LIDAR unit. Other sensors can also be included. The vehicle 402 can use the sensor 404 to acquire lane information about the lane 400. For example, vehicle 402 can use sensor 404 to detect lane markings on the road, as described above.
0050At some point, lane information can be unreliable. For example, as shown in the figure, the lane dividing line may disappear so that the sensor 404 cannot detect the lane dividing line. This may be the result of, for example, the lane dividing line disappearing with the passage of time. Since the lane dividing line is eliminated, the vehicle 402 can reduce the reliability of the lane information, and therefore it can be determined that the lane information is no longer reliable.
0051In response to the determination that the lane information has become unreliable, the vehicle 402 has a sensor 404 (or some implementation) that monitors the adjacent vehicle 406 in the adjacent lane 422, as indicated by the shaded triangle 408. In this form, another sensor (not shown) can be used. In particular, the vehicle 402 can monitor the first distance 410 between the vehicle 402 and the adjacent vehicle 406 in order to maintain the first distance 410 at least at a predetermined distance. In addition, as indicated by the asterisks, the first distance 410 (and, in some embodiments, the orientation of the sensor 404) is used to determine the first relative position 412 of the adjacent vehicle 406. be able to.
0052The vehicle 402 can then use the sensor 404 to further monitor the second distance 414 between the vehicle 402 and the adjacent vehicle 406, at least in advance of the second distance 414, as shown in FIG. 4B. It can be maintained at a fixed distance. In addition, as indicated by the asterisks, a second distance 414 (and, in some embodiments, the orientation of the sensor 404) is used to determine the second relative position 416 of the adjacent vehicle 406. be able to.
0053Based on the first relative position 412 and the second relative position 416 of the adjacent vehicle 406, the vehicle 402 is adjacent, as shown in FIG. 4C (the adjacent vehicle 406 is not shown here for clarity). The course 418 of vehicle 406 can be estimated. For example, vehicle 402 can extrapolate (eg, assume a constant curvature) course 418 from a first relative position 412 and a second relative position 416. Other examples are possible.
0054Based on the estimated course 418, vehicle 402 can determine the updated estimated position of lane 400. For example, it can be determined that the vehicle 402 can determine the center of the lane 400 on the lane 420 deviated from the estimated lane 418 by a predetermined lane width, and is predetermined on both sides of the lane 420. It can be extended to both sides of the course by half the width of the lane. Other examples are possible.
0055Only the first and second distances 410 and 414 and the first and second relative positions 412 and 416 have been described above, but in other embodiments, the vehicle 402 determines further distances and relative positions. can do. The added distances and relative positions may, in some cases, improve the accuracy of the estimated track 418, as well as the accuracy of the updated estimated position in lane 400.
0056The vehicle 402 monitors the first and second distances 410 and 414 and the first and second relative positions 412 and 416, while the vehicle 402 also periodically receives updated lane information. At some point, vehicle 402 can determine that the updated lane information is reliable. For example, in front of a road, a missing lane divider may have been repaired so that the sensor 404 can detect the lane divider. Other examples are possible. Once the vehicle 402 determines that the updated lane information is reliable, the vehicle 402 can estimate the updated position of the lane 400 using the updated information and, in some cases, the estimated course 418. .. In addition, once the vehicle 402 determines that the updated lane information is reliable, the vehicle 402 may or may not continue to monitor the distance to the adjacent vehicle 406 and the relative position of the adjacent vehicle 406.
0057In some embodiments, in addition to monitoring the distance to the adjacent vehicle and determining the updated estimated position of the lane, the vehicle changes the speed of the vehicle so that the adjacent vehicle can overtake the vehicle. can do. Once the adjacent vehicle overtakes the vehicle, the vehicle can use the adjacent vehicle as the leading vehicle, as described above. Adjacent vehicles can provide more useful lane information as a leading vehicle than as an adjacent vehicle, which improves the accuracy of the estimated position of the vehicle in the lane.
00585A-5B show exemplary embodiments of the exemplary method, according to one embodiment. As shown in FIG. 5A, vehicle 502 is traveling in lane 500 on the road. Vehicle 502 includes a computer system (not shown) configured to control the vehicle in autonomous mode. For this purpose, vehicle 502 can use lane information such as lane dividers to estimate the position of lane 500 on the road.
0059As shown, vehicle 502 includes a first sensor 504. The first sensor 504 can include, for example, an imaging device, a laser rangefinder, and / or a LIDAR unit. Other sensors are also possible. The vehicle 502 can use the first sensor 504 to obtain lane information about the lane 500. For example, the vehicle 502 can use the first sensor 504 to detect a lane dividing line on the road, as described above.
0060At some point, lane information can become unreliable. For example, as shown, the lane divider 506 may be thinned or disappeared somewhere along the road. This may be the result of, for example, the lane dividing line 506 disappearing with the passage of lane dividing line time. Since the lane dividing line 506 is gone, the vehicle 502 can reduce the reliability of the lane information, and therefore it can be determined that the lane information is no longer reliable.
0061In response to the determination that the lane information is no longer reliable, the vehicle 502 is the first sensor 504 (or how many) that monitors the adjacent vehicle 508 in the adjacent lane 514, as indicated by the shaded triangle 510. In that embodiment, another sensor (not shown) can be used. In particular, the vehicle 502 can monitor this distance 512 in order to maintain the distance 512 between the vehicle 502 and the adjacent vehicle 08 at least at a predetermined distance as described above.
0062In addition to monitoring the distance 512, vehicle 502 can additionally monitor the speed of adjacent vehicle 508. For this purpose, the vehicle 502 can use, for example, a second sensor 514 including a radar (RADAR) unit. Other sensors are also possible. The vehicle 502 can then change the speed of the vehicle 502 so that the speed is slower than that of the adjacent vehicle 508 so that the adjacent vehicle can overtake the vehicle 502, as shown in FIG. 5B.
0063Once the adjacent vehicle 508 overtakes the vehicle 502, the adjacent vehicle 508 can become the leading vehicle 508, and the vehicle 502 can estimate the course of the leading vehicle 508 as described above. Once the vehicle 502 estimates the course of the leading vehicle 508, the vehicle 502 can estimate the position of the lane 500 based on this estimated course. For example, the vehicle 502 can estimate the position of the lane to include the estimated course (eg, by extending it to both sides of the estimated course by half the predetermined lane width). Other examples are possible.
0064The exemplary embodiments described above have focused on lane information that includes only lane dividers, but as described above, of course, other embodiments that include the geographical location of the vehicle or a predetermined map of the road. Lane information is also possible. For example, instead of or in addition to determining that the lane dividers on the road have disappeared and / or are inconsistent, the vehicle (eg, because the vehicle cannot communicate with the location server). ) It can be determined that the geographical location of the vehicle cannot be determined, and the vehicle does not have a predetermined map (or the predetermined map is inadequate). Yes, and / or the vehicle can be determined to have no leading vehicle ahead. Other examples are possible.
0065Details of a system capable of carrying out exemplary embodiments of the above exemplary methods will be described below. In general, exemplary systems can be implemented in-vehicle or in the form of a vehicle. Vehicles include, for example, automobiles, passenger cars, trucks, motorcycles, buses, boats, planes, helicopters, lawn mowers, earth movers, snowmobiles, RV cars, amusement park vehicles, farm equipment, construction machinery, trams, golf carts. , Trains, and trams can be in many shapes. Other vehicles are also possible.
0066In addition, other exemplary systems can take the form of persistent computer-readable media that store program instructions that can be executed by at least one processor that performs the functions described herein. An exemplary system can also take the form of a vehicle containing such a persistent computer-readable medium containing such program instructions or the form of a partial system of the vehicle.
0067FIG. 6 shows an exemplary vehicle 600 according to one embodiment. In particular, FIG. 6 shows a right side view, a front view, a rear view, and a top view of the vehicle 600. Vehicle 600 is shown as a passenger car in FIG. 6, but other embodiments are possible. For example, vehicle 600 may be a truck, light truck, semi-trailer truck, motorcycle, golf cart, off-road vehicle, or farm equipment. As shown, the vehicle 600 includes a first sensor unit 602, a second sensor unit 604, a third sensor unit 606, a wireless communication system 608, and an imaging device 610.
0068The first, second, and third sensor units 602 to 606 include a Global Positioning System (GPS) system sensor, an inertial measurement unit, a radar (RADAR) unit, a laser rangefinder, a lidar (LIDAR) unit, and imaging. Any combination of devices and acoustic sensors can be included. Other types of sensors are also possible.
0069The first, second, and third sensor units 602 to 606 are shown to be mounted at specific positions in the vehicle 600, but in some embodiments, the sensor unit 602 is the vehicle 600. It can be mounted elsewhere, either inside or outside the vehicle 600. Further, although only three sensor units are shown, more or less sensor units may be included in the vehicle 600 in some embodiments.
0070In some embodiments, one or more of the first, second, and third sensor units 602-606 may include one or more movable mounts to which the sensors can be movably mounted. .. The movable mount can include, for example, a turntable. The sensor mounted on the turntable can rotate so that the sensor can obtain information from all directions around the vehicle 600. Alternatively or additionally, the movable mount can include a tilted platform. The sensor mounted on the tilt platform can be tilted within a certain range of angles and / or azimuths so that the sensor can obtain information from various angles. The movable mount can be in other forms.
0071Further, in some embodiments, one or more of the first, second, and third sensor units 602 to 606 position the sensor within the sensor unit by moving the sensor and / or the movable mount. And / or may include one or more actuators configured to adjust direction. Illustrative actuators include motors, pneumatic actuators, hydraulic actuators, relays, solenoids, piezoelectric actuators. Other actuators are also possible.
0072The wireless communication system 608 may be any system configured to wirelessly connect to one or more other vehicles, sensors, etc., either directly or through a network. To this end, the wireless communication system 608 can include antennas and chipsets for communicating with other vehicles, sensors, etc., either directly or via a spatial interface. Chipsets or wireless communication systems 608 have various configurations, but in general, Bluetooth, communication protocols described in IEEE802.11 (including revised version of IEEE802.11), mobile phone technology (GSM, CDMA, UMTS, EV) -Communicates by one or more other forms of wireless communication, such as (technologies such as DO, WiMAX, or LTE), Zigbee, Dedicated Short Range Communication (DSRC), and Individual Identification (RFID) communication over radio waves. Can be configured to do. The wireless communication system 608 can be in other formats.
0073The wireless communication system 608 is shown to be located on the roof of the vehicle 600, but in other embodiments, the wireless communication system 608 can be arranged in whole or in part elsewhere.
0074The image capturing device 610 can be any camera (eg, a still camera, a video camera, etc.) configured to capture an image of the surroundings of the vehicle 600. For this purpose, the imaging apparatus 610 can be configured to detect visible light, or it can also be configured to detect light in other spectral band portions such as infrared or ultraviolet or X-rays. it can. Other types of imaging devices are also possible. The image capturing device 610 can be a two-dimensional detector or can have a three-dimensional spatial range. In some embodiments, the imaging device 610 is, for example, a region detector configured to generate a two-dimensional image that displays the distance from the imaging device 610 to many points around it. be able to. For this purpose, the imaging apparatus 610 can use one or more region detection techniques. For example, in the image capturing device 610, the vehicle 600 illuminates a surrounding object with a predetermined light pattern such as a grid pattern or a checkerboard turn, and the image capturing device 610 reflects the reflection of the predetermined light pattern from the object. A structured optical technique such as detection can be used. Based on the distortion of the reflected light pattern, the vehicle 600 measures the distance to each point on the object. The predetermined light pattern can include infrared light or light of other wavelengths. As another embodiment, the imaging device 610 can use a laser scanning technique in which the vehicle 600 irradiates and scans a laser beam across many points on a surrounding object. While scanning the object, the vehicle 600 can use the imaging device 610 to detect the laser light reflected from each point of the object. The vehicle 600 can measure the distance to each point on the object based on the time it takes for the laser beam to be reflected from each point on the object. As yet another embodiment, the image capturing device 610 is an imaging device for detecting the light pulse reflected from many points of the object when the vehicle 600 irradiates the light pulse. It is also possible to use the TOF (time-of-flight) method, such as using the 610. In particular, the image capturing apparatus 610 can include many pixels, and each pixel can detect reflected light from each point on the object. Based on the time of the light pulse from the object to the reflection at each point, the vehicle 600 measures the distance of the object to that point. The optical pulse can be a laser pulse. Other distance detection techniques are also possible, including, for example, three-dimensional triangulation, light-cutting triangulation, interference spectroscopy, and coded aperture techniques. The image capturing device 610 may have other shapes.
0075In some embodiments, the imaging apparatus 610 is configured to adjust the position and / or orientation of the imaging apparatus 610 by moving the imaging apparatus 610 and / or the movable mount, as described above. , Movable mounts and / or actuators can be included.
0076The imaging device 610 is shown to be attached to the windshield of the vehicle 600, but in other embodiments the imaging device 610 is located inside or outside the vehicle 600, elsewhere in the vehicle 600. Can be installed The vehicle 600 may include one or more other parts in addition to or in place of those shown.
0077FIG. 7 is a simplified block diagram of an exemplary vehicle 700 according to one embodiment. The vehicle 700 can be, for example, similar to the vehicle 600 described above in the context of FIG. The vehicle 700 can also have other shapes.
0078As shown, vehicle 700 includes a propulsion system 702, a sensor system 704, a control system 706, a peripheral device 708, and a computer system 710 with a processor 712, a data storage device 714, and an instruction 716. According to other embodiments, the vehicle 700 may include more, less, or different systems, each system containing more, less, or different components. be able to. In addition, the system and components can be combined or divided in many different ways.
0079The propulsion system 702 can be configured to provide propulsion to the vehicle 700. As shown, the propulsion system 702 includes an engine / motor 718, an energy source 720, a transmission 722, and a wheel / tire 724.
0080The engine / motor 718 can be, or can include, an internal combustion engine, an electric motor, a steam engine, and a Stirling engine. The same applies to other motors and engines. In some embodiments, the propulsion system 702 can include multiple types of engines and / or motors. For example, gas-electric hybrid passenger cars include gasoline engines and electric motors. Other embodiments are possible.
0081The energy source 720 is a source of energy that powers all or part of the engine / motor 718. That is, the engine / motor 718 can be configured to convert the energy source 720 into mechanical energy. Examples of energy sources 720 include gasoline, diesel, propane, other compressed gas based fuels, ethanol, solar panels, batteries, and other power sources. The energy source 720 can further or alternatively include various combinations of tanks, batteries, capacitors, and / or flywheels. In some embodiments, the energy source 720 can also supply energy to other systems of the vehicle 700.
0082The transmission 722 can be configured to transfer mechanical power from the engine / motor 718 to the wheels / tires 724. For this purpose, the transmission 722 includes gearboxes, clutches, differentials, drive shafts, and / or other elements. As an example of transmission 722, when a drive shaft is included, the drive shaft includes one or more axles configured to connect with wheels / tires 724.
0083The wheels / tires 724 of the vehicle 700 can be configured in various forms including unicycles, bicycles / motorcycles, tricycles, or four-wheeled passenger cars / trucks. Other wheel / tire types are also possible, including six wheels or more. In either case, the wheels / tires 724 of the vehicle 700 can be configured to rotate independently of the other wheels / tires 724. In some embodiments, the wheel / tire 724 can include at least one wheel fixed to the transmission 722 and at least one tire coupled with a wheel rim that can contact the drive surface. Wheel / tire 724 can include various combinations of metal and rubber, or combinations with other materials .
0084The propulsion system 702 may further or optionally include components other than those shown.
0085The sensor system 704 includes one or more actuators 736 configured to reposition and / or orient the sensors, as well as a number of sensors configured to detect information about the surrounding conditions in which the vehicle 700 is located. Can be done. As shown, the sensors in the sensor system include the Global Positioning System (GPS) module 726, inertial measurement unit (IMU) 728, radar (RADAR) device 730, laser rangefinder, and / or lidar (LIDAR) unit 732. , And the imaging device 734 is included. The sensor system 704 can also include, for example, additional sensors including sensors that monitor the vehicle 700 internal system (eg, O2 monitor, fuel gauge, engine oil temperature, etc.). Other sensors are also possible.
0086The GPS726 may be any sensor configured to estimate the geographic location of the vehicle 700. To this end, the GPS726 can include a transceiver configured to estimate the position of the vehicle 700 on Earth. This GPS726 can be in other formats.
0087The IMU728 can be in various combinations of sensors configured to detect changes in the position and direction of the vehicle 700 based on inertial acceleration. In some embodiments, the combination of sensors can include, for example, an accelerometer and a gyroscope. Other combinations of sensors are also possible.
0088The radar device 730 can be any sensor configured to detect surrounding objects on which the vehicle 700 is located. In some embodiments, in addition to detecting the object, the radar device 730 can additionally be configured to detect the velocity and / or the direction in which the object is moving.
0089Similarly, the laser rangefinder or LIDAR unit 732 can be any sensor configured to use a laser to detect surrounding objects where the vehicle 700 is located. In particular, the laser rangefinder or LIDAR unit 732 can include a laser energy source that irradiates the laser light and / or a laser scanner and a detector that is configured to detect the reflected light of the laser light. The laser rangefinder or LIDAR unit 732 can be configured to operate in synchronous detection mode (eg, using heterodyne detection) or asynchronous detection mode.
0090The image capturing device 734 can be any device (eg, a still camera, a video camera, etc.) configured to record an image of the surroundings of the vehicle 700. For this purpose, the imaging device 734 can have any of the shapes described above in the context of the imaging device 610 of FIG.
0091The sensor system 704 may, additionally or optionally, include components other than those illustrated.
0092The control system 706 can be configured to control the operation of the vehicle 700 and its components. For this purpose, control system 706 may include steering unit 738, throttle 740, brake unit 742, sensor integration algorithm 744, computer vision system 746, navigation or course system 748, and obstacle avoidance system 750. it can.
0093The steering unit 738 may be any combination of mechanical devices configured to adjust the direction of travel of the vehicle 700.
0094The throttle 740 may be any combination of mechanical devices configured to control the speed of the engine / motor 718, in other words the speed of the vehicle 700.
0095The brake unit 742 may be any combination of mechanical devices configured to decelerate the vehicle 700. For example, the brake unit 742 may use friction to slow down the wheels / tires 724. As another example, the brake unit 742 can also be configured to regenerate the mechanical energy of the wheel / tire 724 and convert it into an electric current. The brake unit 742 can be in other forms.
0096The sensor integration algorithm 744 can be an algorithm (or a computer program product that stores the algorithm) configured to receive data from the sensor system 704 as input. The data can include, for example, data representing information detected by a sensor in sensor system 704. The sensor integration algorithm 744 includes, for example, an assessment of individual objects and / or features around the vehicle 700, an assessment of a particular situation, and / or an assessment of the potential impact based on a particular situation. It can be configured to present various predictions based on data from system 704. Other predictions are possible.
0097The computer vision system 746 processes the images captured by the imaging device 734 in the vicinity of where the vehicle 700 is located, for example, to identify objects and / or terrain, including traffic lights and obstacles. It can be any system configured for analysis. To this end, computer vision system 746 can use object identification algorithms, structure from motion (SFM) algorithms, video tracking, or other computer vision techniques. In some embodiments, the computer vision system 746 can be additionally configured to perform surrounding drawing, object tracking, object velocity estimation, and the like.
0098The navigation and course system 748 may be any system configured to determine the driving path of the vehicle 700. The navigation and course system 748 may be configured to add to dynamically change the driving route while driving the vehicle 700. In some embodiments, the navigation and course system 748 incorporates data from a sensor integration algorithm 744, a GPS module 726, and one or more predefined maps to determine the driving path of the vehicle 700. Can be configured as
0099The obstacle avoidance system 750 can be any system that is configured to identify, evaluate, and avoid or otherwise overcome obstacles around the vehicle 700.
0100The control system 706 may additionally or alternatively include components different from those shown.
0101Peripheral device 708 can be configured to allow vehicle 700 to interact with external sensors, other vehicles, and / or users. For this purpose, the peripheral device 708 can include, for example, a wireless communication system 752, a touch screen 754, a microphone 756, and / or a speaker 758.
0102The wireless communication system 752 can be in any form described above.
0103The touch screen 754 can be used by the user to enter commands into the vehicle 700. For this purpose, the touch screen 754 detects at least one of the user's finger position or the user's finger movement by capacitance detection, resistance detection, surface acoustics, or the like. Can be configured as The touch screen 754 can detect finger movements in a direction parallel to the surface of the touch screen, in a planar direction, in a direction perpendicular to the surface of the touch screen, or in both directions. It may be possible to detect the degree of pressure applied to the touch screen. The touch screen 754 can be formed of one or more translucent or transparent insulating layers and one or more conductive layers. The touch screen 754 can also have other shapes.
0104The microphone 756 can be configured to receive voice (eg, voice commands or other voice inputs) from the user of the vehicle 700. Similarly, the speaker 758 can be configured to output audio to the user of the vehicle 700.
0105Peripheral devices 708 may be additionally or alternatively included in the components separately from the above.
0106The computer system 710 transmits data to one or more of the propulsion system 702, the sensor system 704, the control system 706, and the peripheral device 708, and the propulsion system 702, the sensor system 704, the control system 706, and the peripheral device 708. It can be configured to receive data from one or more. For this purpose, the computer system 710 includes one or more of the propulsion system 702, the sensor system 704, the control system 706, and the peripheral device 708, and a system bus, network, and / or other communication mechanism (not shown). ) Can be linked so that it can be communicated.
0107The computer system 710 can be further configured to interact and control one or more of the propulsion system 702, the sensor system 704, the control system 706, and / or the peripheral device 708. For example, the computer system 710 can be configured to control the operation of the transmission 722 to improve fuel economy. As another embodiment, the computer system 710 can be configured to have the image capturing device 734 capture an image of the surroundings. As yet another embodiment, the computer system 710 can be configured to store and execute instructions corresponding to the sensor integration algorithm 744. As yet another embodiment, the computer system 710 can be configured to store and execute instructions for displaying a display on the touch screen 754. Other embodiments are possible.
0108As shown, the computer system 710 includes a processor 712 and a data storage device 714. Processor 712 may include one or more general purpose processors and / or one or more dedicated processors. Such processors can be operated separately or in combination as long as the processor 712 includes one or more processors. The data storage device 714 can also include volatile and / or non-volatile storage elements such as optical storage devices, magnetic storage devices, and / or organic storage devices. It can be fully or partially integrated into processor 712.
0109In some embodiments, the data storage device 714 includes instructions 716 (instructions 716) that can be executed by the processor 712 to perform various vehicle functions, including those described above in connection with FIGS. 1-5B. For example, program logic) can be stored. The data storage device 714 transmits data to or from one or more of the propulsion system 702, sensor system 704, control system 706, and peripheral device 708, receives data from one or more of them, and interacts with one or more of them. , And / or additional instructions may be accommodated, including instructions for controlling one or more of these.
0110The computer system 702 may additionally or optionally include other components.
0111As shown, the vehicle 700 further includes a power source 760, which can be configured to power all or part of the components of the vehicle 700. For this purpose, the power source 760 can include, for example, a rechargeable lithium ion or lead acid battery. In some embodiments, one or more battery banks can be provided for power supply. Other power materials and configurations are also possible. In some embodiments, the power source 760 and the energy source 720 can be incorporated together, like some electric vehicles.
0112In some embodiments, one or more of the propulsion system 702, sensor system 704, control system 706, and peripheral device 708 are interconnected with other components within and / or outside their respective systems. Can be configured to work.
0113In addition, the vehicle 700 may include one or more components in addition to or in place of those shown. For example, the vehicle 700 may include one or more additional interfaces and / or power supplies. Other additional components are possible. In such an embodiment, the data storage device 714 can further include instructions that can be executed by the processor 712 to control and / or communicate with this additional component.
0114Further, while components and systems are shown to be incorporated within the vehicle 700, in some embodiments, one or more components or systems are used, using wired or wireless connections. It can be detachably incorporated into the vehicle 700 or otherwise (mechanically or electrically) connected.
0115The vehicle 700 can also be in other forms.
0116In some embodiments, the disclosed method is a computer program encoded in a machine-readable format, on a persistent computer-readable storage medium, or on a persistent medium or product. It can be implemented as an order. FIG. 8 outlines a conceptual portion of an exemplary computer program product 800, including a computer program that performs computer processing on a computer, constructed based on at least some of the embodiments described herein. It is shown in.
0117In one embodiment, the exemplary computer program product 800 is provided with a signal-carrying 802. The signal-transmitting medium 802 contains one or more program instructions 804 that, when executed by one or more processors, output some or all of the above-mentioned functions in association with FIGS. 1-5B. be able to.
0118In some embodiments, the medium 802 that carries the signal is, but is not limited to, a hard disk drive, a compact disc (CD), a digital video disc (DVD), a digital tape, a memory, etc. Such as, computer readable medium 806 can be included. In some embodiments, the medium 802 that carries the signal is, but is not limited to, computer storage such as memory, read / write (R / W) CD, read / write DVD, and the like. Possible media 808 can be included. Furthermore, in some embodiments, the medium 802 that carries the signal is, but is not limited to, a digital and / or analog communication medium (eg, fiber optic cable, waveguide, wired communication link, wireless communication). It can include a communication medium 810, such as a link, etc.). Therefore, for example, the medium 802 for transmitting a signal can be transmitted wirelessly in the form of a communication medium 810.
0119One or more instructions 804 can be, for example, computer-executable instructions and / or logic incorporating instructions. In some embodiments, the computer (eg, computer system 710 in FIG. 7) is transmitted to the computer by one or more computer readable media 806, computer storable media 808, and / or communication medium 810. It can be configured to output various operations, functions, or operations in response to the programming instruction 804.
0120Persistent computer-readable media can also be distributed across multiple data storage elements that can be installed in isolation from each other.
0121In some embodiments, the computer that executes some or all of the programming instructions 804 can be a vehicle as illustrated in FIG. Other computing devices are also possible.
0122Various forms and examples have been disclosed herein, but other forms and examples will be apparent to those skilled in the art. The various forms and examples described herein are for illustration purposes only and should not be construed as limiting the invention. The original technical scope of the present invention and the spirit of the invention are shown by the following claims.
11 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| KR102139342B1 | Cited by | Republic of Korea | Search report |
| JP2011148479A | Cites | Japan | – |
| JP2010030399A | Cites | Japan | – |
| JP2005104462A | Cites | Japan | – |
| JP2008149860A | Cites | Japan | – |
| JP2010023721A | Cites | Japan | – |
| JP2010030424A | Cites | Japan | – |
16 members in 6 offices
Members16
| Document | Office | Kind | |
|---|---|---|---|
| US8504233B1 | United States of America | B1 | |
| WO2013162847A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2014018995A1 | United States of America | A1 | |
| US8725342B2 | United States of America | B2 | |
| KR20140131601A | Republic of Korea | A | |
| CN104395168A | China | A | |
| EP2841316A1 | European Patent Office (EPO) | A1 | |
| KR101514935B1 | Republic of Korea | B1 | |
| JP2015523256A | Japan | A | |
| EP2841316A4 | European Patent Office (EPO) | A4 | |
| CN104395168B | China | B | |
| JP5890585B2This record | Japan | B2 | |
| EP2841316B1 | European Patent Office (EPO) | B1 | |
| EP2841316B8 | European Patent Office (EPO) | B8 | |
| EP3266667A1 | European Patent Office (EPO) | A1 | |
| EP3266667B1 | European Patent Office (EPO) | B1 |
20 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Written notification of registration of transferJAPANESE INTERMEDIATE CODE: R350R350 | R350 | |
| Request for change of ownership or part of ownershipJAPANESE INTERMEDIATE CODE: R313113S111 | S111 | |
| Written notification of registration of transferJAPANESE INTERMEDIATE CODE: R350R350 | R350 | |
| Written request for registration of change of nameJAPANESE INTERMEDIATE CODE: R313533S533 | S533 | |
| Notification of acceptance of power of attorneyJAPANESE INTERMEDIATE CODE: R3D02RD02 | RD02 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Written request for extension of timeJAPANESE INTERMEDIATE CODE: A601A601 | A601 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 |
Numbers
- Publication
- 5890585
- Application
- 2015508989
Titles2
- Japanese
- 自律モードで運転するよう構成された車両および該車両を制御する方法
- English
- Vehicles configured to drive in autonomous mode and methods of controlling the vehicle
Classification
- CPC, 20
- B60W50/029
- G06V20/58
- B60W60/0015
- G05D1/0212
- G05D1/0289
- B60W2554/4041
- B60W2552/00
- B60W2554/801
- G06V20/588
- B60W2552/53
- B60W60/00
- B60W30/16
- B60W40/105
- B60W40/06
- B60W2754/30
- B60W2556/50
- B60W2050/0005
- B60W2520/10
- B60W2720/10
- B60W2420/408
- IPC, 6
- B60W30 10
- B60K31 00
- G08G1 16
- B60R21 00
- B62D6 00
- B62D101 00
