CA3048840C

System and methods for detecting vehicle braking events using data from fused sensors in mobile devices

Abstract

One or more braking event detection computing devices and methods are disclosed herein based on fused sensor data collected during a window of time from various sensors of a mobile device found within an interior of a vehicle. The various sensors of the mobile device may include a GPS receiver, an accelerometer, a gyroscope, a microphone, a camera, and a magnetometer. Data from vehicle sensors and other external systems may also be used. The braking event detection computing devices may adjust the polling frequency of the GPS receiver of the mobile device to capture non-consecutive data points based on the speed of the vehicle, the battery status of the mobile device, traffic-related information, and weather- related information. The braking event detection computing devices may use classification machine learning algorithms on the fused sensor data to determine whether or not to classify a window of time as a braking event.

CA3048840C, drawing sheet 1
Sheet 1 of 9

Term

11.2 yearsleft in the term

Expires 8 December 2037.

  1. Priority
  2. Filed
  3. Granted
  4. Today
  5. Expires

64 claims: 48 independent, 16 dependent

  1. 1
    A braking event detection system comprising:at least one processor;and memory storing computer-readable instructions, that when executed by die at least one processor, cause the system to: collect, by a sensor data collection device of the system, raw sensor date from one or more sensors associated with a mobile device within a vehicle during a window of time using a polling frequency, wherein the one or more sensors comprise at least one of a GPS receiver, an accelerometer, or a gyroscope, wherein die raw sensor data comprises information relating to at least one of a location, a speed, or an acceleration of the vehicle, and wherein the polling frequency is determined based on at least one of: the speed of the vehicle, a battery status of the mobile device, traffic information within a first threshold radius of the vehicle, or weather information within a second threshold radius of the vehicle;process, by a sensor data processing device of the system, the raw sensor date collected from the one or more sensors associated with the mobile device to remove one or more duplicate data points to generate processed sensor data;apply, by a braking event classification device of the system, a classification machine learning algorithm to the raw sensor data and the processed sensor data to determine that the window should be classified as a braking event;and generate and transmit, by a braking event notification device of the system, a notification to at least one of: a second mobile device within a first distance of the vehicle or a second vehicle within a second distance of the vehicle relating to the braking event of the vehicle. Date Reçue/Date Received 2022-12-22
  2. 4
    The system of any one of claims 1-3, further including instructions that, when executed by the at least one processor, cause the system to:collect, by the sensor data collection device, supplemental sensor data from the one or more sensors associated with the vehicle during the window of time;apply, by the braking event classification device, the classification machine learning algorithm to the raw sensor data, the processed sensor data, and the supplemental sensor data to determine that the window should be classified as the braking event.
  3. 5
    The system of any one of claims 1-4, further including instructions that, when executed by the at least one processor, cause the system to:apply, by the braking event classification device, the classification machine learning algorithm to determine a probability that the raw sensor data and the processed sensor data associated with the window is the braking event;and determine, by the braking event classification device, that the probability is greater than a probability threshold. Date Reçue/Date Received 2022-12-22
  4. 6
    The system of any one of claims 1-5, further including instructions that, when executed by the at least one processor, cause the system to:transmit, by the braking event notification device, the notification via a short-range communication protocol.
  5. 7
    The system of any one of claims 1-6 wherein the classification machine learning algorithm comprises a random forest model.
  6. 8
    A method comprising:collecting, by a sensor data collecting device of a braking event detection system, raw sensor data from one or more sensors associated with a mobile device within a vehicle during a window of time using a polling frequency, wherein the one or more sensors comprise at least one of a GPS receiver, an accelerometer, or a gyroscope, wherein the sensor data comprises information relating to at least one of a location, a speed, or an acceleration of the vehicle, and wherein the polling frequency is determined based on at least one of: the speed of die vehicle, a battery status of the mobile device, traffic information within a first threshold radius of the vehicle, or weather information within a second threshold radius of the vehicle;processing, by a sensor data processing device of the system, die raw sensor data collected from the (me or more sensors associated with the mobile device to remove one or more duplicate data points to generate processed sensor data;applying, by a braking event classification device of the system, a classification machine learning algorithm to die raw sensor data and the processed sensor data to determine that the window should be classified as a braking event, wherein die classification machine learning algorithm is stored in a braking event classification model of die system;and generating and transmitting, by a braking event notification device of the system, a notification to at least one of: a second mobile device within a first distance of the vehicle or a second vehicle within a second distance of die vehicle relating to the braking event of the vehicle. Date Reçue/Date Received 2022-12-22
  7. 11
    The method of any one of claims 8-10, further comprising:collecting, by the sensor data collection device, supplemental sensor data from the one or more sensors associated with the vehicle during the window of time;and applying, by the braking event classification device, the classification machine learning algorithm to the raw sensor data, the processed sensor data, and the supplemental sensor data to determine that the window should be classified as the braking event.
  8. 12
    The method of any one of claims 8-11, further comprising:applying, by the braking event classification device, the classification machine learning algorithm to determine a probability that the raw sensor data associated with the window is the braking event;and determining, by the braking event classification device, that the probability is greater than a probability threshold.
  9. 13
    The method of any one of claims 8-12, further comprising:transmitting, by the braking event notification device, the notification via a shortrange communication protocol.
  10. 14
    The method of any one of claims 8-13, wherein the classification machine learning algorithm comprises a random forest model. Date Reçue/Date Received 2022-12-22
  11. 15
    A computer-assisted method of delecting braking events comprising:collecting, by a sensor data collecting device of a braking event detection system, raw sensor data from one or more sensors associated with a mobile device within a vehicle during a window of time using a polling frequency, wherein the one or more sensors comprise a GPS receiver, an accelerometer, or a gyroscope, wherein the sensor data comprises information relating to at least one of a location, a speed, or an acceleration of the vehicle, and wherein the polling frequency is determined based on at least one of: the speed of the vehicle, a battery status of the mobile device, traffic information within a first threshold radius of the vehicle, or weather information within a second threshold radius of the vehicle, wherein the first threshold radius is smaller than the second threshold radius;processing, by a sensor data processing device of the system, the raw sensor data collected from the one or more sensors associated with the mobile device to remove one or more duplicate data points by replacing a duplicate data point with an average value of a first data point and a second data point to generate processed sensor data, wherein the first data point immediately precedes tire duplicate data point, and wherein the second data point immediately follows the duplicate data point;applying, by a braking event classification device, a classification machine learning algorithm to the raw sensor data and the processed sensor data to determine that the window should be classified as a braking event, wherein the classification machine learning algorithm is stored in a braking event classification model of the system;and transmitting, by a braking event notification device of the system, a visual notification to at least one of: a second mobile device within a first distance of the vehicle or a second vehicle within a second predetermined distance of the vehicle relating to the braking event of the vehicle.
  12. 18
    The computer-assisted method of any one of claims 15-17 further comprising:applying, by the braking event classification device, the classification machine learning algorithm to determine a probability that the raw sensor data associated with the window is a braking event;and determining, by the braking event classification device, that the probability is greater than a probability threshold.
  13. 19
    The computer-assisted method of any one of claims 15-18, further comprising:using short-range communication protocols to send the visual notification to nearby vehicles.
  14. 20
    The computer-assisted method of any one of claims 15-19, wherein the classification machine learning algorithm comprises a random forest model.
  15. 21
    A computer-readable medium storing instructions that, when executed, cause performance of the method of any one of claims 8-14.
  16. 22
    A computer-readable medium storing instructions that, when executed, cause performance of the method of any one of claims 15-20.
  17. 23
    An apparatus comprising:one or more processors;and Date Reçue/Date Received 2022-12-22 memory storing instructions that, when executed by die one or more processors, cause performance of any one of claims 15-20.
  18. 24
    The braking event detection system of any one of claims 1-7 comprising:Ihe at least one of: the second mobile device within the first distance of the vehicle or the sec cm d vehicle within the second distance of the vehicle relating to the braking event of the vehicle, configured to receive the notification.
  19. 25
    A system comprising:one or more processors;and memory storing computer-readable instructions that, when executed by the one or more processors, cause the system to: collect, by a sensor data collection device of the system, sensor data from one or more sensors associated with a computing device within a vehicle during a first window of time and using a polling frequency, wherein the sensor data comprises information relating to at least a location, a speed, or an acceleration of the vehicle;process, by a sensor data processing device of the system, the sensor data, wherein processing comprises removing erne or more duplicate data points from the sensor data to generate processed sensor data;determine, by a braking event classification device of the system and based on the sensor data and the processed sensor data, to classify a second window of time as a braking event;and transmit, by a braking event notification device of the system, a notification relating to the braking event of the vehicle to at least one of: a second computing device within a first distance of the vehicle or a second vehicle within a second distance of the vehicle.
  20. 28
    The system of any one of claims 25-27, further including instructions that, when executed by the one or more processors, cause the system to:collect, by the sensor data collection device, supplemental sensor data from the one or more sensors associated with the vehicle during the first window of time;and process, by the sensor data processing device, the supplemental sensor data, wherein processing the supplemental sensor data comprises removing one or more duplicate data points of the supplemental sensor data to generate processed supplemental sensor data, and wherein determining to classify the second window of time as the braking event is further based on the processed supplemental sensor data.
  21. 29
    The system of any one of claims 25-28, further including instructions that, when executed by the one or more processors, cause the system to:apply, by the braking event classification device and based on the sensor data and the processed sensor data, a classification machine learning algorithm to determine a probability that the second window of time relates to the braking event, wherein determining to classify the second window of time as the braking event is further based on determining that the probability meets a threshold. Date Reçue/Date Received 2022-12-22
  22. 30
    The system of any one of claims 25-29, wherein the notification is transmitted via a short-range communication protocol.
  23. 31
    The system of any one of claims 25-30, wherein determining to classify the second window of time as the braking event is further based on a random forest machine learning algorithm.
  24. 32
    A method comprising:collecting, by a sensor data collecting device of a system, sensor data from one or more sensors associated with a computing device within a vehicle during a first window of time and using a polling frequency, wherein die sensor data comprises information relating to at least a location, a speed, or an acceleration of the vehicle;processing, by a sensor data processing device of the system, the sensor data, wherein processing comprises removing one or more duplicate data points to generate processed sensor data;determining, by a braking event classification device of 1he system and based on the sensor data and the processed sensor data, to classify a second window of time as a braking event;and transmitting, by a braking event notification device of the system, a notification relating to the braking event of the vehicle to at least one of: a second computing device within a first predetermined distance of the vehicle or a second vehicle within a second predetermined distance of die vehicle.
  25. 35
    The method of any one of claims 32-34, further comprising:collecting, by the sensor data collection device, supplemental sensor data from sensors associated with the vehicle during the first window of time;and processing, by the sensor data processing device, the supplemental sensor data, wherein processing file supplemental sensor data comprises removing one or more duplicate data points of the supplemental sensor data to generate processed supplemental sensor data, and wherein determining to classify the second window of time as the braking event is further based on die processed supplemental sensor data.
  26. 36
    The method of any one of claims 32-35, further comprising:applying, by the braking event classification device and based on the sensor data and processed sensor data, a classification machine learning algorithm to determine a probability that the second window of time relates to die braking event, wherein determining to classify the second window of time as the braking event is further based on determining that the probability meets a threshold.
  27. 37
    The method of any one of claims 32-36, wherein the notification is transmitted via a short-range communication protocol.
  28. 38
    The method of any one of claims 32-37, wherein determining to classify the second window of time as the braking event is further based on a classification machine learning algorithm.
  29. 39
    A computer-assisted method of detecting braking events comprising:collecting, by a sensor data collecting device of a system, sensor data from one or more sensors associated with a computing device within a vehicle during a first window of time and using a polling frequency, wherein the sensor data comprises infonnation relating to at least a location, a speed, or an acceleration of the vehicle;Date Reçue/Date Received 2022-12-22 processing, by a sensor data processing device of the system, the sensor data, wherein the processing comprises replacing one or more duplicate data points with one or more average data points, and wherein the one or more average data points are based on one or more values of data points near die duplicate data points;determining, by a braking event classification device and based on the sensor data and processed sensor data, to classify a second window of time as a braking event;and transmitting, by a braking event notification device of the system, a notification to at least one of: a second computing device within a first distance of the vehicle or a second vehicle within a second distance of the vehicle relating to the braking event of the vehicle.
  30. 42
    The computer-assisted method of any one of claims 39-41, further comprising:applying, by the braking event classification device and based on the sensor data and the processed sensor data, a classification machine learning algorithm to determine a probability that the sensor data associated with the second window of time is the braking event, wherein determining to classify the second window of time as the braking event is further based on determining that the probability meets a threshold.
  31. 43
    The computer-assisted method of any one of claims 39-42, further comprising:Date Reçue/Date Received 2022-12-22 using short-range communication protocols to send the notification.
  32. 44
    The computer-assisted method of any one of claims 39-43, wherein determining to classify the second window of time as die braking event is further based on a classification machine learning algorithm.
  33. 45
    A computer-readable medium storing instructions that, when executed, cause performance of the method of any one of claims 32-38.
  34. 46
    A computer-readable medium storing instructions that, when executed, cause performance of the method of any one of claims 39-44.
  35. 47
    The system of any one of claims 25-31 comprising the second computing device configured to receive the notification.
  36. 48
    An apparatus comprising:one or more processors;and memoty storing instructions that, when executed by die one or more processors, cause performance of any one of claims 39-44.
  37. 49
    An apparatus comprising:one or more processors;and memory storing instructions that, when executed by the one or more processors, cause the apparatus to: collect, via sensors associated with a computing device in a vehicle, during a first window of time, and using a polling frequency based on a speed of the vehicle, sensor data associated with the vehicle;process the sensor data by removing at least one duplicate data point in the sensor data;classify, based on die processed sensor data, a second window of time as a braking event;Date Reçue/Date Received 2022-12-22 generate, based on the braking event, a notification relating to the braking event;and transmit, to a second computing device within a predetermined distance of the vehicle, the notification.
  38. 52
    The apparatus of any one of claims 49-51, wherein the instructions, when executed by the one or more processors, cause the apparatus to modify the polling frequency based on determining that the speed of the vehicle satisfies a threshold.
  39. 53
    The apparatus of any one of claims 49-52, wherein the polling frequency is further based on weather conditions associated with the vehicle.
  40. 54
    The apparatus of any one of claims 49-53, wherein the polling frequency is further based on traffic conditions associated with the vehicle.
  41. 55
    The apparatus of any one of claims 49-54, wherein the polling frequency is further based on a battery status of the computing device.
  42. 56
    A method comprising:collecting, via one or more sensors associated with a computing device in a vehicle, during a first window of time, and using a polling frequency based on a speed of the vehicle, sensor data associated with the vehicle;Date Reçue/Date Received 2022-12-22 processing the sensor data by removing at least one duplicate data point in the sensor data;classifying, based on the processed sensor data, a second window of time as a braking event;generating, based on the braking event, a notification relating to the braking event;and transmitting, to a second computing device within a distance of the vehicle, the notification.
  43. 59
    The method of any one of claims 56-58, further comprising:modifying the polling frequency based on determining that the speed of the vehicle satisfies a threshold.
  44. 60
    The method of any one of claims 56-59, wherein the polling frequency is further based on weather conditions associated with the vehicle.
  45. 61
    The method of any one of claims 56-60, wherein the polling frequency is further based on traffic conditions associated with the vehicle.
  46. 62
    The method of any one of claims 56-61, wherein die polling frequency is further based on a battery status of the computing device. Date Reçue/Date Received 2022-12-22
  47. 63
    A computer-readable medium storing instructions that, when executed, cause performance of the method of any one of claims 56-62.
  48. 64
    A system comprising:1he apparatus of any one of claims 49-55;and the second computing device configured to receive the notification.
Independent claims48