Method and apparatus of monitoring sensor of driverless vehicle, device and storage medium
AssigneeApollo Intelligent Driving Technology (Beijing) Co., Ltd.
InventorTaiqun Hu
Life of this patent
Estimating the term…
Abstract
The present disclosure provides a method and apparatus of monitoring a sensor of a driverless vehicle, a device and a storage medium, wherein the method comprises: monitoring a physical state of a to-be-monitored sensor; monitoring a data transmission state of the to-be-monitored sensor; monitoring output data of the to-be-monitored sensor, and using predetermined data to perform cross-validation for the output data; when any monitoring result gets abnormal, determining the to-be-monitored sensor as getting abnormal, and giving an alarm. The solution of the present disclosure may be applied to improve safety of the driverless vehicle.
Claims9
A computer-implemented method of monitoring a sensor of a driverless vehicle, wherein the computer-implemented method comprises, at the level of a computer device, the steps of:
- monitoring a physical state of a monitored sensor, the physical state comprising one or more of position, connection, power-on, signal reception, or data transmission of the monitored sensor;
- monitoring a data transmission state of the monitored sensor, the data transmission state comprising one or more of data size, format, frequency, resolution, hash value, timestamp, reflection value, or height value of the monitored sensor;
- monitoring output data of the monitored sensor, and using predetermined data to perform cross-validation for the output data;
- when (a) a result of monitoring the physical state or the data transmission state indicates a deviation from a predefined range of values for one or more criteria comprised by the physical state or the data transmission state or (b) there is a validation result abnormality, determining that the monitored sensor is getting abnormal, and giving an alarm in a manner comprising at least one of an in-vehicle speech, an image prompt, or a remote notification;
- and
- responsive to determining that the monitored sensor is getting abnormal, recording current traffic environment conditions and key data, and activating a safety response policy of the driverless vehicle;
- wherein using the predetermined data to perform the cross-validation for the output data comprises performing cross-validation for the output data transmitted from the monitored sensor by using one of output data of other sensors other than the monitored sensor, a high-precision map, and data previously output by the monitored sensor, or combinations of at least two thereof;
- wherein the monitored sensor is a laser radar sensor and performing the cross-validation for output data of the monitored sensor comprises:
- acquiring a point cloud recognition result obtained according to output data of the laser radar sensor;
- when a vehicle or an obstacle on a road is recognized from the point cloud recognition result but the vehicle or the obstacle is not recognized from both an image recognition result obtained according to output data of an image sensor and an ultrasonic recognition result obtained according to output data of an ultrasonic sensor, determining the laser radar sensor as getting abnormal;
- wherein the abnormality of the laser radar sensor is caused by a hacker's attack or interfering in detection by the laser radar sensor with a strong laser, wherein the hacker's attack includes attacking the laser radar sensor by absorbing waves emitted by the laser radar for concealing and disguising.
A computer device, comprising a memory, a processor and a computer program which is stored on the memory and runs on the processor, wherein the processor, upon executing the computer program, implements a method of monitoring a sensor of a driverless vehicle, wherein the method comprises:
- monitoring a physical state of a monitored sensor, the physical state comprising one or more of position, connection, power-on, signal reception, or data transmission of the monitored sensor;
- monitoring a data transmission state of the monitored sensor, the data transmission state comprising one or more of data size, format, frequency, resolution, hash value, timestamp, reflection value, or height value of the monitored sensor;
- monitoring output data of the monitored sensor, and using predetermined data to perform cross-validation for the output data;
- when (a) a result of monitoring the physical state or the data transmission state indicates a deviation from a predefined range of values for one or more criteria comprised by the physical state or the data transmission state or (b) there is a validation result abnormality, determining that the monitored sensor is getting abnormal, and giving an alarm in a manner comprising at least one of an in-vehicle speech, an image prompt, or a remote notification;
- and
- responsive to determining that the monitored sensor is getting abnormal, recording current traffic environment conditions and key data, and activating a safety response policy of the driverless vehicle;
- wherein using the predetermined data to perform the cross-validation for the output data comprises performing cross-validation for the output data transmitted from the monitored sensor by using one of output data of other sensors other than the monitored sensor, a high-precision map, and data previously output by the monitored sensor, or combinations of at least two thereof;
- wherein when the monitored sensor is a laser radar sensor, performing the cross-validation for output data of the monitored sensor comprises:
- acquiring a point cloud recognition result obtained according to output data of the laser radar sensor;
- when a vehicle or an obstacle on a road is recognized from the point cloud recognition result but the vehicle or the obstacle is not recognized from both an image recognition result obtained according to output data of an image sensor and an ultrasonic recognition result obtained according to output data of an ultrasonic sensor, determining the laser radar sensor as getting abnormal;
- wherein the abnormality of the laser radar sensor is caused by a hacker's attack or interfering in detection by the laser radar sensor with a strong laser, wherein the hacker's attack includes attacking the laser radar sensor by absorbing waves emitted by the laser radar for concealing and disguising.
A non-transitory computer-readable storage medium on which a computer program is stored, wherein the computer program, when executed by a processor, implements a method of monitoring a sensor of a driverless vehicle, wherein the method comprises:
- monitoring a physical state of a monitored sensor, the physical state comprising one or more of position, connection, power-on, signal reception, or data transmission of the monitored sensor;
- monitoring a data transmission state of the monitored sensor, the data transmission state comprising one or more of data size, format, frequency, resolution hash value, timestamp, reflection value, or height value of the monitored sensor;
- monitoring output data of the monitored sensor, and using predetermined data to perform cross-validation for the output data;
- when (a) a result of monitoring the physical state or the data transmission state indicates a deviation from a predefined range of values for one or more criteria comprised by the physical state or the data transmission state or (b) there is a validation result abnormality, determining that the monitored sensor is getting abnormal, and giving an alarm in a manner comprising at least one of an in-vehicle speech, an image prompt, or a remote notification;
- and
- responsive to determining that the monitored sensor is getting abnormal, recording current traffic environment conditions and key data, and activating a safety response policy of the driverless vehicle;
- wherein using the predetermined data to perform the cross-validation for the output data comprises performing cross-validation for the output data transmitted from the monitored sensor by using one of output data of other sensors other than the monitored sensor, a high-precision map, and data previously output by the monitored sensor, or combinations of at least two thereof;
- wherein when the monitored sensor is a laser radar sensor, performing the cross-validation for output data of the monitored sensor comprises:
- acquiring a point cloud recognition result obtained according to output data of the laser radar sensor;
- when a vehicle or an obstacle on a road is recognized from the point cloud recognition result but the vehicle or the obstacle is not recognized from both an image recognition result obtained according to output data of an image sensor and an ultrasonic recognition result obtained according to output data of an ultrasonic sensor, determining the laser radar sensor as getting abnormal;
- wherein the abnormity of the laser radar sensor is caused by a hacker's attack or interfering in detection by the laser radar sensor with a strong laser, wherein the hacker's attack includes attacking the laser radar sensor by absorbing waves emitted by the laser radar for concealing and disguising.
Dependencies are inferred from the claim text.