Detection based on fusion of multiple sensors
AssigneeGM Global Technology Operations LLC
InventorsShuqing Zeng, Wei Tong, Yasen Hu, Mohannad Murad, David R. Petrucci, Gregg R. Kittinger
Life of this patent
Estimating the term…
Abstract
A system and method to perform detection based on sensor fusion includes obtaining data from two or more sensors of different types. The method also includes extracting features from the data from the two or more sensors and processing the features to obtain a vector associated with each of the two or more sensors. The method further includes concatenating the two or more vectors obtained from the two or more sensors to obtain a fused vector, and performing the detection based on the fused vector.
Claims13
A method to perform detection based on sensor fusion, the method comprising:
- obtaining data from two or more sensors of different types, the two or more sensors including a camera and a microphone;
- extracting features from the data from the two or more sensors and processing the features to obtain a vector associated with each of the two or more sensors;
- concatenating, using a processor, the two or more vectors obtained from the two or more sensors to obtain a fused vector;
- and
- performing the detection, using the processor, based on the fused vector, wherein the obtaining the data from the two or more sensors includes obtaining the data in a vehicle, and the performing the detection includes detecting a rumble strip using the fused vector based on the two or more sensors being in the vehicle.
A system to perform detection based on sensor fusion, the system comprising:
- two or more sensors of different types configured to obtain data, wherein the two or more sensors includes a microphone and a camera;
- and
- a processor configured to extract features from the data from the two or more sensors, process the features to obtain a vector associated with each of the two or more sensors, concatenate the two or more vectors obtained from the two or more sensors to obtain a fused vector, and perform the detection based on the fused vector, wherein the two or more sensors are in a vehicle, and the processor is configured to detect a rumble strip traversed by the vehicle based on the fused vector.
A lane departure system in a vehicle, comprising:
- a camera configured to obtain images;
- a microphone configured to obtain audio data;
- and
- a processor configured to extract visual features from the images, extract audio features from the audio data, combine the visual features and the audio features into combined features in a fused vector, perform detection based on the combined features in the fused vector, and indicate lane departure based on the detection, wherein the detection detects a rumble strip indicating a shoulder area of a roadway.
Dependencies are inferred from the claim text.