US 2022/0027684 A1 · GENERATING FUSED SENSOR DATA THROUGH METADATA ASSOCIATION

Abstract

Described herein are systems, methods, and non-transitory computer readable media for generating fused sensor data through metadata association. First sensor data captured by a first vehicle sensor and second sensor data captured by a second vehicle sensor are associated with first metadata and second metadata, respectively, to obtain labeled first sensor data and labeled second sensor data. A frame synchronization is performed between the first sensor data and the second sensor data to obtain a set of synchronized frames, where each synchronized frame includes a portion of the first sensor data and a corresponding portion of the second sensor data. For each frame in the set of synchronized frames, a metadata association algorithm is executed on the labeled first sensor data and the labeled second sensor data to generate fused sensor data that identifies associations between the first metadata and the second metadata.

Claims20

Dependent claims

A computer-implemented method for fusing sensor data via metadata association, the method comprising:

capturing first sensor data using a first vehicle sensor and second sensor data using a second vehicle sensor;
associating first metadata with the first sensor data to obtain labeled first sensor data and second metadata with the second sensor data to obtain labeled second sensor data;
performing a frame synchronization between the first sensor data and the second sensor data to obtain a set of synchronized frames, wherein each synchronized frame includes a respective portion of the first sensor data and a corresponding respective portion of the second sensor data;
executing, for each synchronized frame in the set of synchronized frames, a metadata association algorithm on the labeled first sensor data and the labeled second sensor data;
and
generating, based at least in part on an output of executing the metadata association algorithm, fused sensor data from the labeled first sensor data and the labeled second sensor data.

3 more elements

A system for fusing sensor data via metadata association, the system comprising:

at least one processor;
and
at least one memory storing computer-executable instructions, wherein the at least one processor is configured to access the at least one memory and execute the computer-executable instructions to:
capture first sensor data using a first vehicle sensor and second sensor data using a second vehicle sensor;
associate first metadata with the first sensor data to obtain labeled first sensor data and second metadata with the second sensor data to obtain labeled second sensor data;
perform a frame synchronization between the first sensor data and the second sensor data to obtain a set of synchronized frames, wherein each synchronized frame includes a respective portion of the first sensor data and a corresponding respective portion of the second sensor data;
execute, for each synchronized frame in the set of synchronized frames, a metadata association algorithm on the labeled first sensor data and the labeled second sensor data;
and
generate, based at least in part on an output of executing the metadata association algorithm, fused sensor data from the labeled first sensor data and the labeled second sensor data.

6 more elements

Dependencies are inferred from the claim text.

Generating fused sensor data through metadata association

Life of this patent

Generating fused sensor data through metadata association

Life of this patent

Abstract

Claims20