Sensor fusion with alternating correspondence analysis of sensor data
AssigneeCarl Zeiss AG
InventorsDaniel Spies, Matthias Karl
Life of this patent
Estimating the term…
Abstract
Sensor data are received from a multiplicity of sensors, wherein the multiplicity of sensors image a common scene using a multiplicity of measurement modalities. For each sensor of the multiplicity of sensors, at least one corresponding feature is determined in the respective sensor data and corresponding performance specification data are also obtained. In addition, mutual correspondence analysis between the features of the sensor data is carried out taking into account the corresponding performance specification data. Sensor fusion is also carried out on the basis of the correspondence analysis.
Claims16
A computer-implemented sensor fusion method, wherein the method comprises:
- receiving sensor data from a multiplicity of sensors, wherein the multiplicity of sensors image a common scene using a multiplicity of measurement modalities, wherein the multiplicity of sensors comprise at least a first sensor providing first sensor data and a second sensor providing second sensor data,
- for each sensor of the multiplicity of sensors:
- determining at least one corresponding feature in the respective sensor data,
- for each sensor of the multiplicity of sensors:
- obtaining corresponding performance specification data,
- carrying out a mutual correspondence analysis at least between first features of the first sensor data and second features of the second sensor data taking into account the corresponding performance specification data of the first sensor and the second sensor, the mutual correspondence analysis determining whether, for one or more of the first features that are selected in accordance with the performance specification data, a corresponding one of the second features is present or whether a corresponding one of the second features is absent, and
- carrying out the sensor fusion on the basis of a result of the correspondence analysis.
A computer-implemented sensor fusion method, wherein the method comprises:
- receiving sensor data from a multiplicity of sensors, wherein the multiplicity of sensors image a common scene using a multiplicity of measurement modalities,
- for each sensor of the multiplicity of sensors:
- determining at least one corresponding feature in the respective sensor data,
- for each sensor of the multiplicity of sensors:
- obtaining corresponding performance specification data,
- carrying out mutual correspondence analysis between the features of the sensor data taking into account the corresponding performance specification data,
- carrying out the sensor fusion on the basis of the correspondence analysis
- if the correspondence analysis indicates, as the result, a limited correspondence which is plausible within the scope of the corresponding performance specification data:
- using a scene reconstruction algorithm.
An apparatus having at least one processor and a memory, wherein the at least one processor is configured to load a program code from the memory and to execute it and to carry out the following steps on the basis of the execution of the program code:
- receiving sensor data from a multiplicity of sensors, wherein the multiplicity of sensors image a common scene using a multiplicity of measurement modalities, wherein the multiplicity of sensors comprise at least a first sensor providing first sensor data and a second sensor providing second sensor data,
- for each sensor of the multiplicity of sensors:
- determining at least one corresponding feature in the respective sensor data,
- for each sensor of the multiplicity of sensors:
- obtaining corresponding performance specification data,
- carrying out a mutual correspondence analysis between at least first features of the first sensor data and second features of the second sensor data taking into account the corresponding performance specification data of the first sensor and the second sensor, the mutual correspondence analysis determining whether, for one or more of the first features that are selected in accordance with the performance specification data, a corresponding one of the second features is present or whether a corresponding one of the second features is absent, and
- carrying out the sensor fusion on the basis of a result of the correspondence analysis.
A computer-implemented sensor fusion method, wherein the method comprises:
- receiving sensor data from a multiplicity of sensors, wherein the multiplicity of sensors image a common scene using a multiplicity of measurement modalities,
- for each sensor of the multiplicity of sensors:
- determining at least one corresponding feature in the respective sensor data,
- for each sensor of the multiplicity of sensors:
- obtaining corresponding performance specification data, wherein the performance specification data are indicative of at least one limitation of the respective measurement modality for imaging features with particular properties, wherein the at least one limitation comprises at least one of a lower threshold value for a lateral extent of objects in the scene, a geometrical orientation of objects in the scene on the basis of a post of the corresponding sensor with respect to the object, or a reflectivity of a surface of an object in the scene,
- carrying out mutual correspondence analysis between the features of the sensor data taking into account the corresponding performance specification data, and
- carrying out the sensor fusion on the basis of the correspondence analysis.
Dependencies are inferred from the claim text.