Object detection using multiple sensors and reduced complexity neural networks
AssigneeOptimum Semiconductor Technologies Inc.
InventorsSabin Daniel IANCU, John GLOSSNER, Beinan WANG
Life of this patent
Estimating the term…
Abstract
A system and method relating to object detection using multiple sensor devices include receiving a range data comprising a plurality of points, each of plurality of points being associated with an intensity value and a depth value, determining, based on the intensity values and depth values of the plurality of points, abounding box surrounding a cluster of points among the plurality of points, receiving a video image comprising an array of pixels, determining a region in the video image corresponding to the bounding box, and applying a first neural network to the region to determine an object captured by the range data and the video image.
Claims20
A method for detecting objects using multiple sensor devices, comprising:
- receiving, by a processing device, a range data comprising a plurality of points, each of plurality of points being associated with an intensity value and a depth value;
- determining, by the processing device based on the intensity values and depth values of the plurality of points, a bounding box surrounding a cluster of points among the plurality of points;
- receiving, by the processing device, a video image comprising an array of pixels;
- determining, by the processing device, a region in the video image corresponding to the bounding box;
- and
- applying, by the processing device, a first neural network to the region to determine an object captured by the range data and the video image.
A system, comprising:
- sensor devices;
- a storage device for storing instructions;
- a processing device, communicatively coupled to the sensor devices and the storage device, for executing the instructions to:
- receive a range data comprising a plurality of points, each of plurality of points being associated with an intensity value and a depth value;
- determine, based on the intensity values and depth values of the plurality of points, a bounding box surrounding a cluster of points among the plurality of points;
- receive a video image comprising an array of pixels;
- determine a region in the video image corresponding to the bounding box;
- and
- apply a first neural network to the region to determine an object captured by the range data and the video image.
A non-transitory machine-readable storage medium storing instructions which, when executed, cause a processing device to perform operations for detecting objects using multiple sensor devices, the operations comprising:
- receiving, by the processing device, a range data comprising a plurality of points, each of plurality of points being associated with an intensity value and a depth value;
- determining, by the processing device based on the intensity values and depth values of the plurality of points, a bounding box surrounding a cluster of points among the plurality of points;
- receiving, by the processing device, a video image comprising an array of pixels;
- determining, by the processing device, a region in the video image corresponding to the bounding box;
- and
- applying, by the processing device, a first neural network to the region to determine an object captured by the range data and the video image.
The non-transitory machine-readable storage medium of claim 18, wherein the multiple sensor devices comprise a range sensor to capture the range data and a video camera to capture the video image.
Dependencies are inferred from the claim text.