Object detection using image and audio data
AssigneeQUALCOMM Incorporated
InventorsBalaji Shankar Balachandran, Varun Ravi Kumar, Senthil Kumar Yogamani
Life of this patent
Estimating the term…
Abstract
In some aspects, a device may obtain, via a camera associated with the device, an image that includes one or more objects located within an area of the device. The device may generate a first three-dimensional output based at least in part on the image. The device may obtain, via an audio component associated with the device, an audio input associated with the one or more objects. The device may generate a second three-dimensional output based at least in part on the audio input. The device may detect the one or more objects based at least in part on the first three-dimensional output and the second three-dimensional output. Numerous other aspects are described.
Claims28
A device for wireless communication, comprising:
- one or more memories;
- and
- one or more processors, coupled to the one or more memories, configured to:
- obtain, via a camera associated with the device, an image that includes one or more objects located within an area of the device;
- generate a first three-dimensional output based at least in part on the image;
- obtain, via an audio component associated with the device, an audio input associated with the one or more objects;
- generate a second three-dimensional output based at least in part on the audio input;
- detect the one or more objects based at least in part on the first three-dimensional output and the second three-dimensional output;
- and
- correlate the first three-dimensional output and the second three-dimensional output, wherein the one or more processors, to detect the one or more objects, are configured to determine one or more locations of the one or more objects based at least in part on correlating the first three-dimensional output and the second three-dimensional output.
A method of wireless communication performed by a device, comprising:
- obtaining, via a camera associated with the device, an image that includes one or more objects located within an area of the device;
- generating a first three-dimensional output based at least in part on the image;
- obtaining, via an audio component associated with the device, an audio input associated with the one or more objects;
- generating a second three-dimensional output based at least in part on the audio input;
- detecting the one or more objects based at least in part on the first three-dimensional output and the second three-dimensional output;
- and
- correlating the first three-dimensional output and the second three-dimensional output, wherein detecting the one or more objects comprises determining one or more locations of the one or more objects based at least in part on correlating the first three-dimensional output and the second three-dimensional output.
A non-transitory computer-readable medium storing a set of instructions for wireless communication, the set of instructions comprising:
- one or more instructions that, when executed by one or more processors of a device, cause the device to:
- obtain, via a camera associated with the device, an image that includes one or more objects located within an area of the device;
- generate a first three-dimensional output based at least in part on the image;
- obtain, via an audio component associated with the device, an audio input associated with the one or more objects;
- generate a second three-dimensional output based at least in part on the audio input;
- detect the one or more objects based at least in part on the first three-dimensional output and the second three-dimensional output;
- correlate the first three-dimensional output and the second three-dimensional output;
- and
- detect the one or more objects by determining one or more locations of the one or more objects based at least in part on correlating the first three-dimensional output and the second three-dimensional output.
An apparatus for wireless communication, comprising:
- means for obtaining, via a camera associated with the apparatus, an image that includes one or more objects located within an area of the apparatus;
- means for generating a first three-dimensional output based at least in part on the image;
- means for obtaining, via an audio component associated with the apparatus, an audio input associated with the one or more objects;
- means for generating a second three-dimensional output based at least in part on the audio input;
- means for detecting the one or more objects based at least in part on the first three-dimensional output and the second three-dimensional output;
- and
- means for correlating the first three-dimensional output and the second three-dimensional output, wherein the means for detecting the one or more objects comprises means for determining one or more locations of the one or more objects based at least in part on a correlation of the first three-dimensional output and the second three-dimensional output.
Dependencies are inferred from the claim text.