Back to results
US 10,120,066 B2Granted
Apparatus for making a distance determination
AssigneeSTMicroelectronics (Research & Development) Limited
InventorsXiaoyong Yang, Neale Dutton, Kevin Channon
Life of this patent
Estimating the term…
Abstract
An apparatus includes a camera module configured to generate at least one image and a ToF SPAD based range detecting module configured to generate at least one distance determination to an object within a field of view of the camera module. A processor receives the at least one image from the camera module output and receives the at least one distance determination from the ToF SPAD based range detecting module. This data is processed by the processor to determine a depth map.
Claims20
An apparatus, comprising:
- a camera module configured to generate a first image and a second image taken from offset positions with partially overlapping fields of view;
- at least one time of flight (ToF) single photon avalanche diode (SPAD) based range detecting module configured to generate at least one distance determination between the apparatus and an object within the partially overlapping fields of view;
- and
- a processor configured to receive the first and second images from the camera module and the at least one distance determination from the ToF SPAD based range detecting module and determine a depth map based on depth information obtained from processing the first and second images from the camera module and the at least one distance determination;
- wherein the processor is further configured, in response to an ambient light condition, to:
- determine the depth map substantially based on the at least one distance determination from the ToF SPAD based range detecting module if the ambient light condition indicates a relatively low ambient light;
- determine the depth map substantially based on the first and second images from the camera module if the ambient light condition indicates a relatively high ambient light;
- and
- determine the depth map based on a combination of the at least one distance determination and the first and second images if the ambient light condition indicates neither relatively low nor relatively high ambient light.
6 more elements
An apparatus, comprising:
- a camera module configured to generate a first image and a second image taken from offset positions with partially overlapping fields of view;
- at least one time of flight (ToF) single photon avalanche diode (SPAD) based range detecting module configured to generate at least one distance determination between the apparatus and an object within the partially overlapping fields of view;
- and
- a processor configured to receive the first and second images from the camera module and the at least one distance determination from the ToF SPAD based range detecting module and determine a depth map based on depth information obtained from processing the first and second images from the camera module and the at least one distance determination;
- wherein the processor is further configured to:
- determine the depth map substantially based on the at least one distance determination from the ToF SPAD based range detecting module if speed of movement of the object is relatively fast;
- determine the depth map substantially based on the at least one image from the at least one camera module if speed of movement of the object is relatively slow;
- and
- determine the depth map based on a combination of the at least one distance determination and the at least one image if speed of movement of the object is neither fast nor slow or is both fast and slow.
6 more elements
An apparatus, comprising:
- a camera module configured to generate a first image and a second image taken from offset positions with partially overlapping fields of view;
- at least one time of flight (ToF) single photon avalanche diode (SPAD) based range detecting module configured to generate at least one distance determination between the apparatus and an object within the partially overlapping fields of view;
- and
- a processor configured to receive the first and second images from the camera module and the at least one distance determination from the ToF SPAD based range detecting module and determine a depth map based on depth information obtained from processing the first and second images from the camera module and the at least one distance determination;
- wherein the processor is further configured to:
- determine the depth map substantially based on the at least one distance determination from the ToF SPAD based range detecting module if a desired accuracy of object detection is a relatively high accuracy;
- determine the depth map substantially based on the at least one image from the at least one camera module if the desired accuracy of object detection is a relatively low accuracy;
- and
- determine the depth map based on a combination of the at least one distance determination and the at least one image if the desired accuracy of object detection is neither low nor high accuracy.
6 more elements
An apparatus, comprising:
- a camera module configured to generate a first image and a second image taken from offset positions with partially overlapping fields of view;
- at least one time of flight (ToF) single photon avalanche diode (SPAD) based range detecting module configured to generate at least one distance determination between the apparatus and an object within the partially overlapping fields of view;
- and
- a processor configured to receive the first and second images from the camera module and the at least one distance determination from the ToF SPAD based range detecting module and determine a depth map based on depth information obtained from processing the first and second images from the camera module and the at least one distance determination;
- wherein the processor is further configured to:
- determine the depth map substantially based on the at least one distance determination from the ToF SPAD based range detecting module when a range to the object is a macro or near distance;
- determine the depth map substantially based on the at least one image from the at least one camera module when the range to the object is a far distance;
- and
- determine the depth map based on a combination of the at least one distance determination and the at least one image when the range to the object is neither near or far distance.
6 more elements
An apparatus, comprising:
- a camera module configured to generate a first image and a second image taken from offset positions with partially overlapping fields of view;
- at least one time of flight (ToF) single photon avalanche diode (SPAD) based range detecting module configured to generate at least one distance determination between the apparatus and an object within the partially overlapping fields of view;
- and
- a processor configured to receive the first and second images from the camera module and the at least one distance determination from the ToF SPAD based range detecting module and determine a depth map based on depth information obtained from processing the first and second images from the camera module and the at least one distance determination;
- wherein the processor is further configured to:
- determine the depth map substantially based on the at least one distance determination from the ToF SPAD based range detecting module when the apparatus is operating in a low power consumption mode;
- determine the depth map substantially based on the at least one image from the at least one camera module when the apparatus is operating in a high power consumption mode;
- and
- determine the depth map based on a combination of the at least one distance determination and the at least one image when the apparatus is operating in neither low nor high power consumption modes.
6 more elements
Dependencies are inferred from the claim text.