Depth sensing camera system
AssigneeFotoNation Limited
InventorsPetronel Bigioi, Piotr Stec
Life of this patent
Estimating the term…
Abstract
A depth sensing camera system that comprises one or more fisheye lenses and infrared and/or near-infrared image sensors. In some examples, the image sensors may generate output signals based at least in part on receiving radiation via the fisheye lenses. A depth measurement may be calculated based at least in part on the output signals. For example, these output signals may be provided as input to a depth model, which may determine the depth measurement. In some examples, such a depth model may be integrated into an application-specific integrated circuit and/or may be operated by an application processor.
Claims20
A system comprising:
- an illuminator configured to emit a first type of radiation;
- a fisheye lens characterized by a field of view (FOV);
- a first image sensor configured to generate a first output signal based at least in part on a portion of first light received via the fisheye lens, the first light characterized by the first type of radiation, wherein the first image sensor is further configured to crop the FOV of the fisheye lens so that only a portion of the first light in a central portion of the FOV of the fisheye lens remains, wherein a curvature of one or more lenses of the fisheye lens and a spacing of the fisheye lens from the first image sensor is modified to adjust an effective sensor FOV of the fisheye lens;
- a second image sensor configured to generate a second output signal based at least in part on receiving second light via a second lens, the second light comprising at least one of the first type of radiation or a second type of radiation;
- and
- a controller operatively connected to the first image sensor and the second image sensor and configured to:
- generate, based at least in part on the first output signal, a depth map of an environment visible in a field of view of the first image sensor and the second image sensor.
A device comprising:
- a first fisheye lens characterized by a field of view (FOV);
- a first image sensor configured to generate a first output signal responsive to a portion of first radiation via the first fisheye lens, wherein the first image sensor is further configured to crop the FOV of the fisheye lens so that only a portion of the first radiation in a central portion of the FOV of the fisheye lens remains, wherein a curvature of one or more lenses of the fisheye lens and a spacing of the fisheye lens from the first image sensor is modified to adjust an effective sensor FOV of the fisheye lens;
- and
- a controller comprising a depth model, the controller configured to:
- receive, as input, the first output signal;
- and
- output, based at least in part on the first output signal, a depth measurement.
A method comprising:
- receiving, at a first image sensor, first radiation via a first fisheye lens characterized by a field of view (FOV);
- receiving, at a second image sensor, second radiation via a second fisheye lens;
- generating, by the first image sensor, a first output signal based at least in part on the first radiation, wherein the first image sensor crops the FOV of the fisheye lens so that only a portion of the first radiation in a central portion of the FOV of the fisheye lens remains, wherein a curvature of one or more lenses of the fisheye lens and a spacing of the fisheye lens from the first image sensor is modified to adjust an effective sensor FOV of the fisheye lens;
- generating, by the second image sensor, a second output signal based at least in part on the second radiation;
- and
- determining, based at least in part on the first output signal and the second output signal, a depth measurement.
Dependencies are inferred from the claim text.