# US 2019/0246091 A1 · Systems and methods for enhanced depth sensor devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0246091 A1
- Document ID: US20190246091A1
- Status: Published application
- Kind: A1
- Application number: 15/892,150
- Filed: 2018-02-08
- Published: 2019-08-08
- Earliest claimed: 2018-02-08
- Assignees: Oculus VR, LLC
- Applicants: Oculus VR, LLC
- Inventors: Manoj Bikumandla; Andrew Matthew Bardagjy; Cina Hazegh
- Web page: https://patentgrep.com/patent/US20190246091A1

## CPC

- H04N 13/218: using spatial multiplexing
- G02B 27/017: {Head mounted}
- G02B 27/4205: {having a diffractive optical element [DOE] contributing to image formation, e.g. whereby modulation transfer function MTF or optical aberrations are relevant}
- G06T 7/521: from laser ranging, e.g. using interferometry; from the projection of structured light
- G06T 7/536: from perspective effects, e.g. by using vanishing points
- G06T 7/55: from multiple images
- H04N 13/211: using temporal multiplexing
- H04N 13/254: in combination with electromagnetic radiation sources for illuminating objects
- H04N 13/257: Colour aspects
- H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps
- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- H04N 23/58: Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
- G02B 2027/0127: {comprising devices increasing the depth of field}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0147: {comprising a device modifying the resolution of the displayed image}
- G06T 2207/10048: Infrared image
- H04N 13/232: using fly-eye lenses, e.g. arrangements of circular lenses
- H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals}
- H04N 2013/0088: {Synthesising a monoscopic image signal from stereoscopic images, e.g. synthesising a panoramic or high resolution monoscopic image}
- H04N 2213/001: Constructional or mechanical details
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An exemplary depth imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce different phase delays into a wavefront of the light, and a housing that secures the matrix between the optical sensor and the lens. The device further includes a communication bus coupled to a processing subsystem that directs the optical sensor to capture at least two different perspectives of the scene to create an output image indicating depth within the scene. The device includes a positioning system that couples an optical component of the device to the housing. The optical component may include at least one of the lens, the optical sensor, or the matrix. Other related systems and methods are also provided.

## Claims

### Claim 1

A depth imaging device comprising:
an optical sensor having an optical axis;
a lens positioned to focus light from a scene onto the optical sensor;
a matrix of variable-phase optical elements that are dimensioned to introduce at least two different phase delays into a wavefront of the light from the scene;
a housing that secures the matrix of variable-phase optical elements between the optical sensor and the lens;
a communication bus coupled to a processing system that directs the optical sensor to capture at least two different perspectives of the scene to create an output image indicating depth within the scene; and
a positioning system that couples an optical component of the depth imaging device to the housing, the optical component comprising at least one of the lens, the optical sensor, or the matrix of variable-phase optical elements.

### Claim 2 (depends on 1)

The depth imaging device of claim 1, wherein the positioning system comprises at least one of:
a channel configured to receive an edge of the optical component;
an adhesive securing the optical component in a fixed position relative to the housing; or
an active positioning component operable to moveably position the optical component at least substantially perpendicular to the optical axis.

### Claim 3 (depends on 2)

The depth imaging device of claim 2, wherein the processing system is configured to capture the at least two different perspectives by:
capturing a first image when the optical component is in a first position associated with a first perspective;
actuating the active positioning component to move the optical component from the first position to a second position;
capturing a second image when the optical component is in the second position associated with a second perspective; and
combining the first image and the second image into the output image having depth information characterizing at least a portion of the scene.

### Claim 4 (depends on 3)

The depth imaging device of claim 3, wherein:
the processing system is further programmed to combine the first image and the second image into the output image by triangulation between the two different perspectives of the scene represented by the first image and the second image to provide a depth map of the scene as the output image; and
the depth map comprises depth dimension values for a plurality of portions of the scene.

### Claim 5 (depends on 3)

The depth imaging device of claim 3, wherein:
the first and second images comprise depth images of the scene, each image comprising a three-dimensional representation of the scene; and
the output image comprises depth information from the first image and the second image.

### Claim 6 (depends on 1)

The depth imaging device of claim 1, wherein the processing system is programmed to:
capture a first image when the optical component is in a first position associated with a first perspective;
actuate an active positioning component to move the optical component from the first position to a second position;
capture a second image when the optical component is in the second position associated with a second perspective;
generate interpolated pixel data corresponding to image data between the first position and the second position; and
combine the first image, the second image, and the interpolated pixel data into the output image, the output image having a greater resolution than either the first image or the second image.

### Claim 7 (depends on 6)

The depth imaging device of claim 6, wherein the matrix of variable-phase optical elements decreases an instantaneous field-of-view (iFOV) of each pixel included in the optical sensor.

### Claim 8 (depends on 1)

The depth imaging device of claim 1, further comprising:
a light source configured to illuminate the scene with light in an infrared wavelength range configured for use in depth sensing; and
wherein the matrix of variable-phase optical elements comprises a diffractive optical element (DOE) having features that are dimensioned to introduce at least two different phase delays into a wavefront of the light in the infrared wavelength range received as reflected from the scene through the lens to at least partially optically demodulate the light.

### Claim 9 (depends on 1)

The depth imaging device of claim 1, further comprising an array of microlenses disposed on a top surface of the matrix to focus light through the matrix.

### Claim 10 (depends on 9)

The depth imaging device of claim 9, wherein each microlens of the array of microlenses is positioned consistently with respect to a pattern present in the matrix of variable-phase optical elements.

### Claim 11

A depth imaging system comprising:
an imaging device comprising:
an optical sensor having an optical axis;
a lens positioned to focus reflected light from a scene onto the optical sensor;
a matrix of variable-phase optical elements patterned to introduce at least two different phase delays into a wavefront of the light from the scene; and
a housing that secures the matrix of variable-phase optical elements between the optical sensor and the lens in a configuration that enables the optical image sensor to capture at least two different perspectives of the scene to create an output image; and
a light projection device comprising:
a light source that emits light; and
a lens to direct the emitted light from the light source toward the scene, the scene reflecting the emitted light so as to produce the reflected light.

### Claim 12 (depends on 11)

The depth imaging system of claim 11, further comprising an optical filter layer over the optical sensor, the optical filter layer passing infrared light in a first wavelength range, wherein the light source that emits light emits infrared light of the first wavelength range.

### Claim 13 (depends on 12)

The depth imaging system of claim 12, further comprising a processing system programmed to:
cause the light source to emit a modulated light signal in the first wavelength range;
capture a first perspective of the at least two different perspectives as a first image;
capture a second perspective of the at least two different perspectives as a second image; and
combine the first image and the second image into an output image forming a three-dimensional image of the scene.

### Claim 14

A method comprising:
positioning a matrix of variable-phase optical elements, disposed between an optical sensor and a lens positioned to focus light from a scene onto the optical sensor, in a first position at least substantially perpendicular to an optical axis of the optical sensor;
capturing, with the optical sensor, at least two different perspectives of the scene;
determining depth characteristics of the scene based on the captured at least two perspectives of the scene; and
generated an output depth image of the scene, the output depth image representing the depth characteristics of the scene.

### Claim 15 (depends on 14)

The method of claim 14, further comprising positioning the matrix of variable-phase optical elements in a second position at least substantially perpendicular to the optical axis such that the optical sensor is positioned to capture a second perspective of the at least two different perspectives.

### Claim 16 (depends on 14)

The method of claim 14, wherein capturing the at least two different perspectives of the scene comprises:
capturing a first image when an optical component is in a first position associated with a first perspective, the optical component comprising at least one of the lens, the optical sensor, or the matrix of variable-phase optical elements; and
capturing a second image when the optical component is in a second position associated with a second perspective.

### Claim 17 (depends on 16)

The method of claim 16, wherein the first image and the second image each comprise depth information, such that the first and second images comprise three-dimensional representations of the scene.

### Claim 18 (depends on 16)

The method of claim 16, wherein the first image and the second image do not each include depth information, such that the first and second images comprise only two-dimensional representations of the scene.

### Claim 19 (depends on 14)

The method of claim 14, further comprising:
emitting a light signal into the scene for reflection back from the scene to the lens, wherein determining depth characteristics of the scene based on the captured at least two perspectives of the scene comprises determining phase characteristics of the light signal, the phase characteristics including a phase difference indicative of a distance between the optical sensor and portions of the scene.

### Claim 20 (depends on 19)

The method of claim 19, wherein the matrix of variable-phase optical elements directs a portion of light having a first phase delay to a first pixel of the optical sensor and directs a portion of light having a second phase delay to a second pixel of the optical sensor.
