# US 2018/0324412 A1 · Three dimensional depth mapping using dynamic structured light

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0324412 A1
- Document ID: US20180324412A1
- Status: Published application
- Kind: A1
- Application number: 16/032,304
- Filed: 2018-07-11
- Published: 2018-11-08
- Earliest claimed: 2013-10-23
- Assignees: Facebook, Inc.
- Applicants: Facebook, Inc.
- Inventors: Nitay Romano; Nadav Grossinger; Yair Alpern; Emil Alon
- Web page: https://patentgrep.com/patent/US20180324412A1

## CPC

- H04N 13/296: Synchronisation thereof; Control thereof
- G01S 7/4815: {using multiple transmitters}
- G01S 17/46: Indirect determination of position data
- G01S 17/89: for mapping or imaging
- G02B 27/4205: {having a diffractive optical element [DOE] contributing to image formation, e.g. whereby modulation transfer function MTF or optical aberrations are relevant}
- G02B 27/4255: {for alignment or positioning purposes (optical displacement encoding scales G01D5/347)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/0321: {by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet (constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037)}
- H04N 13/128: Adjusting depth or disparity
- H04N 13/207: using a single two-dimensional [2D] image sensor
- H04N 13/282: for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
- H01S 5/423: {having a vertical cavity}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H01S: DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL

## Abstract

Apparatus for generating a dynamic structured light pattern for optical tracking in three-dimensional space, comprises an array of lasers, such as a VCSEL laser array, to project light in a pattern into a three-dimensional space; and an optical element or elements arranged in cells. The cells are aligned with subsets of the laser array, and each cell individually applies a modulation, in particular an intensity modulation, to light from the laser or lasers of the subset, to provide a distinguishable and separately controllable part of the dynamic structured light pattern. A method of generating a structured light pattern is disclosed, in which light is provided from an array of lasers, and light is individually projected from subsets of the array of lasers to provide differentiated parts of the structured light pattern.

## Claims

### Claim 1

An apparatus comprising:
a plurality of optical elements wherein each of the optical elements includes a cell, the cell aligned with a subset of an array of lasers such that the cell is individually controllable to dynamically apply a modulation to light passing through the cell to form a distinguishable part of a structured light pattern; and
a processor configured to:
provide one or more instructions, to the cell to dynamically adjust the modulation of the light passing through the cell to affect a change in a corresponding part of the structured light pattern.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the modulation is selected from a group consisting of: a diffractive modulation, a refractive modulation, and a combination of a diffractive and a refractive modulation.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the plurality of optical elements are constructed from a single molded element.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein a width of the cell is 1 mm or less.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein a width of the optical element is 1 mm or less.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the cell is controllable to affect a change in a position of the structured light pattern and a shape of the structured light pattern.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the dynamically applied modulation applies an increased resolution of the structured light pattern to parts of a scene and applies a reduced resolution of the structured light pattern to other parts of the scene.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the dynamically applied modulation to the structured light pattern comprises a cell wise change to orientation of the structured light pattern.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the dynamically applied modulation is selected from a group consisting of: a change in intensity, a change in polarization, a change in filtering parameters, and a change in focus.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the subset of the array of lasers is selected from a group consisting of: individual lasers, pairs of lasers, triplets of lasers, combinations of different sizes of lasers, and dynamically changing combinations of lasers.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein light projected from the subset of the array of lasers is tiled.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein the array of lasers is configured to project the structured light pattern into a scene.

### Claim 13 (depends on 1)

The apparatus of claim 1, wherein the array of lasers comprises a source selected from a group consisting of: a laser bar and a vertical cavity surface emitting laser (VCSEL) array.

### Claim 14 (depends on 1)

The apparatus of claim 1, wherein the apparatus is incorporated into any member of a group consisting of: a computer, a laptop computer, a mobile communication device, a tablet device, a game console, and a movement capture device.

### Claim 15

A method comprising:
projecting light from a subset of an array of lasers, the projected light passing through a plurality of optical elements including a cell aligned with the subset of the array of lasers, such that the cell is individually controllable; and
dynamically applying a modulation to the projected light passing through the cell to form a distinguishable part of a structured light pattern.

### Claim 16 (depends on 15)

The method of claim 15, wherein dynamically applying a modulation further comprises, applying a modulation to the projected light, the modulation being selected from a group consisting of: diffracting light, polarizing light, changing a wavelength of light, changing a filtering parameter of light, and changing an intensity of light.

### Claim 17 (depends on 15)

The method of claim 15, further comprising:
dynamically changing the structured light pattern, wherein dynamically changing the structured light pattern comprises changing a modulation applied to the projected light from the subset of the array of lasers.

### Claim 18 (depends on 17)

The method of claim 17, wherein dynamically changing the structured light pattern comprises increasing a resolution level in a part of a scene and reducing a resolution level in a different part of the scene.

### Claim 19 (depends on 17)

The method of claim 17, wherein dynamically changing the structured light pattern further comprises changing a density of patterning within the structured light pattern.

### Claim 20

An apparatus comprising:
a plurality of cells aligned with respective subsets of an array of lasers wherein each cell is individually controllable and configured to dynamically apply a modulation to light passing through the cell from the respective subset of lasers to provide a distinguishable part of a structured light pattern, the modulation applied by the plurality of cells representing an initial modulation; and
a processor configured to:
determine a second modulation configuration based on analyzing at least one captured frame, the second modulation configuration describing a modulation that is different from the initial modulation, and
wherein the plurality of cells are configured to dynamically adjust the modulation of light passing through the cell to apply the second modulation.
