# US 2017/0302907 A1 · Depth sensing using structured illumination

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0302907 A1
- Document ID: US20170302907A1
- Status: Published application
- Kind: A1
- Application number: 15/130,908
- Filed: 2016-04-15
- Published: 2017-10-19
- Earliest claimed: 2016-04-15
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Samuli Wallius; Mikko Juhola
- Web page: https://patentgrep.com/patent/US20170302907A1

## CPC

- G01B 9/02054: {Hand held}
- G01B 11/22: for measuring depth
- G01B 11/2513: {with several lines being projected in more than one direction, e.g. grids, patterns}
- G06T 7/00: Image analysis
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/254: in combination with electromagnetic radiation sources for illuminating objects
- H04N 23/20: for generating image signals from infrared radiation only
- H04N 23/56: provided with illuminating means
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A mobile or portable device comprises an illuminating arrangement comprising a light source, and an amplitude splitting interferometer configured to form an interferogram of light emitted by the light source. The illuminating arrangement is configured to illuminate a target region lying at a distance of at least 10 cm from the device by the interferogram, thereby projecting a structured light pattern onto the target region. The device further comprises an image sensor configured to capture at least one digital image frame of the target region illuminated by the interferogram, and a processing unit configured to obtain image data of the at least one digital image frame, and determine depth of at least one object location in the target region relative to a reference location on the basis of the obtained image data.

## Claims

### Claim 1

A mobile or portable device comprising
an illuminating arrangement comprising a light source, and an amplitude splitting interferometer configured to form an interferogram of light emitted by the light source, the illuminating arrangement being configured to illuminate a target region at a distance of at least 10 cm from the device by the interferogram, thereby projecting a structured light pattern onto the target region;
an image sensor configured to capture at least one digital image frame of the target region illuminated by the interferogram; and
a processing unit configured to obtain image data of the at least one digital image frame, and determine depth of at least one object location in the target region relative to a reference location on the basis of the obtained image data.

### Claim 2 (depends on 1)

A device as defined in claim 1, wherein the illuminating arrangement is configured to distribute the interferogram into a field of illumination having a minimum angle of at least 50 degrees.

### Claim 3 (depends on 1)

A device as defined in claim 1, wherein the light source is configured to emit infrared light.

### Claim 4 (depends on 1)

A device as defined in claim 1, wherein the light source comprises a laser diode.

### Claim 5 (depends on 1)

A device as defined in claim 1, wherein the light source and the interferometer are incorporated into an illuminating module.

### Claim 6 (depends on 1)

A device as defined in claim 1, wherein the illuminating arrangement comprises at least two amplitude splitting interferometers configured to form at least two interferograms, respectively, the illuminating arrangement being configured to illuminate the target region by the at least two interferograms.

### Claim 7 (depends on 1)

A device as defined in claim 1, wherein the illuminating arrangement comprises at least two light sources and at least two amplitude splitting interferometers, each interferometer being configured to form an interferogram of light emitted by one of the at least two light sources, the at least two interferometers thereby forming at least two interferograms, the illuminating arrangement being configured to illuminate a target region by the at least two interferograms.

### Claim 8 (depends on 7)

A device as defined in claim 7, wherein the at least two interferograms comprise a first interferogram comprising a first array of interference lines extending in a first direction for projecting a first structured light pattern onto the target region, and a second interferogram comprising a second array of interference lines extending in a second direction differing from the first direction for projecting a second structured light pattern onto the target region, the first and the second arrays of interference lines forming a two-dimensional grid of interference lines.

### Claim 9 (depends on 1)

A device as defined in claim 1, wherein the illuminating arrangement is configured to illuminate the target region by at least two interferograms of light with different wavelengths, thereby projecting at least two structured light patterns with different wavelengths onto the target region; the at least one image sensor being configured to capture at least one digital image frame of the target region illuminated by each of the different wavelengths; the processing unit being configured to obtain image data of the at least one digital image frame, and determine the depth of the at least one object location in the target region on the basis of the obtained image data.

### Claim 10 (depends on 1)

A device as defined in claim 1, wherein the reference location is defined relative to the device.

### Claim 11 (depends on 1)

A device as defined in claim 1, wherein the reference location is defined relative to a location in the target region.

### Claim 12 (depends on 1)

A device as defined in claim 1, comprising at least two image sensors, each being configured to capture at least one digital image frame of the target region illuminated by the interferogram; the processing unit being configured to obtain image data of the at least one digital image frames of the at least two image sensors, and determine depth of at least one object location in the target region relative to a reference location on the basis of the obtained image data.

### Claim 13 (depends on 1)

A device as defined in claim 1, implemented as one of a mobile phone, a smart phone, a laptop computer, a tablet computer, a game controller, a game console, and a depth sensing device.

### Claim 14

An imaging module integrable into a mobile or portable device, comprising
a light source configured to produce an illuminating light beam;
a non-diffractive interferometer configured to form an interferogram, the imaging module being configured to emit the interferogram about an illuminating axis, to be projected as a structured light pattern, having areas with different light intensity, onto a target region at a distance of at least 10 cm from the imaging module; and
an image sensor configured to capture a digital image frame of the target region illuminated by the structured light pattern projected onto it, the image sensor being positioned off the illuminating axis to allow determining depth of at least one object location in the target region relative to a reference location on the basis of image data of the digital image frame.

### Claim 15 (depends on 14)

An imaging module as defined in claim 14, configured to emit the interferogram into a field of illumination having a minimum angle of at least 50 degrees.

### Claim 16 (depends on 14)

An imaging module as defined in claim 14, comprising two image sensors each being configured to capture a digital image frame of the target region illuminated by the structured light pattern projected onto it, the two image sensors being positioned off the illuminating axis, with viewing directions different from each other, to allow determining the depth of at least one object location in the target region relative to a reference location on the basis of image data of the digital image frames captured by the two image sensors.

### Claim 17

A method comprising
providing illuminating light;
forming an interferogram by amplitude splitting the illuminating light and interferometrically combining the splitted illumination light;
illuminating a target region at a distance of at least 10 cm by the interferogram, thereby projecting a structured light pattern onto the target region;
capturing at least one digital image frame of the target region illuminated by the interferogram; and
obtaining image data of the at least digital image frame, and automatically determining depth of at least one object location in the target region relative to a reference location on the basis of the obtained image data.

### Claim 18 (depends on 17)

A method as defined in claim 17, wherein in illuminating the target region by the interferogram, the structured light pattern is distributed into a field of illumination having a minimum angle of at least 50 degrees.

### Claim 19 (depends on 17)

A method as defined in claim 17, comprising forming at least two interferograms; and illuminating the target region by the at least two interferograms; wherein the at least one digital image frame is captured of the target region while illuminating it by the at least two interferograms.

### Claim 20 (depends on 17)

A method as defined in claim 17, wherein the illuminated light comprises infrared light.
