# US 2021/0239839 A1 · Depth mapping system and method therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0239839 A1
- Document ID: US20210239839A1
- Status: Published application
- Kind: A1
- Application number: 17/161,918
- Filed: 2021-01-29
- Published: 2021-08-05
- Earliest claimed: 2020-01-30
- Assignees: Melexis Technologies SA
- Applicants: Melexis Technologies NV
- Inventors: Volodymyr SELIUCHENKO
- Web page: https://patentgrep.com/patent/US20210239839A1

## CPC

- G01S 17/89: for mapping or imaging
- G01S 17/894: Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
- G01S 7/4815: {using multiple transmitters}
- G01S 17/10: using transmission of interrupted, pulse-modulated waves (determination of distance by phase measurements G01S17/32)
- G01S 17/18: wherein range gates are used
- G01S 17/36: with phase comparison between the received signal and the contemporaneously transmitted signal
- G01S 17/931: of land vehicles
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES

## Abstract

A depth mapping system includes a time of flight ranging system including structured and unstructured light sources, an optical sensor unit and a signal processing unit. The system time employs first and second time of flight ranging technique in respect of the optical sensor unit. The first and second time of flight techniques measure respective first and second distance ranges over a first and a second respective field of view. Measurement of the first and second distance ranges are respectively at a first angular resolution and a second angular resolution greater than the first angular resolution. The structured and unstructured light sources respectively operate in respect of the first and second time of flight techniques. First and second regions of the optical sensor unit respectively have the first and second fields of view associated therewith, and the structured source has a greater emission radiant intensity than the unstructured source.

## Claims

### Claim 1

A depth mapping system comprising:
a time of flight ranging system comprising:
an unstructured light source and a structured light source;
an optical sensor unit; and
a signal processing unit; wherein
the time of flight ranging system is configured to employ a first time of flight ranging technique and a second time of flight ranging technique in respect of the optical sensor unit, the first time of flight ranging technique is configured to measure distance ranges over a first field of view, and the second time of flight ranging technique is configured to measure distance ranges over a second field of view;
the measurement of first distance ranges over the first field of view is at a first angular resolution and the measurement of second distance ranges over the second field of view is at a second angular resolution greater than the first angular resolution;
the structured light source is configured to operate in respect of the first time of flight ranging technique and the unstructured light source is configured to operate in respect of the second time of flight ranging technique;
a first region of the optical sensor unit has the first field of view associated therewith and a second region of the optical sensor unit has the second field of view associated therewith; and
the structured light source is configured to emit structured light having a first radiant intensity and the unstructured light source is configured to emit unstructured light having a second radiant intensity, the first radiant intensity being greater than the second radiant intensity.

### Claim 2 (depends on 1)

The system according to claim 1, wherein the first time of flight ranging technique has a first operating distance range associated therewith and the second time of flight ranging technique has a second operating distance range associated therewith, the first operating distance range being greater than the second operating distance range.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the first field of view is laterally broader than the second field of view.

### Claim 4 (depends on 1)

The system according to claim 1, wherein the time of flight ranging system is configured to map a periphery using the first time of flight ranging technique and is configured to classify and/or detect a non-peripheral obstacle using the second time of flight ranging technique.

### Claim 5 (depends on 1)

The system according to claim 1, wherein
the first time of flight ranging technique is a direct time of flight ranging technique employing the structured light source.

### Claim 6 (depends on 5)

The system according to claim 5, wherein the second time of flight ranging technique is direct time of flight ranging technique employing the unstructured light source.

### Claim 7 (depends on 1)

The system according to claim 1, wherein the optical sensor unit is configured to support both the first and second time of flight ranging techniques.

### Claim 8 (depends on 7)

The system according to claim 7, wherein the optical sensor unit comprises a plurality of optical sensor elements.

### Claim 9 (depends on 8)

The system according to claim 8, wherein the plurality of optical sensor elements employs a common sensing technique.

### Claim 10 (depends on 8)

The system according to claim 8, wherein the plurality of optical sensor elements comprises a same device structure.

### Claim 11 (depends on 1)

The system according to claim 1, wherein the first and second regions overlap at least in part.

### Claim 12 (depends on 1)

The system according to claim 1, wherein
the signal processing unit is configured to determine, when in use, a location within a room and to detect an obstacle within the room.

### Claim 13 (depends on 1)

The system according to claim 1, wherein the time of flight ranging system is configured to time multiplex employment of the first time of flight ranging technique and the second time of flight ranging technique.

### Claim 14 (depends on 13)

The system according to claim 13, wherein the time of flight ranging system is configured to alternate employment of the first time of flight ranging technique and the second time of flight ranging technique.

### Claim 15 (depends on 1)

The system according to claim 1, wherein the time of flight ranging system is configured to illuminate a scene substantially omnidirectionally in respect of the first time of flight ranging technique.

### Claim 16 (depends on 10)

The system according to claim 10, wherein the time of flight ranging system comprises reflective, refractive, diffractive and/or holographic optical elements configured to provide the substantially omnidirectional illumination.

### Claim 17 (depends on 1)

The system according to claim 1, wherein the time of flight ranging system is configured to employ the second time of flight ranging technique to measure in respect of a movement trajectory over a predetermined illumination beam width.

### Claim 18 (depends on 1)

A mobile robotic device comprising:
a system of locomotion; and
the depth mapping system according to claim 1.

### Claim 19 (depends on 18)

The mobile robotic device according to claim 18, wherein the depth mapping system is a local depth system.

### Claim 20

A method of depth mapping comprising:
employing a first time of flight ranging technique and a second time of flight ranging technique in respect of an optical sensor unit;
providing structured light illumination when measuring distance ranges using the first time of flight ranging technique over a first field of view;
providing unstructured light illumination when measuring distance ranges using the second time of flight ranging technique over a second field of view;
the measurement of first distance ranges over the first field of view is at a first angular resolution and the measurement of second distance ranges over the second field of view is at a second angular resolution greater than the first angular resolution; and
directing first reflected light to a first region of the optical sensor unit in respect of the first field of view and directing second reflected light to a second region of the optical sensor unit in respect of the second field of view; wherein
the structured light source emits structured light having a first radiant intensity and the unstructured light source emits unstructured light having a second radiant intensity, the first radiant intensity being greater than the second radiant intensity.
