# US 2022/0276386 A1 · Tof camera, ground obstacle detection method thereof, and ground navigation device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0276386 A1
- Document ID: US20220276386A1
- Status: Published application
- Kind: A1
- Application number: 17/637,898
- Filed: 2020-09-18
- Published: 2022-09-01
- Earliest claimed: 2020-07-15
- Assignees: Shanghai Juyou Smart Intelligence Technology Co., Ltd
- Applicants: Shanghai Juyou Smart Intelligence Technology CO., LTD
- Inventors: Jian MEI
- Web page: https://patentgrep.com/patent/US20220276386A1

## CPC

- G01S 17/894: Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
- G01B 11/22: for measuring depth
- G01S 7/4802: {using analysis of echo signal for target characterisation; Target signature; Target cross-section}
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

This application discloses a TOF camera, a ground obstacle detection method thereof, and a ground navigation device. The ground obstacle detection method of the TOF camera. includes: using depth data of a reference plane as a reference depth value; performing distance detection, and comparing an actually measured depth value at a measured position with a corresponding reference depth value; replacing the actually measured depth value with a characteristic value if the actually measured depth value is greater than or equal to the reference depth value, and marking the corresponding position as a passable region; and using the actually measured depth value at the position as a measured depth value if the actually measured depth value is less than the reference depth value. The ground obstacle detection method can improve the accuracy of obstacle detection.

## Claims

### Claim 1

A ground obstacle detection method of a time of flight (TOF) camera, characterized in that, comprising:
using depth data of a reference plane as a reference depth value;
performing distance detection, and comparing an actually measured depth value at a measured position with a corresponding reference depth value;
replacing the actually measured depth value with a characteristic value if the actually measured depth value is greater than or equal to the reference depth value, and marking a corresponding position as a passable region; and
remaining the actually measured depth value at the position if the actually measured depth value is less than the reference depth value.

### Claim 2 (depends on 1)

The ground obstacle detection method according to claim 1, characterized in that, a method for obtaining the reference depth value comprises: selecting a standard plane, fixing a position of the TOF camera, and detecting standard depth data at each position of the standard plane, wherein a height difference between the standard plane and the TOF camera is H and the standard plane has a flat surface, and the standard depth data is not interfered by an external environment; and determining a height difference between the reference plane and the standard plane according to a feature of an actual ground, and obtaining, through calculation, the depth data of the reference plane as the reference depth value according to the standard depth data of the standard plane.

### Claim 3 (depends on 2)

The ground obstacle detection method according to claim 2, characterized in that, when the actual ground is flat and a height difference between the actual ground and the TOF camera is consistent with the height difference between the standard plane and the TOF camera, the standard plane is used as the reference plane.

### Claim 4 (depends on 2)

The ground obstacle detection method according to claim 2, characterized in that, when the actual ground is flat and a height difference between the actual ground and the TOF camera is H′, the height difference between the reference plane and the standard plane is set to H−H′.

### Claim 5 (depends on 2)

The ground obstacle detection method according to claim 2, characterized in that, when the actual ground has a recess or a protrusion, the reference plane is set to be higher than the standard plane and the height difference between the reference plane and the standard plane is D.

### Claim 6 (depends on 5)

The ground obstacle detection method according to claim 5, characterized in that, the height difference D is greater than or equal to a height of the recess or the protrusion of the actual ground.

### Claim 7

A TOF camera, characterized in that, comprising:
a storage module, configured to store a reference depth value and a characteristic value, wherein the reference depth value is depth data of a reference plane, and the characteristic value is used for marking a passable region;
a detection module, configured to obtain an actually measured depth value at a measured position; and
a processor, configured to: compare the actually measured depth value at the measured position with a corresponding reference depth value; replace the actually measured depth value with the characteristic value if the actually measured depth value is greater than or equal to the reference depth value, and mark a corresponding position as a passable region; and remain the actually measured depth value at the position if the actually measured depth value is less than the reference depth value.

### Claim 8 (depends on 7)

The TOF camera according to claim 7, characterized in that, a method for obtaining the reference depth value comprises: selecting a standard plane, fixing a position of the TOF camera, and detecting standard depth data at each position of the standard plane, wherein a height difference between the standard plane and the TOF camera is H and the standard plane has a fiat surface, and the standard depth data is not interfered by an external environment; and determining a height difference between the reference plane and the standard plane according to a feature of an actual ground, and obtaining, through calculation, the depth data of the reference plane as the reference depth value according to the standard depth data of the standard plane.

### Claim 9 (depends on 8)

The TOF camera according to claim 8, characterized in that, when a height difference between the actual ground and the TOF camera is consistent with the height difference between the standard plane and the TOF camera, the standard plane is used as the reference plane.

### Claim 10 (depends on 8)

The TOF camera according to claim 8, characterized in that, when the actual ground is flat and a height difference between the actual ground and the TOF camera is H′, the height difference between the reference plane and the standard plane is set to H−H′.

### Claim 11 (depends on 8)

The TOF camera according to claim 8, characterized in that, when the actual ground has a recess or a protrusion, the height difference between the reference plane and the standard plane is set to D, and the height difference D is greater than or equal to a height of the recess or the protrusion of the actual ground.

### Claim 12

A ground navigation device, characterized in that, comprising a TOF camera, the TOF camera comprises:
a storage module, configured to store a reference depth value and a characteristic value, wherein the reference depth value is depth data of a reference plane, and the characteristic value is used for marking a passable region;
a detection module, configured to obtain an actually measured depth value at a measured position; and
a processor, configured to: compare the actually measured depth value at the measured position with a corresponding reference depth value; replace the actually measured depth value with the characteristic value if the actually measured depth value is greater than or equal to the reference depth value, and mark a corresponding position as a passable region; and remain the actually measured depth value at the position if the actually measured depth value is less than the reference depth value.

### Claim 13 (depends on 12)

The ground navigation device according to claim 12, characterized in that, a method for obtaining the reference depth value comprises: selecting a standard plane, fixing a position of the TOF camera, and detecting standard depth data at each position of the standard plane, wherein a height difference between the standard plane and the TOF camera is H and the standard plane has a flat surface, and the standard depth data is not interfered by an external environment; and determining a height difference between the reference plane and the standard plane according to a feature of an actual ground, and obtaining, through calculation, the depth data of the reference plane as the reference depth value according to the standard depth data of the standard plane.

### Claim 14 (depends on 13)

The ground navigation device according to claim 13, characterized in that, when a height difference between the actual ground and the TOF camera is consistent with the height difference between the standard plane and the TOF camera, the standard plane is used as the reference plane.

### Claim 15 (depends on 13)

The ground navigation device according to claim 13, characterized in that, when the actual ground is flat and a height difference between the actual ground and the TOF camera is H′, the height difference between the reference plane and the standard plane is set to H−H′.

### Claim 16 (depends on 13)

The ground navigation device according to claim 13, characterized in that, when the actual ground has a recess or a protrusion, the height difference between the reference plane and the standard plane is set to D, and the height difference D is greater than or equal to a height of the recess or the protrusion of the actual ground.
