# US 2022/0273152 A1 · Obstacle identification method, apparatus, self-moving device and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0273152 A1
- Document ID: US20220273152A1
- Status: Published application
- Kind: A1
- Application number: 17/747,957
- Filed: 2022-05-18
- Published: 2022-09-01
- Earliest claimed: 2020-04-22
- Assignees: Dreame Innovation Technology (Suzhou) Co., Ltd.
- Applicants: Dreame Innovation Technology (Suzhou) Co., Ltd.
- Inventors: JIAJIA SUN; YINBO XU
- Web page: https://patentgrep.com/patent/US20220273152A1

## CPC

- A47L 11/4011: {Regulation of the cleaning machine by electric means; Control systems and remote control systems therefor}
- G01S 7/4802: {using analysis of echo signal for target characterisation; Target signature; Target cross-section}
- G01S 7/4808: {Evaluating distance, position or velocity data}
- G01S 7/4815: {using multiple transmitters}
- G01S 17/08: for measuring distance only (indirect measurement G01S17/46; active triangulation systems G01S17/48)
- G01S 17/42: Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46)
- G01S 17/88: Lidar systems specially adapted for specific applications
- G01S 17/89: for mapping or imaging
- G01S 17/931: of land vehicles
- G05D 1/0214: {in accordance with safety or protection criteria, e.g. avoiding hazardous areas (monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13)}
- G05D 1/0223: {involving speed control of the vehicle (vehicle fittings for automatically controlling, i.e. preventing speed from exceeding an arbitrarily established velocity or maintaining speed at a particular velocity, as selected by the vehicle operator B60K31/00)}
- G05D 1/024: {in combination with a laser (lasers per se H01S)}
- G05D 1/242: Means based on the reflection of waves generated by the vehicle (using passive navigation aids external to the vehicle G05D1/244; using signals provided by artificial sources external to the vehicle G05D1/247)
- G05D 1/6485: {by taking into account surface type, e.g. carpeting}
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- A47L 2201/04: Automatic control of the travelling movement; Automatic obstacle detection
- G05D 2105/10: for cleaning, vacuuming or polishing
- G05D 2109/10: Land vehicles
- G05D 2111/17: {Coherent light, e.g. laser signals}
- A47L: DOMESTIC WASHING OR CLEANING (brushes A46B; cleaning quantities of bottles or of other hollow articles of one kind B08B9/00; laundry D06F); SUCTION CLEANERS IN GENERAL (cleaning in general B08)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An obstacle identification method includes: acquiring an environmental image sent by an image acquisition component; determining contour information of an object acted on by a line laser by using pixel coordinates of reflected light in the environmental image; and when a contour indicated by the contour information is the contour of an obstacle, determining that the object acted on by the line laser is the obstacle. Since a first line laser emitter and the image acquisition component are jointly used to acquire environmental images, the image acquisition component may still collect an image of reflected light of the line laser even when there is relatively little ambient light. Therefore, it is ensured that obstacles may be identified even when there is relatively little ambient light. An obstacle identification apparatus, a self-moving device, and a storage medium are disclosed as well.

## Claims

### Claim 1

An obstacle identification method, the obstacle identification method being used in a self-moving device on which a first line laser emitter and an image acquisition component are installed; the first line laser emitter being adapted to emit line laser obliquely and downwardly along a moving direction; the image acquisition component being adapted to collect an environmental image including reflected light obtained by the line laser reflected by an object; the obstacle identification method comprising:
acquiring the environment image sent by the image acquisition component;
using pixel coordinates of the reflected light in the environment image to determine contour information of the object acted on by the line laser; and
determining that the object acted on by the line laser is an obstacle when a contour indicated by the contour information is an obstacle contour.

### Claim 2 (depends on 1)

The obstacle identification method according to claim 1, wherein after determining that the object acted on by the line laser is the obstacle, the obstacle identification method further comprises:
determining a vertical distance of the obstacle relative to the ground according to the contour information.

### Claim 3 (depends on 2)

The obstacle identification method according to claim 2, wherein determining the vertical distance of the obstacle relative to the ground according to the contour information, comprises:
acquiring a first vertical distance between the ground and the first line laser emitter;
determining a second vertical distance between the object acted on by the line laser and the first line laser emitter based on a principle of laser ranging and the pixel coordinates of the contour information; and
determining a difference between the second vertical distance and the first vertical distance as the vertical distance.

### Claim 4 (depends on 3)

The obstacle identification method according to claim 3, wherein acquiring the first vertical distance between the ground and the first line laser emitter, comprises:
for historical environmental images collected in history and the vertical distance of the object acted on by the line laser with respect to the ground is less than or equal to a preset distance threshold, based on the principle of laser ranging and the pixel coordinates of the reflected light in the historical environment images, determining a vertical distance between the object and the first line laser emitter so as to obtain the first vertical distance.

### Claim 5 (depends on 1)

The obstacle identification method according to claim 1, wherein a second line laser emitter is further provided on the self-moving device, the second line laser emitter is used to emit other line laser, an emission direction of the other line laser is different from an emission direction of the line laser, and the environmental image also includes reflected light obtained by reflecting the other line laser by the object.

### Claim 6 (depends on 1)

The obstacle identification method according to claim 1, wherein after determining that the object acted on by the line laser is the obstacle, the obstacle identification method further comprises:
determining a working strategy of the self-moving device based on a type of the obstacle, and the working strategy is used to avoid or surpass the obstacle.

### Claim 7 (depends on 6)

The obstacle identification method according to claim 6, wherein determining the working strategy of the self-moving device based on the type of the obstacle, comprises:
when the obstacle is a carpet, and a vertical distance of the carpet with respect to the ground is greater than a first threshold and less than a second threshold, determining that the working strategy of the self-moving device is to speed up driving so as to surpass the obstacle; and
when the obstacle is the carpet, and the vertical distance of the carpet with respect to the ground is greater than or equal to the second threshold, determining that the working strategy of the self-moving device is to change the moving direction so as to avoid the obstacle.

### Claim 8 (depends on 6)

The obstacle identification method according to claim 6, wherein determining the working strategy of the self-moving device based on the type of the obstacle, comprises:
when the obstacle is a step, the step is below the ground and a maximum vertical distance to the ground is greater than a third threshold and less than a fourth threshold, determining that the working strategy of the self-moving device is to drive at a reduced speed so as to lower to a height corresponding to the step; and
when the obstacle is the step, the step is below the ground and the maximum vertical distance to the ground is greater than or equal to the fourth threshold, determining that the working strategy of the self-moving device is to change the moving direction so as to avoid the obstacle.

### Claim 9 (depends on 1)

The obstacle identification method according to claim 1, wherein after using pixel coordinates of the reflected light in the environment image to determine the contour information of the object acted on by the line laser, the obstacle identification method further comprises: determining the number of protrusions of a contour shape in the contour information;
when the number of the protrusions is greater than a number threshold, and when the contour indicated by the contour information is determined as an obstacle contour, the obstacle identification method determines that the object acted by the line laser is an obstacle; and when the number of the protrusions is less than or equal to the number threshold, the obstacle identification method determines that the contour indicated by the contour information is not an obstacle contour.

### Claim 10 (depends on 9)

The obstacle identification method according to claim 9, wherein when the number of the protrusions is greater than the number threshold, a non-image identification algorithm is adopted to determine the contour information.

### Claim 11 (depends on 1)

The obstacle identification method according to claim 1, wherein after using pixel coordinates of the reflected light in the environment image to determine the contour information of the object acted on by the line laser, the obstacle identification method further comprises:
comparing a contour shape in the contour information with a template shape, if the contour shape matches the template shape, the contour indicated by the contour information is the obstacle contour; if the contour shape does not match the template shape, the contour indicated by the contour information is not the obstacle contour;
wherein the template shape comprises contour shapes of a plurality of obstacles.

### Claim 12 (depends on 1)

The obstacle identification method according to claim 1, wherein when the line laser hits a flat ground, a ground information extracted from the environmental image captured by the image acquisition component is flat and smooth; and when the obstacle is a carpet and the line laser hits the carpet, a ground information extracted from the environmental image captured by the image acquisition component is irregular data with noise.

### Claim 13 (depends on 1)

The obstacle identification method according to claim 1, wherein using the pixel coordinates of the reflected light in the environment image to determine the contour information of the object acted on by the line laser, comprises:
determining the number of protrusions of a contour shape in the contour information; wherein when the line laser hits a flat ground, a ground information extracted from the environmental image captured by the image acquisition component is flat and smooth; and when the obstacle is a carpet and the line laser hits the carpet, an extracted ground information is irregular data with noise;
when the number of the protrusions is greater than a number threshold, and when the contour indicated by the contour information is determined as an obstacle contour by using a non-image identification algorithm, the obstacle identification method determines that the object acted by the line laser is an obstacle; and when the number of the protrusions is less than or equal to the number threshold, the obstacle identification method determines that the contour indicated by the contour information is not an obstacle contour.

### Claim 14 (depends on 1)

The obstacle identification method according to claim 1, wherein after using pixel coordinates of the reflected light in the environment image to determine the contour information of the object acted on by the line laser, the obstacle identification method further comprises:
determining the number of protrusions of a contour shape in the contour information;
when the number of the protrusions is less than or equal to a number threshold, determining a first vertical distance between the ground and the first line laser emitter;
when the number of the protrusions is greater than the number threshold, determining the contour indicated by the contour information is the obstacle contour, and determining a second vertical distance between the object acted on by the line laser and the first line laser emitter based on a principle of laser ranging and the pixel coordinates of the contour information; and
determining a difference between the second vertical distance and the first vertical distance as the vertical distance.

### Claim 15

An obstacle identification apparatus, the obstacle identification apparatus being used in a self-moving device on which a first line laser emitter and an image acquisition component are installed; the first line laser emitter being adapted to emit line laser obliquely and downwardly along a moving direction; the image acquisition component being adapted to collect an environmental image including reflected light obtained by the line laser reflected by an object; the obstacle identification apparatus comprising:
an image acquisition module adapted to acquire the environment image sent by the image acquisition component;
a contour determination module adapted to use pixel coordinates of the reflected light in the environmental image to determine contour information of the object acted on by the line laser; and
an object identification module adapted to determine that the object acted on by the line laser is an obstacle when a contour indicated by the contour information is an obstacle contour.

### Claim 16 (depends on 15)

The obstacle identification apparatus according to claim 15, further comprising a processor and a memory; a program being stored in the memory, and the program being loaded and executed by the processor to realize an obstacle identification method; the obstacle identification method being used in a self-moving device on which a first line laser emitter and an image acquisition component are installed; the first line laser emitter being adapted to emit line laser obliquely and downwardly along a moving direction; the image acquisition component being adapted to collect an environmental image including reflected light obtained by the line laser reflected by an object; the obstacle identification method comprising:
acquiring the environment image sent by the image acquisition component;
using pixel coordinates of the reflected light in the environment image to determine contour information of the object acted on by the line laser; and
determining that the object acted on by the line laser is an obstacle when a contour indicated by the contour information is an obstacle contour.

### Claim 17 (depends on 16)

The obstacle identification apparatus according to claim 16, wherein after determining that the object acted on by the line laser is the obstacle, the obstacle identification apparatus further comprises:
acquiring a first vertical distance between the ground and the first line laser emitter;
determining a second vertical distance between the object acted on by the line laser and the first line laser emitter based on a principle of laser ranging and the pixel coordinates of the contour information; and
determining a difference between the second vertical distance and the first vertical distance as the vertical distance.

### Claim 18 (depends on 16)

The obstacle identification apparatus according to claim 16, wherein after determining that the object acted on by the line laser is the obstacle, the obstacle identification apparatus further comprises:
when the obstacle is a carpet, and a vertical distance of the carpet with respect to the ground is greater than a first threshold and less than a second threshold, determining that the working strategy of the self-moving device is to speed up driving so as to surpass the obstacle;
when the obstacle is the carpet, and the vertical distance of the carpet with respect to the ground is greater than or equal to the second threshold, determining that the working strategy of the self-moving device is to change the moving direction so as to avoid the obstacle;
when the obstacle is a step, the step is below the ground and a maximum vertical distance to the ground is greater than a third threshold and less than a fourth threshold, determining that the working strategy of the self-moving device is to drive at a reduced speed so as to lower to a height corresponding to the step; and
when the obstacle is the step, the step is below the ground and the maximum vertical distance to the ground is greater than or equal to the fourth threshold, determining that the working strategy of the self-moving device is to change the moving direction so as to avoid the obstacle.

### Claim 19

A self-moving device, comprising: a shell, a first line laser emitter, an image acquisition component and a control component; the first line laser emitter being disposed on the shell, and being adapted to emit line laser obliquely and downwardly along a moving direction; the image acquisition component being adapted to collect an environmental image comprising reflected light obtained by the line laser reflected by an object; the first line laser emitter and the image acquisition component being respectively connected in communication with the control component, the control component being adapted to:
acquire the environment image sent by the image acquisition component;
use pixel coordinates of the reflected light in the environment image to determine contour information of the object acted on by the line laser; and
determine that the object acted on by the line laser is an obstacle when a contour indicated by the contour information is an obstacle contour.

### Claim 20 (depends on 19)

The self-moving device according to claim 19, further comprising a second line laser emitter, the second line laser emitter being adapted to emit another line laser, an emission direction of the another line laser being different from an emission direction of the line laser; the environmental image also comprising reflected light obtained by the another line laser reflected by the object.
