# US 2024/0197130 A1 · Structured light module and self-moving device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0197130 A1
- Document ID: US20240197130A1
- Status: Published application
- Kind: A1
- Application number: 18/442,785
- Filed: 2024-02-15
- Published: 2024-06-20
- Earliest claimed: 2021-08-17
- Assignees: Ecovacs Robotics Co., Ltd.
- Applicants: Ecovacs Robotics Co., Ltd.
- Inventors: Kaili XU; Xiao LUO; Junjie SHAN; Wei CHEN; Yongdong WU; Peng ZHANG; Yang LIU
- Web page: https://patentgrep.com/patent/US20240197130A1

## CPC

- A47L 11/24: Floor-sweeping machines, motor-driven
- G05D 1/242: Means based on the reflection of waves generated by the vehicle (using passive navigation aids external to the vehicle G05D1/244; using signals provided by artificial sources external to the vehicle G05D1/247)
- A47L 9/2826: {the condition of the floor}
- A47L 9/30: Arrangement of illuminating devices
- A47L 11/4008: {Arrangements of switches, indicators or the like}
- A47L 11/4011: {Regulation of the cleaning machine by electric means; Control systems and remote control systems therefor}
- G01S 7/4813: {Housing arrangements}
- G01S 17/931: of land vehicles
- G05D 1/228: Command input arrangements located on-board unmanned vehicles
- G05D 1/2435: {Extracting 3D information}
- G05D 1/2462: {using feature-based mapping}
- G05D 1/2467: {using a semantic description of the environment}
- G05D 1/622: Obstacle avoidance (predicting or avoiding probable or impending collision of road vehicles B60W30/08)
- G06V 10/145: Illumination specially adapted for pattern recognition, e.g. using gratings
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- H04N 23/56: provided with illuminating means
- H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
- A47L 2201/00: Robotic cleaning machines, i.e. with automatic control of the travelling movement or the cleaning operation
- G05D 2101/20: using external object recognition
- G05D 2105/10: for cleaning, vacuuming or polishing
- G05D 2107/40: Indoor domestic environment
- G05D 2109/10: Land vehicles
- G05D 2111/10: Optical signals
- G05D 2111/17: {Coherent light, e.g. laser signals}
- A47L: DOMESTIC WASHING OR CLEANING (brushes A46B; cleaning quantities of bottles or of other hollow articles of one kind B08B9/00; laundry D06F); SUCTION CLEANERS IN GENERAL (cleaning in general B08)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The application provides a structured light module and an autonomous mobile device. The structured light module includes a first camera and line laser emitters for collecting a first environmental image containing laser stripes generated when the line laser encounters an object. The structured light module can also capture a visible light image through a second environmental image that does not contain laser stripes. Both the first and second environmental images can help to detect more accurate and richer environmental information, expanding the application range of laser sensors.

## Claims

### Claim 1

A structured light module comprising:
a first camera, line laser emitters distributed on both sides of the first camera, and a second camera, wherein, the line laser emitters are for emitting line lasers, the first camera is for collecting a first environmental image detected by the line lasers during their emission, and the second camera is for collecting a second environmental image within its field of view; the first environmental image includes a laser image with laser stripes produced when the line lasers encounter an object, and the second environmental image is a visible light image that does not include laser stripes.

### Claim 2 (depends on 1)

The structured light module according to claim 1, further comprising: an indicator light for indicating a working state of the second camera, and the indicator light being on indicating that the second camera is in a working state.

### Claim 3 (depends on 2)

The structured light module according to claim 2, wherein the indicator light and the second camera are symmetrically arranged on both sides of the first camera.

### Claim 4 (depends on 1)

The structured light module according to claim 1, wherein an optical axis of the first camera is tilted downward at a first angle relative to a horizontal plane parallel to the ground, and an optical axis of each of the line laser emitters is tilted downward at a second angle relative to the horizontal plane, with the second angle being smaller than the first angle.

### Claim 5 (depends on 4)

The structured light module according to claim 4, wherein the optical axis of the second camera is parallel to the horizontal plane.

### Claim 6 (depends on 3)

The structured light module according to claim 3, wherein, at an installation position, the line laser emitters, the indicator light, the first camera, and the second camera are located at the same height.

### Claim 7 (depends on 3)

The structured light module according to claim 3, further comprising: a mount; the line laser emitter, the indicator light, the first camera, and the second camera are assembled on the mount.

### Claim 8 (depends on 7)

The structured light module according to claim 7, wherein the mount comprises: a main body and ends located on both sides of the main body; wherein, the indicator light, the first camera, and the second camera are assembled on the main body, and the line laser emitters are assembled on the ends;
wherein, an end face of each end is oriented towards a reference surface, so that a centerline of the line laser emitter on that end intersects with a centerline of the first camera at a point; the reference surface is a plane perpendicular to an end face of the main body or a tangent plane of the end face of the main body.

### Claim 9 (depends on 8)

The structured light module according to claim 8, wherein three grooves are provided at a middle position of the main body, the indicator light, the first camera, and the second camera are installed in the corresponding grooves; mounting holes are provided on the ends, and the line laser emitters are installed in the mounting holes.

### Claim 10 (depends on 7)

The structured light module according to claim 7, further comprising: a module controller, wherein the line laser emitters, the first camera, and the indicator light are electrically connected to the module controller respectively; and the module controller and the second camera are electrically connected to a main controller of the autonomous mobile device respectively;
the main controller is used to send working state information of the second camera to the module controller; the module controller is used to control the on/off state of the indicator light based on the working state information of the second camera.

### Claim 11 (depends on 10)

The structured light module according to claim 10, further comprising: a fixed cover assembled above the mount; wherein a cavity is formed between the fixed cover and the mount to accommodate connection wires between the line laser emitters, the first camera, and the module controller, and the connection wires between the module controller and the second camera and the main controller.

### Claim 12 (depends on 1)

The structured light module according to claim 1, wherein each of the line laser emitters includes an optical shaping lens, which is a cylindrical lens or a wave lens.

### Claim 13 (depends on 12)

The structured light module according to claim 12, wherein, when the optical shaping lens of each of the line laser emitters is a wave lens, within an angular range of [−30, 30] degrees relative to the optical axis of the line laser emitter, the light intensity of the line laser is the strongest.

### Claim 14 (depends on 12)

The structured light module according to claim 12, wherein, when the optical shaping lens of each of the line laser emitter is a cylindrical lens, within an angular range of [−10, 10] degrees relative to the optical axis of the line laser emitter, the light intensity of the line laser is the strongest.

### Claim 15 (depends on 1)

The structured light module according to claim 1, wherein the angle between the optical axis of each of the line laser emitters and a baseline of the structured light module ranges from [50, 60] degrees.

### Claim 16

An autonomous mobile device, comprising: a device body, on which a main controller and a structured light module are installed, the main controller being electrically connected to the structured light module;
wherein, the structured light module comprises: a first camera, line laser emitters distributed on both sides of the first camera, a second camera, and a module controller;
wherein, the module controller controls the line laser emitters to emit line lasers externally and controls the first camera to collect a first environmental image detected by the line lasers during their emission, and sends the first environmental image to the main controller; the main controller controls the second camera to collect a second environmental image within its field of view and performs functional control of the autonomous mobile device based on the first and second environmental images; wherein, the first environmental image includes a laser image with laser stripes produced when the line lasers encounter an object, and the second environmental image is a visible light image that does not include laser stripes.

### Claim 17 (depends on 16)

The structured light module according to claim 16, wherein an optical axis of the first camera is tilted downward at a first angle relative to a horizontal plane parallel to the ground, and an optical axis of each of the line laser emitters is tilted downward at a second angle relative to the horizontal plane, with the second angle being smaller than the first angle.

### Claim 18

A method applicable to an autonomous mobile device equipped with a structured light module, the method comprising:
using structured light components and visual sensors in the structured light module to respectively collect structured light data and image data in an operation area ahead;
based on the image data, identifying a category of a target object present in the operation area ahead, and selecting a target machine behavior mode that matches the category of the target object;
based on the structured light data, controlling the autonomous mobile device to perform an operation task in connection with the target object present in the operation area ahead according to the target machine behavior mode.

### Claim 19 (depends on 18)

The method according to claim 18, wherein,
when the category of the target object is prone to jamming and impassable, selecting the target machine behavior mode that matches the category of the target object comprises: selecting an obstacle avoidance behavior mode as the target machine behavior mode;
when the category of the target object is prone to jamming and passable, selecting the target machine behavior mode that matches the category of the target object comprises: selecting an accelerated passage behavior mode as the target machine behavior mode;
when the category of the target object is prone to entanglement, selecting the target machine behavior mode that matches the category of the target object comprises: selecting a reduced-speed operation behavior mode as the target machine behavior mode;
when the category of the target object is prone to dirtiness, selecting the target machine behavior mode that matches the category of the target object comprises: selecting an enhanced operation behavior mode as the target machine behavior mode; and
when the category of the target object is movable, selecting the target machine behavior mode that matches the category of the target object comprises: selecting a voice prompt behavior mode as the target machine behavior mode.

### Claim 20 (depends on 18)

The method according to claim 18, wherein, based on the structured light data, controlling the autonomous mobile device to perform the operation task in connection with the target object present in the operation area ahead according to the target machine behavior mode comprises:
based on the structured light data, identifying position information and/or shape parameters of the target object present in the operation area ahead;
based on the position information and/or shape parameters of the target object, controlling the autonomous mobile device to perform the operation task in connection with the target object according to the target machine behavior mode.
