# US 2021/0330164 A1 · Robot cleaner and controlling method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0330164 A1
- Document ID: US20210330164A1
- Status: Published application
- Kind: A1
- Application number: 17/221,432
- Filed: 2021-04-02
- Published: 2021-10-28
- Earliest claimed: 2020-04-22
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Minwoo RYU; Changho HA; Jinhee KIM; Shin KIM; Donghun LEE
- Web page: https://patentgrep.com/patent/US20210330164A1

## CPC

- A47L 11/4011: {Regulation of the cleaning machine by electric means; Control systems and remote control systems therefor}
- G05D 1/0214: {in accordance with safety or protection criteria, e.g. avoiding hazardous areas (monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13)}
- G05D 1/0238: {using obstacle or wall sensors (G05D1/0246 and G05D1/0289 take precedence; lidar systems designed for anti-collision purposes G01S17/93)}
- G05D 1/0246: {using a video camera in combination with image processing means}
- G05D 1/0248: {in combination with a laser (lasers per se H01S)}
- G05D 1/027: {comprising intertial navigation means, e.g. azimuth detector (inertial navigation G01C21/16; inertial navigation combined with non-inertial navigation instruments G01C21/165)}
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06V 20/64: Three-dimensional [3D] objects
- A47L 2201/04: Automatic control of the travelling movement; Automatic obstacle detection
- A47L: DOMESTIC WASHING OR CLEANING (brushes A46B; cleaning quantities of bottles or of other hollow articles of one kind B08B9/00; laundry D06F); SUCTION CLEANERS IN GENERAL (cleaning in general B08)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A robot cleaner is provided. The robot cleaner includes a three-dimensional image sensor, an optical sensor, a gyro sensor, and at least one processor configured to control a driving state of the robot cleaner based on image data acquired by the three-dimensional image sensor, optical data acquired by the optical sensor, and angular velocity data acquired by the gyro sensor, wherein the three-dimensional image sensor and the optical sensor are respectively arranged to be tilted by a predetermined tilting angle, and a tilting angle of the three-dimensional image sensor is smaller than a tilting angle of the optical sensor.

## Claims

### Claim 1

A robot cleaner comprising:
a three-dimensional image sensor;
an optical sensor;
a gyro sensor; and
at least one processor configured to:
control a driving state of the robot cleaner based on image data acquired by the three-dimensional image sensor, optical data acquired by the optical sensor, and angular velocity data acquired by the gyro sensor,
wherein the three-dimensional image sensor and the optical sensor are respectively arranged to be tilted by a predetermined tilting angle, and
wherein a tilting angle of the three-dimensional image sensor is smaller than a tilting angle of the optical sensor.

### Claim 2 (depends on 1)

The robot cleaner of claim 1,
wherein the optical sensor is arranged to be lower than a location of the three-dimensional image sensor.

### Claim 3 (depends on 1)

The robot cleaner of claim 1, wherein the optical sensor and the three-dimensional image sensor are arranged outside a housing of the robot cleaner.

### Claim 4 (depends on 1)

The robot cleaner of claim 1,
wherein arrangement height information of the three-dimensional image sensor is between 35 mm and 85 mm, and
wherein the predetermined tilting angle is between 0 degrees and 19 degrees.

### Claim 5 (depends on 1)

The robot cleaner of claim 1,
wherein the three-dimensional image sensor tilting angle is determined based on an arrangement height of the three-dimensional image sensor, a field of view of the three-dimensional image sensor, and a minimum detection distance of the three-dimensional image sensor, and
wherein the optical sensor is arranged to detect an area between a wheel of the robot cleaner and the minimum detection distance of the three-dimensional image sensor.

### Claim 6 (depends on 1)

The robot cleaner of claim 1, wherein the at least one processor is further configured to:
acquire spatial information based on image data acquired from the three-dimensional image sensor,
control a driving state of the robot cleaner based on the acquired spatial information,
acquire a slope angle indicating a degree that the robot cleaner is tilted based on an X value and a Y value among an X value, a Y value, and a Z value acquired from the gyro sensor,
based on the slope angle being greater than or equal to a threshold value, change the acquired spatial information based on the slope angle, and
control a driving state of the robot cleaner based on the changed spatial information.

### Claim 7 (depends on 6)

The robot cleaner of claim 6, wherein the at least one processor is further configured to:
based on a time that the slope angle is maintained to be greater than or equal to the threshold value being greater than or equal to a threshold time, change the spatial information based on the acquired slope angle,
control a driving state of the robot cleaner based on the changed spatial information, and
based on the time that the slope angle is maintained to be greater than or equal to the threshold value being smaller than the threshold time, control a driving state of the robot cleaner based on the slope angle.

### Claim 8 (depends on 7)

The robot cleaner of claim 7, wherein the at least one processor is further configured to:
based on identifying that a fall risk area exists based on the acquired spatial information, identify a fall possibility based on sensing data acquired from the optical sensor, and
control a driving state of the robot cleaner based on the fall possibility.

### Claim 9 (depends on 1)

The robot cleaner of claim 1, wherein the at least one processor is further configured to:
based on a bottom characteristic not being identified based on sensing data acquired from the optical sensor, identify an object located under the robot cleaner based on acquired spatial information,
based on the object being identified, identify a height of the object, and
identify the bottom characteristic based on the identified height of the object.

### Claim 10 (depends on 1)

The robot cleaner of claim 1, wherein the at least one processor is further configured to:
identify an object located on a driving path of the robot cleaner based on acquired spatial information,
based on the identified object being a prestored subject to be avoided, control the driving state of the robot cleaner to avoid the object, and
based on the identified object not being the prestored subject to be avoided, control the driving state of the robot cleaner to run over the object.

### Claim 11

A controlling method of a robot cleaner, the controlling method comprising:
acquiring image data by a three-dimensional image sensor;
acquiring optical data by an optical sensor;
acquiring angular velocity data by a gyro sensor; and
controlling a driving state of the robot cleaner based on the acquired image data, the acquired optical data, and the acquired angular velocity data,
wherein the three-dimensional image sensor and the optical sensor are respectively arranged to be tilted by a predetermined tilting angle, and
wherein a tilting angle of the three-dimensional image sensor is smaller than a tilting angle of the optical sensor.

### Claim 12 (depends on 11)

The controlling method of a robot cleaner of claim 11,
wherein the optical sensor is arranged to be lower than a location of the three-dimensional image sensor.

### Claim 13 (depends on 11)

The controlling method of a robot cleaner of claim 11, wherein the optical sensor and the three-dimensional image sensor are arranged outside a housing of the robot cleaner.

### Claim 14 (depends on 11)

The controlling method of a robot cleaner of claim 11,
wherein arrangement height information of the three-dimensional image sensor is between 35 mm and 85 mm, and
wherein the predetermined tilting angle is between 0 degrees and 19 degrees.

### Claim 15 (depends on 11)

The controlling method of a robot cleaner of claim 11,
wherein the three-dimensional image sensor tilting angle is determined based on an arrangement height of the three-dimensional image sensor, a field of view of the three-dimensional image sensor, and a minimum detection distance of the three-dimensional image sensor, and
wherein the optical sensor is configured to detect an area between a wheel of the robot cleaner and the minimum detection distance of the three-dimensional image sensor.

### Claim 16 (depends on 11)

The controlling method of a robot cleaner of claim 11, wherein the controlling of the driving state further comprises:
acquiring spatial information based on image data acquired from the three-dimensional image sensor;
controlling a driving state of the robot cleaner based on the acquired spatial information;
acquiring a slope angle indicating a degree that the robot cleaner is tilted based on an X value and a Y value among an X value, a Y value, and a Z value acquired from the gyro sensor;
based on the slope angle being greater than or equal to a threshold value, changing the acquired spatial information based on the slope angle; and
controlling a driving state of the robot cleaner based on the changed spatial information.

### Claim 17 (depends on 16)

The controlling method of a robot cleaner of claim 16, wherein the controlling of the driving state further comprises:
based on a time that the slope angle is maintained to be greater than or equal to the threshold value being greater than or equal to a threshold time, changing the spatial information based on the acquired slope angle;
controlling a driving state of the robot cleaner based on the changed spatial information; and
based on the time that the slope angle is maintained to be greater than or equal to the threshold value being smaller than the threshold time, controlling a driving state of the robot cleaner based on the slope angle.

### Claim 18 (depends on 17)

The controlling method of a robot cleaner of claim 17, wherein the controlling of the driving state further comprises:
based on identifying that a fall risk area exists based on the acquired spatial information, identifying a fall possibility based on sensing data acquired from the optical sensor; and
controlling a driving state of the robot cleaner based on the fall possibility.

### Claim 19 (depends on 11)

The controlling method of a robot cleaner of claim 11, wherein the controlling of the driving state further comprises:
based on a bottom characteristic not being identified based on sensing data acquired from the optical sensor, identifying an object located under the robot cleaner based on acquired spatial information; and
based on the object being identified, identifying a height of the object, and identifying the bottom characteristic based on the identified height of the object.

### Claim 20 (depends on 11)

The controlling method of a robot cleaner of claim 11, wherein the controlling of the driving state further comprises:
identifying an object located on a driving path of the robot cleaner based on acquired spatial information;
based on the identified object being a prestored subject to be avoided, controlling the driving state of the robot cleaner to avoid the object; and
based on the identified object not being the prestored subject to be avoided, controlling the driving state of the robot cleaner to run over the object.
