# US 2022/0265106 A1 · Moving robot and control method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0265106 A1
- Document ID: US20220265106A1
- Status: Published application
- Kind: A1
- Application number: 17/743,935
- Filed: 2022-05-13
- Published: 2022-08-25
- Earliest claimed: 2016-11-24
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Dongki NOH; Seungmyun BAEK; Seungmin BAEK
- Web page: https://patentgrep.com/patent/US20220265106A1

## CPC

- A47L 11/4061: {Steering means; Means for avoiding obstacles; Details related to the place where the driver is accommodated}
- A47L 9/2805: {Parameters or conditions being sensed}
- A47L 9/2852: {Elements for displacement of the vacuum cleaner or the accessories therefor, e.g. wheels, casters or nozzles}
- A47L 11/4011: {Regulation of the cleaning machine by electric means; Control systems and remote control systems therefor}
- B25J 9/00: Program-controlled manipulators
- B25J 9/0003: {Home robots, i.e. small robots for domestic use}
- B25J 9/16: Program controls (total factory control, i.e. centrally controlling a plurality of machines, G05B19/418)
- B25J 9/1664: {characterised by motion, path, trajectory planning}
- B25J 9/1674: {characterised by safety, monitoring, diagnostic}
- B25J 11/00: Manipulators not otherwise provided for
- B25J 11/0085: {Cleaning}
- B25J 19/02: Sensing devices
- B25J 19/023: {including video camera means}
- B25J 19/06: Safety devices
- B25J 19/061: {with audible signals (audio controls B25J13/003)}
- G05D 1/0246: {using a video camera in combination with image processing means}
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/82: using neural networks
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- A47L 2201/04: Automatic control of the travelling movement; Automatic obstacle detection
- A47L: DOMESTIC WASHING OR CLEANING (brushes A46B; cleaning quantities of bottles or of other hollow articles of one kind B08B9/00; laundry D06F); SUCTION CLEANERS IN GENERAL (cleaning in general B08)
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Disclosed is a moving robot including: a travel unit configured to move a body; an image acquisition unit configured to acquire a surrounding image of the body; a sensor unit having one or more sensors configured to detect an obstacle while the body moves; a controller configured to: upon detection of an obstacle by the sensor unit, recognize an attribute of the obstacle based on an image acquired by the image acquisition unit, and control driving of the travel unit based on the attribute of the obstacle; and a sound output unit configured to: output preset sound when the recognized attribute of the obstacle indicates a movable obstacle. Accordingly, the moving robot improves stability, user convenience, driving efficiency, and cleaning efficiency.

## Claims

### Claim 1

A moving robot comprising:
a travel unit configured to move a body;
an image acquisition unit configured to acquire a plurality of surrounding image of the body continuously;
a sensor unit having one or more sensors configured to detect an obstacle while the body moves;
a controller configured to: upon detection of an obstacle by the sensor unit, recognize an attribute of the obstacle based on an image acquired by the image acquisition unit, and control driving of the travel unit based on the recognized attribute of the obstacle;
a sound output unit configured to: output preset sound when the recognized attribute of the obstacle indicates a movable obstacle; and
wherein the controller is further configured to: upon detection of an obstacle by the sensor unit,
based on a moving direction and a speed of the body, select an image captured at a particular point in time before the obstacle is detected by the sensor unit from among a plurality of continuous images; and
recognize the attribute of the obstacle included in the image captured at the particular point in time.

### Claim 2 (depends on 1)

The moving robot of claim 1, wherein the movable obstacle is part of a human body or a pet.

### Claim 3 (depends on 2)

The moving robot of claim 2, wherein the controller is further configured to stop moving the body when the recognized attribute of the obstacle indicates the movable obstacle.

### Claim 4 (depends on 3)

The moving robot of claim 3, wherein the controller is further configured to resume previous movement when movement of the movable obstacle is detected within a particular standby time.

### Claim 5 (depends on 4)

The moving robot of claim 4, wherein the controller is further configured to perform avoidance driving with respect to the movable obstacle when movement of the movable obstacle is not detected within the particular standby time.

### Claim 6 (depends on 4)

The moving robot of claim 4, wherein the controller is further configured to control the body to move forward and backward repeatedly within a predetermined distance range.

### Claim 7 (depends on 1)

The moving robot of claim 1, wherein the controller is further configured to perform a control operation so that avoidance driving is performed in a different pattern based on the recognized attribute of the obstacle.

### Claim 8 (depends on 2)

The moving robot of claim 2, wherein the preset sound is alert sound, or a message for guiding the movable obstacle to move.

### Claim 9 (depends on 1)

The moving robot of claim 1, wherein the controller comprises:
an obstacle recognition module configured to recognize the obstacle from the image, acquired by the image acquisition unit, based on data that is pre-learned using machine learning; and
a driving control module configured to control driving of the travel unit based on the attribute of the obstacle.

### Claim 10 (depends on 9)

The moving robot of claim 9, further comprising: a communication unit configured to receive machine learning-related data from a specific server,
wherein the object recognition module is updated based on the machine learning-related data received from the specific server.

### Claim 11 (depends on 9)

The moving robot of claim 9, further comprising: a storage unit configured to store a plurality of continuous images acquired by the image acquisition unit.

### Claim 12 (depends on 1)

The moving robot of claim 1, wherein the controller is further configured to:
perform control operations comprising:
when the obstacle is detected from a forward right side of the body, extracting a lower right part of the image acquired by the image acquisition unit;
when the obstacle is detected from a forward left side of the body, extracting a lower left part of the image acquired by the image acquisition unit; and
when the obstacle is detected from a front side of the body, extracting a lower center part of the image acquired.

### Claim 13 (depends on 1)

The moving robot of claim 1, wherein the controller is further configured to, when the moving speed is slower, select the image captured at an earlier point in time before the obstacle is detected by the sensor unit.

### Claim 14 (depends on 1)

The moving robot of claim 1, wherein the controller is configured to extract a partial region from the image acquired by the image acquisition unit based on a direction from which the obstacle is detected by the sensor unit.

### Claim 15

A control method of a moving robot, the method comprising:
detecting, by a sensor unit, an obstacle and acquiring by the image acquisition unit, a plurality of surrounding image of the body continuously while a body of the moving robot moves;
upon detection of the obstacle by the sensor unit, selecting an image captured at a particular point in time before the obstacle is detected by the sensor unit from among a plurality of continuous images acquired by the image acquisition unit based on a moving direction and a speed of the body;
recognizing an attribute of the obstacle included in the image captured at the particular point in time; and
controlling driving of a travel unit based on the recognized attribute of the obstacle.

### Claim 16 (depends on 15)

The control method of claim 15, wherein the movable obstacle is part of a human body or a pet.

### Claim 17 (depends on 16)

The control method of claim 16, further comprising: stopping moving the body when the recognized attribute of the obstacle indicates a movable obstacle.

### Claim 18 (depends on 17)

The control method of claim 17, further comprising: detecting whether the movable obstacle moves within a particular standby time;
wherein previous movement of the body before the stopping is resumed when movement of the movable obstacle is detected within the particular standby time.

### Claim 19 (depends on 18)

The control method of claim 18, further comprising: detecting whether the movable obstacle moves within a particular standby time,
wherein, when movement of the movable obstacle is not detected within the particular standby time, the controlling of driving of the travel unit based on the recognized attribute of the obstacle comprises controlling the travel unit to perform avoidance driving with respect to the movable obstacle.

### Claim 20 (depends on 16)

The control method of claim 16, further comprising: extracting a partial region from an image acquired by the image acquisition unit based on a direction from which the obstacle is detected by the sensor unit.
