# US 2021/0200234 A1 · Electronic apparatus and method of controlling thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0200234 A1
- Document ID: US20210200234A1
- Status: Published application
- Kind: A1
- Application number: 17/117,692
- Filed: 2020-12-10
- Published: 2021-07-01
- Earliest claimed: 2019-12-27
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Sukhoon SONG; Kyongsu KIM; Injoo KIM; Dongmin SHIN; Shin KIM
- Web page: https://patentgrep.com/patent/US20210200234A1

## CPC

- G05D 1/0246: {using a video camera in combination with image processing means}
- A47L 9/009: {Carrying-vehicles; Arrangements of trollies or wheels; Means for avoiding mechanical obstacles}
- A47L 9/2805: {Parameters or conditions being sensed}
- A47L 9/2826: {the condition of the floor}
- A47L 9/2852: {Elements for displacement of the vacuum cleaner or the accessories therefor, e.g. wheels, casters or nozzles}
- A47L 11/4011: {Regulation of the cleaning machine by electric means; Control systems and remote control systems therefor}
- A47L 11/4061: {Steering means; Means for avoiding obstacles; Details related to the place where the driver is accommodated}
- G05D 1/0221: {involving a learning process}
- G05D 1/0238: {using obstacle or wall sensors (G05D1/0246 and G05D1/0289 take precedence; lidar systems designed for anti-collision purposes G01S17/93)}
- G05D 1/0274: {using mapping information stored in a memory device (navigation using map-matching G01C21/30)}
- G05D 1/248: generated by satellites, e.g. GPS
- G05D 1/628: following the obstacle profile, e.g. a wall or undulated terrain
- A47L 2201/04: Automatic control of the travelling movement; Automatic obstacle detection
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- A47L: DOMESTIC WASHING OR CLEANING (brushes A46B; cleaning quantities of bottles or of other hollow articles of one kind B08B9/00; laundry D06F); SUCTION CLEANERS IN GENERAL (cleaning in general B08)

## Abstract

A robot vacuum cleaner is provided. The robot vacuum cleaner includes a camera, a memory configured to store an artificial intelligence model trained to identify an image from an input image and shape information corresponding to each of a plurality of objects, and a processor configured to control the electronic apparatus by being connected to the camera and the memory, wherein the processor is configured to input an image obtained by the camera to the artificial intelligence model to identify an object included in the image, obtain shape information corresponding to the identified object among the plurality of shape information stored in the memory, and set a traveling path of the robot vacuum cleaner based on the shape information and size information related to the object.

## Claims

### Claim 1

A robot vacuum cleaner comprising:
a camera;
a memory configured to store an artificial intelligence model trained to identify an image from an input image and shape information corresponding to each of a plurality of objects; and
a processor configured to control the robot vacuum cleaner by being connected to the camera and the memory, wherein the processor is further configured to:
input an image obtained by the camera to the artificial intelligence model to identify an object included in the image,
obtain shape information corresponding to the identified object among the shape information stored in the memory, and
set a traveling path of the robot vacuum cleaner based on the shape information and size information related to the object.

### Claim 2 (depends on 1)

The robot vacuum cleaner of claim 1,
wherein the memory is further configured to store size information for each of the shape information, and
wherein the processor is further configured to obtain size information corresponding to the shape information based on the image, or obtain size information corresponding to the shape information based on the size information stored in the memory.

### Claim 3 (depends on 1)

The robot vacuum cleaner of claim 1, wherein the processor is further configured to:
identify a plan shape corresponding to the object based on the shape information of the object, and
set the traveling path for avoiding the object based on the plan shape of the object.

### Claim 4 (depends on 1)

The robot vacuum cleaner of claim 1, further comprising:
an obstacle detecting sensor, wherein the processor is further configured to set the traveling path for avoiding the object based on sensing data of the obstacle detecting sensor, based on a plan view corresponding to the object being failed to be obtained.

### Claim 5 (depends on 1)

The robot vacuum cleaner of claim 1,
wherein the memory is further configured to store information on whether there is an object to avoid for each of the plurality of objects, and
wherein the processor is further configured to set the traveling path to climb the object, based on the object being identified as an object not to avoid based on the information on whether there is an object to avoid.

### Claim 6 (depends on 5)

The robot vacuum cleaner of claim 5, wherein the processor is further configured to stop a suction operation of the robot vacuum cleaner while climbing the object.

### Claim 7 (depends on 1)

The robot vacuum cleaner of claim 1,
wherein the memory is further configured to further store first weight value information for each object corresponding to a first area, and second weight value information for each object corresponding to a second area, and
wherein the processor is further configured to:
based on a plurality of objects being identified from the image obtained by the camera, apply the first weight value information to each of the plurality of objects to obtain first area prediction information,
apply the second weight value information to each of the plurality of objects to obtain second area prediction information, and
identify an area in which the robot vacuum cleaner is located as any one of the first area or the second area based on the first area prediction information and the second area prediction information.

### Claim 8 (depends on 7)

The robot vacuum cleaner of claim 7, further comprising:
a communication circuitry,
wherein the processor is further configured to, based on the area in which the robot vacuum cleaner is located being identified any one of the first area or the second area, control the communication circuitry to transmit identification information on the identified area, a plan view of the identified area, a plan shape corresponding to each of the plurality of objects located in the area to an external server.

### Claim 9 (depends on 1)

The robot vacuum cleaner of claim 1, wherein the processor is further configured to:
based receiving on a user command that indicates an object, identify an object corresponding to the user command among the objects identified from the image, and
drive the robot vacuum cleaner such that the robot vacuum cleaner moves to a location of the identified object based on a plan view with respect to an area in which the robot vacuum cleaner is located and a plan shape with respect to at least one object located in the area.

### Claim 10 (depends on 9)

The robot vacuum cleaner of claim 9, wherein the processor is further configured to:
obtain shape information corresponding to the identified object among the shape information stored in the memory, and
set a traveling path for cleaning surroundings of the object based on the shape information and size information related to the object.

### Claim 11

A method of controlling a robot vacuum cleaner including an artificial intelligence model trained to identify an object from an input image, the method comprising:
inputting an image obtained by a camera to the artificial intelligence model to identify an object included in the image;
obtaining shape information corresponding to the identified object among a plurality of shape information; and
setting a traveling path of the robot vacuum cleaner based on the obtained shape information and size information related to the object.

### Claim 12 (depends on 11)

The method of claim 11,
wherein the method further comprises storing size information for each shape of the plurality of shape information, and
wherein the obtaining of the shape information comprises obtaining size information corresponding to the shape information based on the image, or obtaining size information corresponding to the shape information based on the size information stored in a memory.

### Claim 13 (depends on 11)

The method of claim 11, wherein the setting of the traveling path comprises:
identifying a plan shape corresponding to the object based on the obtained shape information of the object, and
setting the traveling path for avoiding the object based on the plan shape of the object.

### Claim 14 (depends on 11)

The method of claim 11, wherein the setting of the traveling path comprises setting the traveling path to avoid the object based on sensing data of an obstacle detecting sensor, based failing to obtain a plan view corresponding to the object.

### Claim 15 (depends on 11)

The method of claim 11,
wherein the method further comprises storing information on whether there is an object to avoid for each of the plurality of objects, and
wherein the setting of the traveling path comprises setting the traveling path to climb the object, based on the object being identified as an object not to avoid based on the information on whether there is an object to avoid.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
stopping a suction operation of the robot vacuum cleaner while climbing the object.

### Claim 17 (depends on 11)

The method of claim 11, further comprising:
storing a first weight value information for each object corresponding to a first area, and second weight value information for each object corresponding to a second area; and
based on a plurality of objects being identified from the image obtained by the camera, applying the first weight value information to each of the plurality of objects to obtain first area prediction information;
applying the second weight value information to each of the plurality of objects to obtain second area prediction information; and
identifying an area in which the robot vacuum cleaner is located as any one of the first area or the second area based on the first area prediction information and the second area prediction information.

### Claim 18 (depends on 17)

The method of claim 17, further comprising:
based on the area in which the robot vacuum cleaner is located being identified as any one of the first area or the second area, transmitting, to an external server, identification information on the identified area, a plan view of the identified area, and a plan shape corresponding to each of the plurality of objects located in the area.

### Claim 19 (depends on 11)

The method of claim 11, further comprising:
based on receiving a user command that indicates an object, identifying an object corresponding to the user command among the objects identified from the image; and
driving the robot vacuum cleaner such that the robot vacuum cleaner moves to a location of the identified object based on a plan view with respect to an area in which the robot vacuum cleaner is located and a plan shape with respect to at least one object located in the area.

### Claim 20 (depends on 19)

The method of claim 19 further comprising:
obtaining shape information corresponding to the identified object among the shape information stored in a memory; and
setting a traveling path for cleaning surroundings of the object based on the shape information and size information related to the object.
