# US 2021/0172741 A1 · Accompanying service method and device for intelligent robot

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0172741 A1
- Document ID: US20210172741A1
- Status: Published application
- Kind: A1
- Application number: 17/103,141
- Filed: 2020-11-24
- Published: 2021-06-10
- Earliest claimed: 2019-12-04
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Juan Liu; Rui Pan; Xinyan Mei; Kangkang Zhu; Xudong Jiang; Jie Chen
- Web page: https://patentgrep.com/patent/US20210172741A1

## CPC

- G01C 21/20: Instruments for performing navigational calculations (G01C21/24, G01C21/26 take precedence)
- G05D 1/0274: {using mapping information stored in a memory device (navigation using map-matching G01C21/30)}
- G05D 1/0214: {in accordance with safety or protection criteria, e.g. avoiding hazardous areas (monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13)}
- G05D 1/0257: {using a radar (radar systems designed for anti-collision purposes between land vehicles or between land vehicle and fixed obstacles G01S13/931)}
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

## Abstract

An accompanying service method for a robot includes obtaining a map model of a set area; planning an accompanying user path from a current position of the robot to a destination position based on the map model of the set area; monitoring an accompanied user in real time in a process of accompanying the user to travel on the planned accompanying user path; and based on the accompanied user being lost, searching for the accompanied user using a search model.

## Claims

### Claim 1

An accompanying service method for a robot, comprising:
obtaining a map model of a set area;
planning an accompanying user path from a current position of the robot to a destination position based on the map model of the set area;
monitoring an accompanied user in real time in a process of accompanying the user to travel on the planned accompanying user path; and
based on the accompanied user being lost, searching for the accompanied user using a search model.

### Claim 2 (depends on 1)

The method of claim 1, wherein the searching for the accompanied user by using the search model comprises:
dividing the map model into four quadrants based on a plane rectangular coordinate system;
traveling straight along a current path until an obstacle is met;
detecting a movement direction of the robot within a set period of time using a movement trend estimation method and determining a next movement direction of the robot;
determining a next quadrant to which the robot is to move according to the next movement direction of the robot, and searching the next quadrant by setting it as a current quadrant; and
repeating the traveling straight along the current path, the detecting the movement direction of the robot within a set period of time, the determining the next movement direction of the robot, the determining a next quadrant to which the robot is to move; and the searching the next quadrant until the accompanied user is found.

### Claim 3 (depends on 2)

The method of claim 2, further comprising, before determining the next movement direction of the robot:
setting an inner point and an outer point in each quadrant; and
estimating that the movement direction of the robot within the set period of time is inward movement or outward movement;
wherein the determining the next quadrant to which the robot is to move according to the next movement direction of the robot comprises:
based on a movement trend of the robot being outward movement and the movement direction of the robot on a plane is horizontal movement, determining a next target quadrant as a next quadrant of the current quadrant in a horizontal direction;
based on a movement trend of the robot being outward movement and the movement direction of the robot on the plane is vertical movement, determining the next target quadrant as the next quadrant of the current quadrant in a vertical direction; and
based on the movement trend of the robot being a move within the current quadrant, determining the next target quadrant as the current quadrant.

### Claim 4 (depends on 3)

The method of claim 3, wherein the searching the next quadrant by setting it as the current quadrant comprises:
searching the current quadrant in the order of the outer point and then the inner point, or in the order of the inner point and then the outer point.

### Claim 5 (depends on 4)

The method of claim 4, wherein a search path for searching for the accompanied user by using the search model does not comprise a return path, and
wherein search priorities are set for the quadrants, and a search priority of a quadrant where a doorway in the map model is located is set to the lowest, so that the robot searches the quadrant where the doorway is located last according to the search priority.

### Claim 6 (depends on 1)

The method of claim 1, wherein the process of accompanying the user to travel on the planned accompanying user path comprises:
monitoring an obstacle on the planned accompanying user path in real time;
based on detecting the obstacle, determining whether the obstacle affects accompanying the user to travel;
based on the obstacle affecting accompanying the user to travel, going around the obstacle; and
based on the obstacle not affecting accompanying the user to travel, continuing to travel.

### Claim 7 (depends on 1)

The method of claim 1, wherein the accompanying the user to travel on the planned accompanying user path comprises:
based on the accompanied user instructing the robot to guide the user, guiding the user to travel; and
based on the accompanied user instructing the robot to follow the user, following the user to travel.

### Claim 8 (depends on 7)

The method of claim 7, wherein, based on the accompanying the user to travel being guiding the user to travel, the monitoring the accompanied user in real time comprises:
based on the robot determining that tracking for the accompanied user is normal and setting a safe monitoring distance, monitoring the accompanied user in real time and confirming whether the accompanied user is following the robot;
based on detecting that the accompanied user is within a set following distance, continuing to travel;
based on detecting that the accompanied user is outside the set safe monitoring distance, switching to a search mode, relocating the accompanied user and continuing to guide the accompanied user to travel;
based on detecting that the accompanied user is outside the set following distance, but within the set safe monitoring distance, switching to a tracking mode and tracking the accompanied user; and
based on detecting that the accompanied user enters the set following distance, switching to a forward state and continuing to travel; and
based on the accompanying the user to travel being following the user to travel, the monitoring the accompanied user in real time comprises:
initializing a position and speed state information of the accompanied user;
estimating the position and travel speed of the accompanied user;
creating a feature template of the accompanied user and performing pedestrian detection on a collected image;
travelling according to a travel state of the accompanied user;
detecting a distance to an obstacle ahead by using a radar module, and controlling the robot within the set following distance; and
adjusting travel speed of the robot according to the estimated travel speed of the accompanied user.

### Claim 9 (depends on 1)

The method of claim 1, further comprising, before searching for the accompanied user by using the search model:
searching for the accompanied user on the planned companying user path and relocating the accompanied user;
based on the relocating being successful, terminating the process; and
based on the relocating being unsuccessful, performing the step of searching for the accompanied user by using the search model.

### Claim 10 (depends on 9)

The method of claim 9, wherein the searching for the accompanied user and relocating the accompanied user comprises:
based on determining that the accompanying the user to travel is guiding the user to travel, performing a reverse search based on the planned accompanying user path;
based on determining that the accompanying the user to travel is following the user to travel, performing a forward search based on the planned accompanying user path;
during the reverse or forward search process, obtaining images, obtaining feature information of each pedestrian in the images, and calculating feature similarity between the feature information of each pedestrian and the feature template of the accompanied user; and
based on a maximum feature similarity being greater than a set similarity threshold, determining that a pedestrian having the maximum feature similarity is the accompanied user.

### Claim 11

An accompanying service device for a robot, comprising a setting module, a path planning module, an accompanying monitoring module and a user searching module, wherein:
the setting module is configured to obtain a map model of a set area;
the path planning module is configured to plan an accompanying user path from a current position of the robot to a destination position based on the map model of the set area;
the accompanying monitoring module is configured to monitor an accompanied user in real time in a process of accompanying the user to travel on the planned accompanying user path; and
the user searching module is configured to, based on the accompanied user being lost, search for the accompanied user using a search model.

### Claim 12 (depends on 11)

The device of claim 11, wherein the user searching module comprises a quadrant dividing and inner/outer search point setting sub-module, a search path piloting sub-module, and a target recognizing sub-module,
wherein the quadrant dividing and inner/outer search point setting sub-module is configured to divide the map model into four quadrants based on a plane rectangular coordinate system,
wherein the search path piloting sub-module is configured to detect that the robot travels straight along a current path until it meets an obstacle, detect a movement direction of the robot within a set period of time by using a movement trend estimation method, and determine a next movement direction of the robot,
wherein the target recognizing sub-module is configured to determine a next quadrant to which the robot is to move according to the next movement direction of the robot, and search the next quadrant by setting it as a current quadrant, and
wherein traveling straight along the current path, the detecting the movement direction of the robot within a set period of time, the determining the next movement direction of the robot, the determining a next quadrant to which the robot is to move, and the searching the next quadrant are repeated until the accompanied user is found.

### Claim 13 (depends on 12)

The device of claim 12, wherein the quadrant dividing and inner/outer search point setting sub-module is further configured to set an inner point and an outer point in each quadrant,
wherein the search path piloting sub-module is further configured to estimate that the movement direction of the robot within the set period of time is inward movement or outward movement based on the inner point and the outer point set in each quadrant, and
wherein the determining a next quadrant to which the robot is to move according to the next movement direction of the robot comprises:
based on a movement trend of the robot being outward movement and the movement direction of the robot on a plane is a horizontal movement, determining a next target quadrant as a next quadrant of the current quadrant in a horizontal direction;
based on a movement trend of the robot being outward movement and the movement direction of the robot on the plane is a vertical movement, determining the next target quadrant as the next quadrant of the current quadrant in a vertical direction; and
based on the movement trend of the robot being a move within the current quadrant, determining the next target quadrant as the current quadrant.
