# US 2016/0260027 A1 · Robot controlling apparatus and robot controlling method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0260027 A1
- Document ID: US20160260027A1
- Status: Published application
- Kind: A1
- Application number: 15/051,893
- Filed: 2016-02-24
- Published: 2016-09-08
- Earliest claimed: 2015-03-03
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Nobuaki Kuwabara; Masahiro Suzuki; Kazuhiko Kobayashi; Yusuke Nakazato
- Web page: https://patentgrep.com/patent/US20160260027A1

## CPC

- G05B 19/4155: characterised by program execution, i.e. part program or machine function execution, e.g. selection of a program
- B25J 9/1676: {Avoiding collision or forbidden zones}
- B25J 13/08: by means of sensing devices, e.g. viewing or touching devices
- B25J 19/06: Safety devices
- F16P 3/142: {using image capturing devices}
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 20/00: Machine learning
- G05B 2219/39205: Markov model
- G05B 2219/40116: Learn by operator observation, symbiosis, show, watch
- G05B 2219/40201: Detect contact, collision with human
- G05B 2219/40202: Human robot coexistence
- Y10S 901/03: Teaching system
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- F16P: SAFETY DEVICES IN GENERAL; {SAFETY DEVICES FOR PRESSES}
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- Y10S: TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS

## Abstract

To enable work safely in a space where a robot and a worker coexist without defining an area in a work space using a monitoring boundary or the like and thus improve productivity, there is provided a robot controlling apparatus which controls the robot by detecting time-series states of the worker and the robot, and comprises: a detecting unit configured to detect a state of the worker; a learning information holding unit configured to hold learning information obtained by learning the time-series states of the robot and the worker; and a controlling unit configured to control an operation of the robot based on the state the worker output from the detecting unit and the learning information output from the learning information holding unit.

## Claims

### Claim 1

A robot controlling apparatus which controls a robot by detecting time-series states of a worker and the robot, comprising:
a detecting unit configured to detect a state of the worker;
a learning information holding unit configured to hold learning information obtained by learning the time-series states of the robot and the worker; and
a controlling unit configured to control an operation of the robot based on the state of the worker output from the detecting unit and the learning information output from the learning information holding unit.

### Claim 2 (depends on 1)

The robot controlling apparatus according to claim 1, wherein
the controlling unit further comprises a deciding unit configured to obtain the time-series state of the worker from the detected state of the worker, and decide whether or not the obtained time-series state of the worker is similar to the time-series state of the worker included in the learning information, and
the controlling unit controls the operation of the robot based on a decision result of the deciding unit.

### Claim 3 (depends on 2)

The robot controlling apparatus according to claim 2, wherein, in a case where it is decided by the deciding unit that the obtained time-series state of the worker is not similar to the time-series state of the worker included in the learning information, the controlling unit stops or decelerates the operation of the robot.

### Claim 4 (depends on 3)

The robot controlling apparatus according t claim 3, further comprising a notifying unit configured to, in the case where it is decided by the deciding unit that the obtained time-series state of the worker is not similar to the time-series state of the worker included in the learning information, notify the worker of information for urging to restart work after the operation of the robot is stopped or decelerated.

### Claim 5 (depends on 3)

The robot controlling apparatus according to claim 3, wherein
in the case where it is decided by the deciding unit that the obtained time-series state of the worker is not similar to the time-series state of the worker included in the learning information, the controlling unit decides whether or not the worker pays attention to the robot,
in a case where it is decided that the worker pays attention to the robot, the controlling unit continues the current operation of the robot, and
in a case where it is decided that the worker does not pay attention to the robot, the controlling unit stops or decelerates the operation of the robot.

### Claim 6 (depends on 2)

The robot controlling apparatus according to claim 2, wherein, in a case where it is decided by the deciding unit that the obtained time-series state of the worker is similar to the time-series state of the worker included in the learning information, the controlling unit continues the operation of the robot.

### Claim 7 (depends on 1)

The robot controlling apparatus according to claim 1, wherein the state of the worker includes at least either a position and orientation of a predetermined part of the worker and a position and orientation of an object grasped by the worker.

### Claim 8 (depends on 2)

The robot controlling apparatus according to claim 2, wherein the deciding unit further decides the operation of the robot based on a state of the robot.

### Claim 9 (depends on 8)

The robot controlling apparatus according claim 8, wherein the state of the robot corresponds to position information of a hand or a joint of the robot.

### Claim 10 (depends on 1)

The robot controlling apparatus according to claim 1, further comprising a learning information updating unit configured to update the learning information based on the state of the worker output from the detecting unit and the learning information output from learning information holding unit, and output the updated learning information to the learning information holding unit.

### Claim 11

A robot controlling method which controls a robot by detecting time-series states of a worker and the robot, comprising:
detecting a state of the worker;
holding learning information obtained by learning the time-series states of the robot and the worker; and
controlling an operation of the robot based on the detected state of the worker and the held learning information.

### Claim 12

A non-transitory computer-readable storage medium which stores a program for causing a computer to perform a robot controlling method of controlling a robot by detecting time-series states of a worker and the robot, the controlling method comprising:
detecting a state of the worker;
holding learning information obtained by learning the time-series states of the robot and the worker; and
controlling an operation of the robot based on the detected state of the worker and the held learning information.
