# US 2024/0351205 A1 · Command value generating device, method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0351205 A1
- Document ID: US20240351205A1
- Status: Published application
- Kind: A1
- Application number: 18/687,674
- Filed: 2022-03-28
- Published: 2024-10-24
- Earliest claimed: 2021-09-07
- Assignees: OMRON Corporation
- Applicants: OMRON Corporation
- Inventors: Masayoshi ABE; Shinji KAWAKAMI; Akinobu KANAI; Yumi SAITOH
- Web page: https://patentgrep.com/patent/US20240351205A1

## CPC

- B25J 9/1656: {characterised by programming, planning systems for manipulators}
- B25J 9/1661: {characterised by task planning, object-oriented languages}
- B25J 9/163: {learning, adaptive, model based, rule based expert control}
- B25J 9/1664: {characterised by motion, path, trajectory planning}
- G05B 19/423: Teaching successive positions by walk-through, i.e. the tool head or end effector being grasped and guided directly, with or without servo-assistance, to follow a path
- B25J 9/1697: {Vision controlled systems}
- G05B 19/42: Recording and playback systems, i.e. in which the program is recorded from a cycle of operations, e.g. the cycle of operations being manually controlled, after which this record is played back on the same machine
- G05B 2219/36433: Position assisted teaching
- G05B 2219/39137: Manual teaching, set next point when tool touches other tool, workpiece
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

An acquisition section (31) acquires command values to execute a task on a target object with a robot (40) and acquires state data representing a state of the robot (40) in a case in which an action of the robot (40) during the task is taught manually, which is state data of plural types including at least action data representing an action of the robot (40), position/orientation data representing a relative position and relative orientation between the robot (40) and the target object, and external force data representing external force received by the target object during the task. A generation section (33) generates a generator for, based on the command values and the state data acquired for corresponding times by the acquisition section (31), generating command values to execute an action with the robot (40) corresponding to the state data that has been input.

## Claims

### Claim 1

A command value generating device, comprising:
an acquisition section that acquires command values to execute a task on a target object with a robot and acquires state data representing a state of the robot in a case in which an action of the robot during the task is taught manually, which is state data of a plurality of types including at least action data representing an action of the robot, position/orientation data representing a relative position and a relative orientation between the robot and the target object, and external force data representing external force received by the target object during the task; and
a generation section that generates a generator for, based on the command values and the state data acquired for corresponding times by the acquisition section, generating command values to execute an action with the robot corresponding to the state data that has been input.

### Claim 2 (depends on 1)

The command value generating device of claim 1, wherein the generation section generates the generator by determining internal parameters of the generator based on optimization.

### Claim 3 (depends on 1)

The command value generating device of claim 1, further comprising:
a reception section that receives a selection of a segment of the state data to be used for generation of the generator from among the state data acquired by the acquisition section for each of plural times of teaching; and
wherein the generation section generates the generator utilizing the segment of the state data selected.

### Claim 4 (depends on 3)

The command value generating device of claim 3, wherein:
the reception section receives a selection of a type of the state data to be used for generation of the generator from among the state data of a plurality of types acquired by the acquisition section; and
the generation section generates the generator by optimizing a parameter for generating command values capable of reproducing a state represented by the state data of the selected type, based on the state data of the selected type and the command values.

### Claim 5 (depends on 4)

The command value generating device of claim 4, wherein the generation section receives correction to a parameter of the generator that was generated.

### Claim 6 (depends on 4)

The command value generating device of claim 4, wherein:
parameters of the generator include an upper limit value of the command value, and a goal value of an action for the command value; and
the generation section generates the generator by fixing the upper limit value and the goal value to specified values and optimizing other parameters.

### Claim 7 (depends on 1)

The command value generating device of claim 1, further comprising an instruction section that:
determines whether or not the robot is operable based on a command value generated in a case in which the state data having a perturbation term included in a parameter that possibly fluctuates in the task has been input to the generator generated by the generation section, and in a case in which determined not operable, instructs the acquisition section to acquire command values and the state data generated in a case in which the perturbation term has been included.

### Claim 8 (depends on 1)

The command value generating device of claim 1 , wherein the generation section performs at least one of removing part of the state data used for generation of the generator or adding state data newly acquired by the acquisition section, and then re-executes generation of the generator.

### Claim 9 (depends on 1)

The command value generating device of claim 1, wherein: the acquisition section acquires an image in which a work area including the target object has been captured during teaching, and
the command value generating device further comprises a setting section that sets a parameter to recognize the work area based on the image acquired by the acquisition section.

### Claim 10 (depends on 9)

The command value generating device of claim 9, wherein the acquisition section acquires a distance between a camera for capturing the image and the target object as computed based on a pre-set size of the target object and on a size on an image of the target object as recognized in the image.

### Claim 11 (depends on 1)

The command value generating device of claim 1, wherein manual teaching of an action of the robot is executed by direct teaching, remote operation from a controller, or remote operation using a teaching machine connected by bilateral control to the robot.

### Claim 12 (depends on 1)

The command value generating device of claim 1 , further comprising a control section that controls the robot by outputting command values generated by the generator.

### Claim 13 (depends on 12)

The command value generating device of claim 12, further comprising a detection section that detects for an abnormality occurring during a task performed by the robot by inputting command values generated by the generator into a generator for back calculation to estimate the state data, and comparing the state data as estimated against the state data acquired by the acquisition section.

### Claim 14

A command value generating method, comprising:
an acquisition section acquiring command values to execute a task on a target object with a robot and acquires state data representing a state of the robot in a case in which an action of the robot during the task is taught manually, which is state data of a plurality of types including at least action data representing an action of the robot, position/orientation data representing a relative position and a relative orientation between the robot and the target object, and external force data representing external force received by the target object during the task; and
a generation section generating a generator for, based on the command values and the state data acquired for corresponding times by the acquisition section, generating command values to execute an action with the robot corresponding to the state data that has been input.

### Claim 15

A non-transitory storage medium storing a command value generating program that causes a computer to function as:
an acquisition section that acquires command values to execute a task on a target object with a robot and acquires state data representing a state of the robot in a case in which an action of the robot during the task is taught manually, which is state data of a plurality of types including at least action data representing an action of the robot, position/orientation data representing a relative position and a relative orientation between the robot and the target object, and external force data representing external force received by the target object during the task; and
a generation section that generates a generator for, based on the command values and the state data acquired for corresponding times by the acquisition section, generating command values to execute an action with the robot corresponding to the state data that has been input.
