# US 2021/0268650 A1 · Control device and control method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0268650 A1
- Document ID: US20210268650A1
- Status: Published application
- Kind: A1
- Application number: 17/254,210
- Filed: 2019-05-07
- Published: 2021-09-02
- Earliest claimed: 2018-06-29
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Hirotaka Suzuki
- Web page: https://patentgrep.com/patent/US20210268650A1

## CPC

- A63F 13/60: Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
- B25J 9/1653: {parameters identification, estimation, stiffness, accuracy, error analysis}
- A63F 13/573: using trajectories of game objects, e.g. of a golf ball according to the point of impact
- A63F 13/80: Special adaptations for executing a specific game genre or game mode
- B25J 9/10: characterised by positioning means for manipulator elements
- B25J 9/1664: {characterised by motion, path, trajectory planning}
- B25J 9/1694: {characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion}
- G05B 13/02: electric
- G05D 1/0217: {in accordance with energy consumption, time reduction or distance reduction criteria}
- G05D 1/0219: {ensuring the processing of the whole working surface}
- G06F 30/15: Vehicle, aircraft or watercraft design
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A control device (1b) according to an embodiment includes a control unit (11), an estimating unit (100), and a correcting unit (103). The control unit included in the control device performs a control based on first chronological information, of an action of a controlled object (3). The estimating unit included in the control device performs estimation of a cost produced by achievement of a purpose of the controlled object. The correcting unit included in the control device performs correction of an action based on the first chronological information of the controlled object according to the cost estimated by the estimating unit.

## Claims

### Claim 1

A control device comprising:
a control unit that controls an action of a controlled object based on first chronological information;
an estimating unit that estimates a cost produced by achievement of a purpose of the controlled object; and
a correcting unit that corrects an action of the controlled object based on the first chronological information, according to the cost estimated by the estimating unit.

### Claim 2 (depends on 1)

The control device according to claim 1, wherein
the correcting unit corrects the action based on the first chronological information to an action that continues from an action based on second chronological information different from the first chronological information.

### Claim 3 (depends on 2)

The control device according to claim 2, further comprising
a retrieving unit that retrieves, according to the cost estimated by the estimating unit, a similar state that is similar to a state corresponding to the estimation from at least one piece of chronological information, wherein
the second chronological information is chronological information that is obtained by retrieving the similar state from the at least one piece of the chronological information by the retrieving unit.

### Claim 4 (depends on 3)

The control device according to claim 3, wherein
the retrieving unit retrieves the similar state similar to an environment that includes a state corresponding to the estimation.

### Claim 5 (depends on 2)

The control device according to claim 2, wherein
the second chronological information is chronological information according to an action estimated as optimal by training performed with the first chronological information as input information.

### Claim 6 (depends on 2)

The control device according to claim 2, wherein
the second chronological information is chronological information according to an action estimated as optimal, by training by autonomous trial and error actions by the controlled object.

### Claim 7 (depends on 2)

The control device according to claim 2, wherein
the correcting unit corrects an action based on the first chronological information based on a user operation to control an action of the controlled object.

### Claim 8 (depends on 7)

The control device according to claim 7, wherein
the correcting unit adds third chronological information according to the action corrected based on the user operation to the first chronological information.

### Claim 9 (depends on 1)

The control device according to claim 1, wherein
the correcting unit further performs correction according to the cost estimated by the estimating unit with respect to an action of the controlled object that is controlled by the control unit based on the corrected first chronological information.

### Claim 10 (depends on 1)

The control device according to claim 1, wherein
the estimating unit estimates the cost according to a possibility that the controlled object interferes another object.

### Claim 11 (depends on 1)

The control device according to claim 1, wherein
the estimating unit estimates the cost based on a detection result by a detecting unit that detects a peripheral state of the controlled object.

### Claim 12 (depends on 2)

The control device according to claim 2, wherein
the control unit controls an action of the controlled object based on the first chronological information in a second environment different from a first environment corresponding to the first chronological information.

### Claim 13 (depends on 12)

The control device according to claim 12, wherein
the control unit controls an action of the controlled object based on the first chronological information generated in the first environment.

### Claim 14 (depends on 12)

The control device according to claim 12, wherein
the first chronological information is generated according to fixed patterns in advance.

### Claim 15 (depends on 12)

The control device according to claim 12, wherein
the control unit controls an action of the controlled object in the second environment in which a plurality of objects act including the controlled object simultaneously act, based on the first chronological information generated in the first environment in which the controlled object acts by itself.

### Claim 16 (depends on 2)

The control device according to claim 2, wherein
the control unit controls an action of the controlled object in virtual space based on the first chronological information.

### Claim 17 (depends on 16)

The control device according to claim 16, wherein
the correcting unit corrects an action based on the first chronological information of the controlled object according to the cost estimated based on a user operation to control an action of another controlled object that is different from the controlled object.

### Claim 18 (depends on 17)

The control device according to claim 17, wherein
the estimating unit estimates the cost according to a speed of at least one of the controlled object and the other controlled object.

### Claim 19

A control method comprising:
a control step of controlling an action of a controlled object based on first chronological information;
an estimating step of estimating a cost produced by achievement of a purpose of the controlled object; and
a correcting step of correcting an action of the controlled object based on the first chronological information, according to the cost estimated by the estimating unit.
