# US 2021/0333779 A1 · Control apparatus, control method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0333779 A1
- Document ID: US20210333779A1
- Status: Published application
- Kind: A1
- Application number: 17/223,044
- Filed: 2021-04-06
- Published: 2021-10-28
- Earliest claimed: 2020-04-24
- Assignees: Yokogawa Electric Corporation
- Applicants: Yokogawa Electric Corporation
- Inventors: Go TAKAMI; Fumio NISHIJO; Satoru TANAKA
- Web page: https://patentgrep.com/patent/US20210333779A1

## CPC

- G05B 19/4142: {characterised by the use of a microprocessor (G05B19/4141 takes precedence)}
- B25J 9/161: {Hardware, e.g. neural networks, fuzzy logic, interfaces, processor}
- B25J 9/163: {learning, adaptive, model based, rule based expert control}
- G05B 7/02: electric
- G05B 13/0265: {the criterion being a learning criterion}
- G06N 20/00: Machine learning
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Provided is a control apparatus including an acquisition unit configured to acquire a measurement value measured regarding control target equipment, a first control unit configured to output an operation amount of the control target equipment according to the measurement value by at least one of feedback control or feed-forward control, a second control unit configured to output an operation amount of the control target equipment according to the measurement value using a model learnt by using learning data, and a switching unit configured to perform switching between the first control unit and the second control unit by which the control target equipment is controlled.

## Claims

### Claim 1

A control apparatus comprising:
an acquisition unit configured to acquire a measurement value measured regarding control target equipment;
a first control unit configured to output an operation amount of the control target equipment according to the measurement value by at least one of feedback control or feed-forward control;
a second control unit configured to output an operation amount of the control target equipment according to the measurement value using a model learnt by using learning data; and
a switching unit configured to perform switching between the first control unit and the second control unit by which the control target equipment is controlled.

### Claim 2 (depends on 1)

The control apparatus according to claim 1, wherein the switching unit is configured to perform the switching according to a difference between the measurement value and a target value.

### Claim 3 (depends on 2)

The control apparatus according to claim 2, wherein the switching unit is configured to perform the switching from the control by the first control unit to the control by the second control unit in response to a state occurring multiple times where the difference between the measurement value and the target value is higher than a reference value within a reference time window.

### Claim 4 (depends on 1)

The control apparatus according to claim 1, wherein:
the first control unit is configured to output an operation amount calculated based on the measurement value and a target value; and
the model of the second control unit is learnt by using learning data that includes measurement data including the measurement value and the operation amount of the control target equipment, and is configured to output a recommended operation amount of the control target equipment for increasing a reward value determined by a previously set reward function in response to input of the measurement data.

### Claim 5 (depends on 2)

The control apparatus according to claim 2, wherein:
the first control unit is configured to output an operation amount calculated based on the measurement value and a target value; and
the model of the second control unit is learnt by using learning data that includes measurement data including the measurement value and the operation amount of the control target equipment, and is configured to output a recommended operation amount of the control target equipment for increasing a reward value determined by a previously set reward function in response to input of the measurement data.

### Claim 6 (depends on 3)

The control apparatus according to claim 3, wherein:
the first control unit is configured to output an operation amount calculated based on the measurement value and a target value; and
the model of the second control unit is learnt by using learning data that includes measurement data including the measurement value and the operation amount of the control target equipment, and is configured to output a recommended operation amount of the control target equipment for increasing a reward value determined by a previously set reward function in response to input of the measurement data.

### Claim 7 (depends on 4)

The control apparatus according to claim 4, wherein:
the reward function is a function by which the reward value becomes higher as the measurement value is closer to one target value; and
the switching unit is configured to perform the switching on the basis of a comparison result between a threshold based on the one target value and the measurement value.

### Claim 8 (depends on 7)

The control apparatus according to claim 7, wherein the switching unit is configured to give hysteresis characteristics to
a threshold used for switching from the control by the first control unit to the control by the second control unit, and
a threshold used for switching from the control by the second control unit to the control by the first control unit.

### Claim 9 (depends on 1)

The control apparatus according to claim 1, wherein the switching unit is configured to cause
the second control unit to perform the control until reference time elapses from start of the control on the control target equipment, and
the first control unit to perform the control after the reference time has elapsed from the start of the control on the control target equipment.

### Claim 10 (depends on 2)

The control apparatus according to claim 2, wherein the switching unit is configured to cause
the second control unit to perform the control until reference time elapses from start of the control on the control target equipment, and
the first control unit to perform the control after the reference time has elapsed from the start of the control on the control target equipment.

### Claim 11 (depends on 3)

The control apparatus according to claim 3, wherein the switching unit is configured to cause
the second control unit to perform the control until reference time elapses from start of the control on the control target equipment, and
the first control unit to perform the control after the reference time has elapsed from the start of the control on the control target equipment.

### Claim 12 (depends on 1)

The control apparatus according to claim 1, wherein the first control unit is configured to perform feedback control using at least one of proportional control, integral control, or differential control.

### Claim 13 (depends on 2)

The control apparatus according to claim 2, wherein the first control unit is configured to perform feedback control using at least one of proportional control, integral control, or differential control.

### Claim 14 (depends on 3)

The control apparatus according to claim 3, wherein the first control unit is configured to perform feedback control using at least one of proportional control, integral control, or differential control.

### Claim 15 (depends on 1)

The control apparatus according to claim 1, wherein:
the first control unit is operable in
an auto mode for calculating and outputting, in response to input of the measurement value, an operation amount of the control target equipment according to the measurement value, and
a manual mode for outputting, in response to input of the operation amount that is to be output, the operation amount;
the second control unit is configured to input the operation amount of the control target equipment to the first control unit; and
the switching unit is configured to perform the switching by switching a mode of the first control unit.

### Claim 16 (depends on 2)

The control apparatus according to claim 2, wherein:
the first control unit is operable in
an auto mode for calculating and outputting, in response to input of the measurement value, an operation amount of the control target equipment according to the measurement value, and
a manual mode for outputting, in response to input of the operation amount that is to be output, the operation amount;
the second control unit is configured to input the operation amount of the control target equipment to the first control unit; and
the switching unit is configured to perform the switching by switching a mode of the first control unit.

### Claim 17 (depends on 3)

The control apparatus according to claim 3, wherein:
the first control unit is operable in
an auto mode for calculating and outputting, in response to input of the measurement value, an operation amount of the control target equipment according to the measurement value, and
a manual mode for outputting, in response to input of the operation amount that is to be output, the operation amount;
the second control unit is configured to input the operation amount of the control target equipment to the first control unit; and
the switching unit is configured to perform the switching by switching a mode of the first control unit.

### Claim 18 (depends on 15)

The control apparatus according to claim 15, wherein in a case where the switching from the manual mode to the auto mode is performed, the first control unit is configured to control the operation amount before and after the switching in a bumpless manner.

### Claim 19

A control method comprising:
acquiring a measurement value measured regarding control target equipment;
outputting an operation amount of the control target equipment according to the measurement value by at least one of feedback control or feed-forward control in a first control phase;
outputting an operation amount of the control target equipment according to the measurement value using a model learnt by using learning data in a second control phase; and
performing switching between the first control phase and the second control phase by which the control target equipment is controlled.

### Claim 20

A storage medium storing a control program for causing a computer to function as:
an acquisition unit configured to acquire a measurement value measured regarding control target equipment;
a first control unit configured to output an operation amount of the control target equipment according to the measurement value by at least one of feedback control or feed-forward control;
a second control unit configured to output an operation amount of the control target equipment according to the measurement value using a model learnt by using learning data; and
a switching unit configured to perform switching between the first control unit and the second control unit by which the control target equipment is controlled.
