# US 2024/0255918 A1 · Control apparatus, control method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0255918 A1
- Document ID: US20240255918A1
- Status: Published application
- Kind: A1
- Application number: 18/633,525
- Filed: 2024-04-12
- Published: 2024-08-01
- Earliest claimed: 2020-04-24
- Assignees: Yokogawa Electric Corporation
- Applicants: Yokogawa Electric Corporation
- Inventors: Go TAKAMI; Fumio NISHIJO; Satoru TANAKA
- Web page: https://patentgrep.com/patent/US20240255918A1

## CPC

- G05B 19/4142: {characterised by the use of a microprocessor (G05B19/4141 takes precedence)}
- B25J 9/161: {Hardware, e.g. neural networks, fuzzy logic, interfaces, processor}
- B25J 9/163: {learning, adaptive, model based, rule based expert control}
- G05B 7/02: electric
- G05B 13/0265: {the criterion being a learning criterion}
- G06N 20/00: Machine learning
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Provided is a control apparatus including an acquisition unit configured to acquire a measurement value measured regarding control target equipment, a first control unit configured to output an operation amount of the control target equipment according to the measurement value by at least one of feedback control or feed-forward control, a second control unit configured to output an operation amount of the control target equipment according to the measurement value using a model learnt by using learning data, and a switching unit configured to perform switching between the first control unit and the second control unit by which the control target equipment is controlled.

## Claims

### Claim 1

A control apparatus comprising:
an acquisition unit configured to acquire a measurement value measured regarding control target equipment;
a first control unit configured to output an operation amount of the control target equipment according to the measurement value by at least one of feedback control or feed-forward control;
a second control unit configured to output an operation amount of the control target equipment according to the measurement value using a model learnt by using learning data; and
a switching unit configured to perform switching between the first control unit and the second control unit by which the control target equipment is controlled, wherein
the switching unit is configured to perform the switching from a control by the first control unit to a control by the second control unit according to a difference between the measurement value and a target value.

### Claim 2 (depends on 1)

The control apparatus according to claim 1, wherein the switching unit is configured to perform the switching from the control by the first control unit to the control by the second control unit in response to a state occurring multiple times where the difference between the measurement value and the target value is higher than a reference value within a reference time window.

### Claim 3 (depends on 1)

The control apparatus according to claim 1, wherein:
the first control unit is configured to output an operation amount calculated based on the measurement value and a target value; and
the model of the second control unit is learnt by using learning data that includes measurement data including the measurement value and the operation amount of the control target equipment, and is configured to output a recommended operation amount of the control target equipment for increasing a reward value determined by a previously set reward function in response to input of the measurement data.

### Claim 4 (depends on 3)

The control apparatus according to claim 3, wherein:
the reward function is a function by which the reward value is increased as the measurement value gets closer to the target value; and
the switching unit is configured to perform the switching on the basis of a comparison result between a threshold based on the target value and the measurement value.

### Claim 5 (depends on 4)

The control apparatus according to claim 4, wherein the switching unit is configured to set a threshold used for switching from the control by the second control unit to the control by the first control unit to be higher than a threshold used for switching from the control by the first control unit to the control by the second control unit.

### Claim 6 (depends on 1)

The control apparatus according to claim 1, wherein the switching unit is configured to cause
the second control unit to perform the control until reference time elapses from start of the control on the control target equipment, and
the first control unit to perform the control after the reference time has elapsed from the start of the control on the control target equipment.

### Claim 7 (depends on 1)

The control apparatus according to claim 1, wherein the first control unit is configured to perform feedback control using at least one of proportional control, integral control, or differential control.

### Claim 8 (depends on 1)

The control apparatus according to claim 1, wherein:
the first control unit is operable in
an auto mode for calculating and outputting, in response to input of the measurement value, an operation amount of the control target equipment according to the measurement value, and
a manual mode for outputting, in response to input of the operation amount that is to be output, the operation amount;
the second control unit is configured to input the operation amount of the control target equipment to the first control unit; and
the switching unit is configured to perform the switching by switching a mode of the first control unit.

### Claim 9 (depends on 8)

The control apparatus according to claim 8, wherein in a case where the switching from the manual mode to the auto mode is performed, the first control unit is configured to control the operation amount before and after the switching such that an abrupt change of the operation amount before and after the switching is suppressed.

### Claim 10

A control apparatus comprising:
an acquisition unit configured to acquire a measurement value measured regarding control target equipment;
a first control unit configured to output an operation amount of the control target equipment according to the measurement value by at least one of feedback control or feed-forward control;
a second control unit configured to output an operation amount of the control target equipment according to the measurement value using a model learnt by using learning data; and
a switching unit configured to perform switching between the first control unit and the second control unit by which the control target equipment is controlled, wherein
the switching unit is configured to perform the switching from a control by the second control unit to a control by the first control unit in response to a fact that a difference between the measurement value and a target value becomes smaller than a reference value.

### Claim 11 (depends on 10)

The control apparatus according to claim 10, wherein the switching unit is configured to perform the switching from the control by the first control unit to the control by the second control unit in response to a state occurring multiple times where the difference between the measurement value and the target value is higher than a reference value within a reference time window.

### Claim 12 (depends on 10)

The control apparatus according to claim 10, wherein:
the first control unit is configured to output an operation amount calculated based on the measurement value and a target value; and
the model of the second control unit is learnt by using learning data that includes measurement data including the measurement value and the operation amount of the control target equipment, and is configured to output a recommended operation amount of the control target equipment for increasing a reward value determined by a previously set reward function in response to input of the measurement data.

### Claim 13 (depends on 12)

The control apparatus according to claim 12, wherein:
the reward function is a function by which the reward value is increased as the measurement value gets closer to the target value; and
the switching unit is configured to perform the switching on the basis of a comparison result between a threshold based on the target value and the measurement value.

### Claim 14 (depends on 13)

The control apparatus according to claim 13, wherein the switching unit is configured to set a threshold used for switching from the control by the second control unit to the control by the first control unit to be higher than a threshold used for switching from the control by the first control unit to the control by the second control unit.

### Claim 15 (depends on 10)

The control apparatus according to claim 10, wherein the switching unit is configured to cause
the second control unit to perform the control until reference time elapses from start of the control on the control target equipment, and
the first control unit to perform the control after the reference time has elapsed from the start of the control on the control target equipment.

### Claim 16 (depends on 10)

The control apparatus according to claim 10, wherein the first control unit is configured to perform feedback control using at least one of proportional control, integral control, or differential control.

### Claim 17 (depends on 10)

The control apparatus according to claim 10, wherein:
the first control unit is operable in
an auto mode for calculating and outputting, in response to input of the measurement value, an operation amount of the control target equipment according to the measurement value, and
a manual mode for outputting, in response to input of the operation amount that is to be output, the operation amount;
the second control unit is configured to input the operation amount of the control target equipment to the first control unit; and
the switching unit is configured to perform the switching by switching a mode of the first control unit.

### Claim 18 (depends on 17)

The control apparatus according to claim 17, wherein in a case where the switching from the manual mode to the auto mode is performed, the first control unit is configured to control the operation amount before and after the switching such that an abrupt change of the operation amount before and after the switching is suppressed.

### Claim 19

A control method comprising:
acquiring a measurement value measured regarding control target equipment;
outputting an operation amount of the control target equipment according to the measurement value by at least one of feedback control or feed-forward control in a first control phase;
outputting an operation amount of the control target equipment according to the measurement value using a model learnt by using learning data in a second control phase; and
performing switching between the first control phase and the second control phase by which the control target equipment is controlled, wherein
the performing switching includes performing the switching from a control in the first control phase to a control in the second control phase according to a difference between the measurement value and a target value.

### Claim 20

A non-transitory computer-readable storage medium storing a control program for causing a computer to function as:
an acquisition unit configured to acquire a measurement value measured regarding control target equipment;
a first control unit configured to output an operation amount of the control target equipment according to the measurement value by at least one of feedback control or feed-forward control;
a second control unit configured to output an operation amount of the control target equipment according to the measurement value using a model learnt by using learning data; and
a switching unit configured to perform switching between the first control unit and the second control unit by which the control target equipment is controlled, wherein
the switching unit is configured to perform the switching from a control by the first control unit to a control by the second control unit according to a difference between the measurement value and a target value.

### Claim 21

A control method comprising:
acquiring a measurement value measured regarding control target equipment;
outputting an operation amount of the control target equipment according to the measurement value by at least one of feedback control or feed-forward control in a first control phase;
outputting an operation amount of the control target equipment according to the measurement value using a model learnt by using learning data in a second control phase; and
performing switching between the first control phase and the second control phase by which the control target equipment is controlled, wherein
the performing switching includes performing the switching from a control in the second control phase to a control in the first control phase in response to a fact that a difference between the measurement value and a target value becomes smaller than a reference value.

### Claim 22

A non-transitory computer-readable storage medium storing a control program for causing a computer to function as:
an acquisition unit configured to acquire a measurement value measured regarding control target equipment;
a first control unit configured to output an operation amount of the control target equipment according to the measurement value by at least one of feedback control or feed-forward control;
a second control unit configured to output an operation amount of the control target equipment according to the measurement value using a model learnt by using learning data; and
a switching unit configured to perform switching between the first control unit and the second control unit by which the control target equipment is controlled, wherein
the switching unit is configured to perform the switching from a control by the second control unit to a control by the first control unit in response to a fact that a difference between the measurement value and a target value becomes smaller than a reference value.
