# US 2021/0241123 A1 · Optimization device, optimization method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241123 A1
- Document ID: US20210241123A1
- Status: Published application
- Kind: A1
- Application number: 17/050,773
- Filed: 2019-04-24
- Published: 2021-08-05
- Earliest claimed: 2018-04-27
- Assignees: Nippon Telegraph and Telephone Corporation
- Applicants: Nippon Telegraph and Telephone Corporation
- Inventors: Kyota TSUTSUMIDA; Hidetaka ITO; Tatsushi MATSUBAYASHI; Hiroyuki TODA
- Web page: https://patentgrep.com/patent/US20210241123A1

## CPC

- G06N 3/126: Evolutionary algorithms, e.g. genetic algorithms or genetic programming
- G06F 16/00: Information retrieval; Database structures therefor; File system structures therefor
- G06N 5/04: Inference or reasoning models
- G06N 20/00: Machine learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A parameter can be optimized with a small number of evaluations. For each of a plurality of candidate search points that are parameters used as candidates for search points which a candidate search point generation unit 120 has generated based on a plurality of parameters used for calculation, a search point determination unit 130 determines whether or not to set the candidate search point as a search point using a plurality of data points, each including a set of a parameter used for calculation by an evaluation unit 300 and an evaluation value that has been calculated by using the parameter used for calculation by the evaluation unit 300 as a search point.

## Claims

### Claim at position 1

-8. (canceled)

### Claim 9

A computer-implemented method for optimizing parameters for control, the method comprising:
receiving evaluation data;
receiving a set of parameters for determining a search point;
determining, based on the evaluation data and the set of parameters, an evaluation value, wherein the evaluation value includes an index for evaluating a result of optimizing the set of parameters;
storing a plurality of data points, wherein each data point includes the set of parameters and the determined evaluation value based on the set of parameters;
generating, based on a plurality of the stored set of parameters in the plurality of data points, a plurality of search point candidates, wherein the plurality of search point candidates represent parameter candidates for the search point;
determining, for each of the generated plurality of search point candidates, whether a search point candidate represents the search point using the stored plurality of data points;
generating, based on iteratively determining the search point and the evaluation value for the search point, an optimized set of parameters; and
providing the optimized set of parameters.

### Claim 10 (depends on 9)

The computer-implemented method of claim 9, the method further comprising:
receiving environment information associated with an evaluation environment; and
storing the plurality of data points in combination with the environment information.

### Claim 11 (depends on 9)

The computer-implemented method of claim 9, the method further comprising:
determining, using a discriminator, for each of the plurality of search point candidates, the evaluation value, wherein the discriminator is trained to identify the evaluation value based on the stored plurality of data points and the environment information associated with the plurality of evaluation environment, wherein the discriminator uses the set of parameters and the environment information associated with the evaluation environment as input, and wherein the evaluation value is one of positive or negative; and
when the determined evaluation value is positive, determining the search point candidate as the search point.

### Claim 12 (depends on 9)

The computer-implemented method of claim 9, the method further comprising:
receiving sampling of data from a domain associated with each element of the set of parameters; and
generating, based on the received sampling of data, the plurality of search point candidates.

### Claim 13 (depends on 9)

The computer-implemented method of claim 9, the method further comprising:
generating the plurality of search point candidates using a genetic algorithm.

### Claim 14 (depends on 9)

The computer-implemented method of claim 9, wherein the evaluation data relates to traffic information for simulating traffic, wherein the set of parameters relates to controlling at least one traffic signal state, and the environment information of evaluation environment includes a vector representation of a traffic congestion on a road.

### Claim 15 (depends on 9)

The computer-implemented method of claim 9, wherein the set of parameters include hyper-parameters for machine learning and parameters for simulation of a flow.

### Claim 16

A system for optimizing parameters for control, the system comprises:
a processor; and
a memory storing computer-executable instructions that when executed by the processor cause the system to:
receive evaluation data;
receive a set of parameters for determining a search point;
determine, based on the evaluation data and the set of parameters, an evaluation value, wherein the evaluation value includes an index for evaluating a result of optimizing the set of parameters;
store a plurality of data points, wherein each data point includes the set of parameters and the determined evaluation value based on the set of parameters;
generate, based on a plurality of the stored set of parameters in the plurality of data points, a plurality of search point candidates, wherein the plurality of search point candidates represent parameter candidates for the search point;
determine, for each of the generated plurality of search point candidates, whether a search point candidate represents the search point using the stored plurality of data points;
generate, based on iteratively determining the search point and the evaluation value for the search point, an optimized set of parameters; and
provide the optimized set of parameters.

### Claim 17 (depends on 16)

The system of claim 16, the computer-executable instructions when executed further causing the system to:
receive environment information associated with an evaluation environment; and
store the plurality of data points in combination with the environment information.

### Claim 18 (depends on 16)

The system of claim 16, the computer-executable instructions when executed further causing the system to:
determine, using a discriminator, for each of the plurality of search point candidates, the evaluation value, wherein the discriminator is trained to identify the evaluation value based on the stored plurality of data points and the environment information associated with the plurality of evaluation environment, wherein the discriminator uses the set of parameters and the environment information associated with the evaluation environment as input, and wherein the evaluation value is one of positive or negative; and
when the determined evaluation value is positive, determine the search point candidate as the search point.

### Claim 19 (depends on 16)

The system of claim 16, the computer-executable instructions when executed further causing the system to:
receive sampling of data from a domain associated with each element of the set of parameters; and
generate, based on the received sampling of data, the plurality of search point candidates.

### Claim 20 (depends on 16)

The system of claim 16, the computer-executable instructions when executed further causing the system to:
generating the plurality of search point candidates using a genetic algorithm.

### Claim 21 (depends on 16)

The system of claim 16, wherein the evaluation data relates to traffic information for simulating traffic, wherein the set of parameters relates to controlling at least one traffic signal state, and the environment information of evaluation environment includes a vector representation of a traffic congestion on a road.

### Claim 22 (depends on 16)

The system of claim 16, wherein the set of parameters include hyper-parameters for machine learning and parameters for simulation of a flow.

### Claim 23

A computer-readable non-transitory recording medium storing computer-executable instructions that when executed by a processor cause a computer system to:
receive evaluation data;
receive a set of parameters for determining a search point;
determine, based on the evaluation data and the set of parameters, an evaluation value, wherein the evaluation value includes an index for evaluating a result of optimizing the set of parameters;
store a plurality of data points, wherein each data point includes the set of parameters and the determined evaluation value based on the set of parameters;
generate, based on a plurality of the stored set of parameters in the plurality of data points, a plurality of search point candidates, wherein the plurality of search point candidates represent parameter candidates for the search point;
determine, for each of the generated plurality of search point candidates, whether a search point candidate represents the search point using the stored plurality of data points;
generate, based on iteratively determining the search point and the evaluation value for the search point, an optimized set of parameters; and
provide the optimized set of parameters.

### Claim 24 (depends on 23)

The computer-readable non-transitory recording medium of claim 23, the computer-executable instructions when executed further causing the system to:
receive environment information associated with an evaluation environment; and
store the plurality of data points in combination with the environment information.

### Claim 25 (depends on 23)

The computer-readable non-transitory recording medium of claim 23, the computer-executable instructions when executed further causing the system to:
determine, using a discriminator, for each of the plurality of search point candidates, the evaluation value, wherein the discriminator is trained to identify the evaluation value based on the stored plurality of data points and the environment information associated with the plurality of evaluation environment, wherein the discriminator uses the set of parameters and the environment information associated with the evaluation environment as input, and wherein the evaluation value is one of positive or negative; and
when the determined evaluation value is positive, determine the search point candidate as the search point.

### Claim 26 (depends on 23)

The computer-readable non-transitory recording medium of claim 23, the computer-executable instructions when executed further causing the system to:
receive sampling of data from a domain associated with each element of the set of parameters; and
generate, based on the received sampling of data, the plurality of search point candidates.

### Claim 27 (depends on 23)

The computer-readable non-transitory recording medium of claim 23, the computer-executable instructions when executed further causing the system to:
generating the plurality of search point candidates using a genetic algorithm.

### Claim 28 (depends on 23)

The computer-readable non-transitory recording medium of claim 23, wherein the evaluation data relates to traffic information for simulating traffic, wherein the set of parameters relates to controlling at least one traffic signal state, and the environment information of evaluation environment includes a vector representation of a traffic congestion on a road.
