# US 2019/0095785 A1 · Dynamic tuning of training parameters for machine learning algorithms

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0095785 A1
- Document ID: US20190095785A1
- Status: Published application
- Kind: A1
- Application number: 15/716,417
- Filed: 2017-09-26
- Published: 2019-03-28
- Earliest claimed: 2017-09-26
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Tuhin Sarkar; Animashree Anandkumar; Leo Parker Dirac
- Web page: https://patentgrep.com/patent/US20190095785A1

## CPC

- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- G05B 13/027: {using neural networks only}
- G06N 3/09: Supervised learning
- G06N 20/00: Machine learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

A system such as a service of a computing resource service provider includes executable code that, if executed by one or more processors, causes the one or more processors to initiate a training of a machine-learning model with a parameter for the training having a first value, the training to determine a set of parameters for the model, calculate output of the training, and change the parameter of the training to have a second value during the training based at least in part on the output. Training parameters may, in some cases, also be referred to as hyperparameters.

## Claims

### Claim 1

A computer-implemented method, comprising:
initializing a training parameter to a first value, wherein the training parameter controls at least part of a training process for generating a machine-learning model;
calculating a first output of an iteration of the training process based at least in part on applying a first value of the training parameter and training data to a machine-learning algorithm;
modifying the training parameter to a second value based at least in part on the first output; and
calculating a second output of a subsequent iteration of the training process, wherein the second output is calculated based at least in part on the second value of the training parameter.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising determining the second output based at least in part on applying a Bayesian optimization algorithm to the first output.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the machine-learning model comprises a neural network.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising:
allocating a set of computing resources based on detecting that the training parameter is modified to the second value; and
wherein the calculating of the second output is performed using the set of computing resources.

### Claim 5

A system, comprising one or more machine-readable mediums having stored thereon a set of instructions, which if performed by one or more processors, cause the system to at least:
initiate a training of a machine-learning model with one or more parameters for the training having at least a first value, the training to determine a set of parameters for the model;
calculate output of the training; and
change the one or more parameters of the training to have at least a second value during the training based at least in part on the output.

### Claim 6 (depends on 5)

The system of claim 5, wherein the instructions to change the one or more parameters of the training to have at least the second value, which if performed by the one or more processors, cause the system to compute the second value based at least in part on a result of a sequential model-based optimization algorithm, the result determined based at least in part on the output of the training.

### Claim 7 (depends on 6)

The system of claim 6, wherein the sequential model-based optimization algorithm is a Bayesian optimization algorithm.

### Claim 8 (depends on 5)

The system of claim 5, wherein:
the first value of the one or more parameters corresponds to an amount of computing resources to utilize to calculate outputs of the training;
the second value of the one or more parameters indicating a different amount of computing resources to utilize to calculate outputs of the training; and
the instructions, which if performed by the one or more processors, further cause the system to allocate computing resources for the training of the machine-learning model, wherein, the computing resources are allocated in response to detecting a change in the one or more parameter from the first value to the second value.

### Claim 9 (depends on 8)

The system of claim 8, wherein the computing resources comprise virtual machine instances.

### Claim 10 (depends on 5)

The system of claim 5, wherein the parameter is an optimization hyperparameter that controls at least part of the training of the machine-learning model.

### Claim 11 (depends on 10)

The system of claim 10, wherein the optimization hyperparameter is a learning rate hyperparameter.

### Claim 12 (depends on 5)

The system of claim 5, wherein:
the instructions, which if performed by the one or more processors, further cause the system store a plurality of outputs of the training generated at least in part by using the one or more parameters; and
the instructions to change the one or more parameters of the training to have the second value, which, if performed by the one or more processors, further causes the system to change the one or more parameters based at least in part on the plurality of outputs.

### Claim 13

A non-transitory computer-readable storage medium having stored thereon executable instructions that, as a result of being executed by one or more processors of a computer system, cause the computer system to at least:
select a first value for one or more parameters for a training of a machine-learning model, the training to determine a set of parameters for the model;
calculate an output of the training; and
during the training, change the one or more parameters to have a second value determined based at least in part on the output.

### Claim 14 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the one or more parameters comprises an optimization hyperparameter.

### Claim 15 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the instructions further comprise instructions that, as a result of being executed by the one or more processors, cause the computer system to:
select a plurality of values for a parameter of the one or more parameter;
for the plurality of values, calculate and store a respective output of the training; and
determine the second value based at least in part on the respective outputs.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the instructions that cause the computer system to select the plurality of values further include instructions that cause the computer system to pseudo-randomly select the plurality of values.

### Claim 17 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the instructions further comprise instructions that, as a result of being executed by the one or more processors, cause the system to apply a grid search algorithm to the output to generate the second value.

### Claim 18 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the parameter comprises information usable to determine an amount of computing resources to utilize to calculate the output.

### Claim 19 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the instructions further comprise instructions that, as a result of being executed by the one or more processors, cause the system to:
calculate a second output of the training, wherein second output is calculated using at least the second value of the one or more parameters; and
during the training, change the second value of the one or more parameters to a third value based at least in part on the second output.

### Claim 20 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the machine-learning model comprises a linear regression model or a Bayesian network.
