# US 2022/0036174 A1 · Machine learning hyper tuning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036174 A1
- Document ID: US20220036174A1
- Status: Published application
- Kind: A1
- Application number: 16/943,922
- Filed: 2020-07-30
- Published: 2022-02-03
- Earliest claimed: 2020-07-30
- Assignees: Dell Products L.P.
- Applicants: Dell Products L.P.
- Inventors: Ally Junio Oliveira BARRA
- Web page: https://patentgrep.com/patent/US20220036174A1

## CPC

- G06N 3/08: Learning methods
- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/09: Supervised learning
- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An information handling system may include at least one processor; and a non-transitory memory coupled to the at least one processor. The information handling system may be configured to: communicatively couple to a cloud platform for execution of a machine learning task; and cause the cloud platform to execute a hyper server that is configured to: determine a plurality of sets of possible values for hyperparameters of the machine learning task; for each of the plurality of sets of possible values, dispatch a model comprising the set to a hyper client configured to execute a model training process based on the set; receive, for each set, statistics relating to the model training process for the set; and determine, based on the received statistics, a particular set that is preferred.

## Claims

### Claim 1

An information handling system comprising:
at least one processor; and
a non-transitory memory coupled to the at least one processor;
wherein the information handling system is configured to:
communicatively couple to a cloud platform for execution of a machine learning task; and
cause the cloud platform to execute a hyper server that is configured to:
determine a plurality of sets of possible values for hyperparameters of the machine learning task;
for each of the plurality of sets of possible values, dispatch a model comprising the set to a hyper client configured to execute a model training process based on the set;
receive, for each set, statistics relating to the model training process for the set; and
determine, based on the received statistics, a particular set that is preferred.

### Claim 2 (depends on 1)

The information handling system of claim 1, wherein the machine learning task is a deep learning task.

### Claim 3 (depends on 1)

The information handling system of claim 1, wherein the model comprises a neural network.

### Claim 4 (depends on 3)

The information handling system of claim 3, wherein the hyperparameters include a learning rate, a momentum, a regularization, a dropout probability, a batch normalization, and a number of hidden units.

### Claim 5 (depends on 1)

The information handling system of claim 1, wherein the statistics include a generalization error.

### Claim 6 (depends on 5)

The information handling system of claim 5, wherein the particular set that is preferred is associated with a smallest generalization error.

### Claim 7

A method comprising:
an information handling system communicatively coupling to a cloud platform for execution of a machine learning task; and
the information handling system causing the cloud platform to execute a hyper server that is configured to:
determine a plurality of sets of possible values for hyperparameters of the machine learning task;
for each of the plurality of sets of possible values, dispatch a model comprising the set to a hyper client configured to execute a model training process based on the set;
receive, for each set, statistics relating to the model training process for the set; and
determine, based on the received statistics, a particular set that is preferred.

### Claim 8 (depends on 7)

The method of claim 7, wherein the machine learning task is a deep learning task.

### Claim 9 (depends on 7)

The method of claim 7, wherein the model comprises a neural network.

### Claim 10 (depends on 9)

The method of claim 9, wherein the hyperparameters include a learning rate, a momentum, a regularization, a dropout probability, a batch normalization, and a number of hidden units.

### Claim 11 (depends on 7)

The method of claim 7, wherein the statistics include a generalization error.

### Claim 12 (depends on 11)

The method of claim 11, wherein the particular set that is preferred is associated with a smallest generalization error.

### Claim 13

An article of manufacture comprising a non-transitory, computer-readable medium having computer-executable code thereon that is executable by an information handling system for:
communicatively coupling to a cloud platform for execution of a machine learning task; and
causing the cloud platform to execute a hyper server that is configured to:
determine a plurality of sets of possible values for hyperparameters of the machine learning task;
for each of the plurality of sets of possible values, dispatch a model comprising the set to a hyper client configured to execute a model training process based on the set;
receive, for each set, statistics relating to the model training process for the set; and
determine, based on the received statistics, a particular set that is preferred.

### Claim 14 (depends on 13)

The article of claim 13, wherein the machine learning task is a deep learning task.

### Claim 15 (depends on 13)

The article of claim 13, wherein the model comprises a neural network.

### Claim 16 (depends on 15)

The article of claim 15, wherein the hyperparameters include a learning rate, a momentum, a regularization, a dropout probability, a batch normalization, and a number of hidden units.

### Claim 17 (depends on 13)

The article of claim 13, wherein the statistics include a generalization error.

### Claim 18 (depends on 17)

The article of claim 17, wherein the particular set that is preferred is associated with a smallest generalization error.
