Selecting hyper parameters for machine learning algorithms based on past training results
OwnerMoshe Guttmanninventor
Life of this patent
Estimating the term…
Abstract
Systems and methods for selecting hyper parameters for machine learning algorithms based on past training results are provided. For example, groups of values of hyper parameters may be obtained. Further, in some examples, results of training the machine learning algorithm using different pluralities of training examples and/or the different group of values of hyper parameters may be obtained. Further, in some examples, the results and the groups of values of hyper parameters may be used to select at least one value of a hyper parameter for a prospective training of the machine learning algorithm.
Claims20
A method for selecting hyper parameters for machine learning algorithms based on past training results, the method comprising:
- obtaining a first group of values of hyper parameters, a second group of values of hyper parameters and a third group of values of hyper parameters, the second group of values of hyper parameters differs from the first group of values of hyper parameters, and the third group of values of hyper parameters differs from the first group of values of hyper parameters and the second group of values of hyper parameters;
- obtaining a first result of training a machine learning algorithm using a first plurality of training examples and the first group of values of hyper parameters;
- obtaining a second result of training the machine learning algorithm using a second plurality of training examples and the second group of values of hyper parameters;
- obtaining a third result of training the machine learning algorithm using a third plurality of training examples and the third group of values of hyper parameters;
- and
- using the first result, the second result, the third result, the first group of values of hyper parameters, the second group of values of hyper parameters and the third group of values of hyper parameters to select at least one value of a hyper parameter for a prospective training of the machine learning algorithm.
A system for selecting hyper parameters for machine learning algorithms based on past training results, the system comprising:
- at least one processor configured to:
- obtain a first group of values of hyper parameters, a second group of values of hyper parameters and a third group of values of hyper parameters, the second group of values of hyper parameters differs from the first group of values of hyper parameters, and the third group of values of hyper parameters differs from the first group of values of hyper parameters and the second group of values of hyper parameters;
- obtain a first result of training a machine learning algorithm using a first plurality of training examples and the first group of values of hyper parameters;
- obtain a second result of training the machine learning algorithm using a second plurality of training examples and the second group of values of hyper parameters;
- obtain a third result of training the machine learning algorithm using a third plurality of training examples and the third group of values of hyper parameters;
- and
- use the first result, the second result, the third result, the first group of values of hyper parameters, the second group of values of hyper parameters and the third group of values of hyper parameters to select at least one value of a hyper parameter for a prospective training of the machine learning algorithm.
A non-transitory computer readable medium storing data and computer implementable instructions for carrying out a method for selecting hyper parameters for machine learning algorithms based on past training results, the method comprising:
- obtaining a first group of values of hyper parameters, a second group of values of hyper parameters and a third group of values of hyper parameters, the second group of values of hyper parameters differs from the first group of values of hyper parameters, and the third group of values of hyper parameters differs from the first group of values of hyper parameters and the second group of values of hyper parameters;
- obtaining a first result of training a machine learning algorithm using a first plurality of training examples and the first group of values of hyper parameters;
- obtaining a second result of training the machine learning algorithm using a second plurality of training examples and the second group of values of hyper parameters;
- obtaining a third result of training the machine learning algorithm using a third plurality of training examples and the third group of values of hyper parameters;
- and
- using the first result, the second result, the third result, the first group of values of hyper parameters, the second group of values of hyper parameters and the third group of values of hyper parameters to select at least one value of a hyper parameter for a prospective training of the machine learning algorithm.
Dependencies are inferred from the claim text.