Systems and methods for hyperparameter optimization
AssigneeKinaxis Inc.
InventorsAnthony John Arena, Kevin Wye-Lim Chan, Yousra Mohamed, Behrouz Haji Soleimani
Life of this patent
Estimating the term…
Abstract
Methods and systems for improving the efficiency of hyperparameter tuning by generalizing run results across different segments of data. Segments are grouped by segment data metrics, to produce segment clusters. Hyperparameter tuning is run for a cluster medoid and resulting hyperparameters are used for training machine learning models for the segments corresponding to the cluster.
Claims15
A computing apparatus comprising:
- a processor;
- and
- a memory storing instructions that, when executed by the processor, configure the apparatus to:
- receive a plurality of segment data;
- determine data metrics for each segment data;
- cluster data points into a plurality of clusters, the data points indicative of a subset of the data metrics for each segment data;
- determine a preliminary medoid of each cluster;
- select a cluster;
- tune a set of hyperparameters using segment data corresponding to a medoid of the cluster;
- and
- train a machine learning model on each segment data in the cluster using the set of hyperparameters associated with the cluster.
A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:
- receive a plurality of segment data;
- determine data metrics for each segment data;
- cluster data points into a plurality of clusters, the data points indicative of a subset of the data metrics for each segment data;
- determine a preliminary medoid of each cluster;
- select a cluster;
- tune a set of hyperparameters using segment data corresponding to a medoid of the cluster;
- and
- train a machine learning model on each segment data in the cluster using the set of hyperparameters associated with the cluster.
A computer-implemented method comprising:
- receiving, by a processor, a plurality of segment data;
- determining, by the processor, data metrics for each segment data;
- clustering, by the processor, data points into a plurality of clusters, the data points indicative of a subset of the data metrics for each segment data;
- determining, by the processor, a preliminary medoid of each cluster;
- selecting, by the processor, a cluster;
- tuning, by the processor, a set of hyperparameters using segment data corresponding to a medoid of the cluster;
- and
- training, by the processor, a machine learning model on each segment data in the cluster using the set of hyperparameters associated with the cluster.
Dependencies are inferred from the claim text.