Automated Processing of Multiple Prediction Generation Including Model Tuning
AssigneeDatabricks, Inc.
InventorsBenjamin Thomas Wilson, Corey Zumar
Life of this patent
Estimating the term…
Abstract
The present application discloses a method, system, and computer system for building a model associated with a dataset. The method includes receiving a data set, the dataset comprising a plurality of keys and a plurality of key-value relationships, determining a plurality of models to build based at least in part on the dataset, wherein determining the plurality of models to build comprises using the dataset format information to identify the plurality of models, building the plurality of models, and optimizing at least one of the plurality of models.
Claims21
(canceled)
A computer-implemented method, comprising:
- accessing a set of machine-learning models trained using a dataset, wherein the dataset comprises at least a set of keys and key-values for the set of keys, and wherein each machine-learning model is trained using a respective subset of the dataset corresponding to a respective set of key-values for the set of keys;
- receiving, via an interface, a current dataset that is an updated dataset;
- determining whether drift has occurred with respect to the dataset used to train the set of machine-learning models, comprising determining whether a difference between the current dataset and the dataset exceeds a threshold;
- responsive to a determination the drift has occurred and the difference exceeds the threshold, tuning parameters of one or more machine-learning models in the set of machine-learning models using the current dataset to generate another set of machine-learning models;
- and
- exposing the another set of machine-learning models via an interface of a computing service.
A non-transitory computer-readable storage medium comprising stored instructions executable by a processor system, the instructions when executed causing the processor system to:
- access a set of machine-learning models trained using a dataset, wherein the dataset comprises at least a set of keys and key-values for the set of keys, and wherein each machine-learning model is trained using a respective subset of the dataset corresponding to a respective set of key-values for the set of keys;
- receive, via an interface, a current dataset that is an updated dataset;
- determine whether drift has occurred with respect to the dataset used to train the set of machine-learning models, comprising determining whether a difference between the current dataset and the dataset exceeds a threshold;
- responsive to a determination the drift has occurred and the difference exceeds the threshold, tune parameters of one or more machine-learning models in the set of machine-learning models using the current dataset to generate another set of machine-learning models;
- and
- expose the another set of machine-learning models via an interface of a computing service.
A computer system, comprising:
- a processor system;
- and
- a non-transitory computer-readable storage medium comprising stored instructions executable by a processor system, the instructions when executed causing the processor system to:
- access a set of machine-learning models trained using a dataset, wherein the dataset comprises at least a set of keys and key-values for the set of keys, and wherein each machine-learning model is trained using a respective subset of the dataset corresponding to a respective set of key-values for the set of keys;
- receive, via an interface, a current dataset that is an updated dataset;
- determine whether drift has occurred with respect to the dataset used to train the set of machine-learning models, comprising determining whether a difference between the current dataset and the dataset exceeds a threshold;
- responsive to a determination the drift has occurred and the difference exceeds the threshold, tune parameters of one or more machine-learning models in the set of machine-learning models using the current dataset to generate another set of machine-learning models;
- and
- expose the another set of machine-learning models via an interface of a computing service.
The computer system of claim 16, wherein the instructions when executed further cause the processor system to:
- receive another current dataset;
- for a selected machine-learning model, determine whether an accuracy of the selected machine-learning model with respect to the dataset or the current dataset has decreased below a threshold;
- and
- responsive to a determination that the accuracy of the selected machine-learning model has decreased below the threshold, tune parameters of the selected machine-learning model using the another current dataset.
The computer system of claim 16, wherein the instructions when executed further cause the processor system to:
- for each machine-learning model of the one or more machine-learning models, allocate the machine-learning model to a respective compute resource in a set of compute resources for tuning the parameters of the machine-learning model.
The computer system of claim 16, wherein the another set of machine-learning models is exposed as a composite model via the interface, and wherein the interface is an application programming interface (API) or a web interface.
The computer system of claim 16, wherein the instructions when executed further cause the processor system to:
- receive, from a client device, a query via the interface exposing the another set of machine-learned models;
- select at least one of the another set of machine-learning models for servicing the query;
- generate a prediction for the query using the at least one machine-learning model;
- and
- provide the prediction to the client device as a response to the query.
Dependencies are inferred from the claim text.