# US 2025/0061378 A1 · Automated Processing of Multiple Prediction Generation Including Model Tuning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0061378 A1
- Document ID: US20250061378A1
- Status: Published application
- Kind: A1
- Application number: 18/738,025
- Filed: 2024-06-09
- Published: 2025-02-20
- Earliest claimed: 2022-01-28
- Assignees: Databricks, Inc.
- Applicants: Databricks, Inc.
- Inventors: Benjamin Thomas Wilson; Corey Zumar
- Web page: https://patentgrep.com/patent/US20250061378A1

## CPC

- G06N 20/00: Machine learning
- G06F 18/21322: {Rendering the within-class scatter matrix non-singular}
- G06F 18/2413: based on distances to training or reference patterns
- G06F 18/285: {Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system}
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06F 18/21326: {involving optimisations, e.g. using regularisation techniques}
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present application discloses a method, system, and computer system for building a model associated with a dataset. The method includes receiving a data set, the dataset comprising a plurality of keys and a plurality of key-value relationships, determining a plurality of models to build based at least in part on the dataset, wherein determining the plurality of models to build comprises using the dataset format information to identify the plurality of models, building the plurality of models, and optimizing at least one of the plurality of models.

## Claims

### Claim 1

(canceled)

### Claim 2

A computer-implemented method, comprising:
accessing a set of machine-learning models trained using a dataset, wherein the dataset comprises at least a set of keys and key-values for the set of keys, and wherein each machine-learning model is trained using a respective subset of the dataset corresponding to a respective set of key-values for the set of keys;
receiving, via an interface, a current dataset that is an updated dataset;
determining whether drift has occurred with respect to the dataset used to train the set of machine-learning models, comprising determining whether a difference between the current dataset and the dataset exceeds a threshold;
responsive to a determination the drift has occurred and the difference exceeds the threshold, tuning parameters of one or more machine-learning models in the set of machine-learning models using the current dataset to generate another set of machine-learning models; and
exposing the another set of machine-learning models via an interface of a computing service.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, comprising:
receiving another current dataset;
for a selected machine-learning model, determining whether an accuracy of the selected machine-learning model with respect to the dataset or the current dataset has decreased below a threshold; and
responsive to a determination that the accuracy of the selected machine-learning model has decreased below the threshold, tuning parameters of the selected machine-learning model using the another current dataset.

### Claim 4 (depends on 2)

The computer-implemented method of claim 2, comprising:
for each machine-learning model of the one or more machine-learning models, allocating the machine-learning model to a respective compute resource in a set of compute resources for tuning the parameters of the machine-learning model.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, further comprising:
for each machine-learning model of the one or more machine-learning models, caching a corresponding dataset of the current dataset for tuning the parameters of the machine-learning model in the respective compute resource.

### Claim 6 (depends on 2)

The computer-implemented method of claim 2, wherein the another set of machine-learning models is exposed as a composite model via the interface, and wherein the interface is an application programming interface (API) or a web interface.

### Claim 7 (depends on 2)

The computer-implemented method of claim 2, further comprising:
receiving, from a client device, a query via the interface exposing the another set of machine-learned models;
selecting at least one of the another set of machine-learning models for servicing the query;
generating a prediction for the query using the at least one machine-learning model; and
providing the prediction to the client device as a response to the query.

### Claim 8 (depends on 2)

The computer-implemented method of claim 2, wherein the set of keys represent one or a combination of geographical region, item, price, date, and time information.

### Claim 9

A non-transitory computer-readable storage medium comprising stored instructions executable by a processor system, the instructions when executed causing the processor system to:
access a set of machine-learning models trained using a dataset, wherein the dataset comprises at least a set of keys and key-values for the set of keys, and wherein each machine-learning model is trained using a respective subset of the dataset corresponding to a respective set of key-values for the set of keys;
receive, via an interface, a current dataset that is an updated dataset;
determine whether drift has occurred with respect to the dataset used to train the set of machine-learning models, comprising determining whether a difference between the current dataset and the dataset exceeds a threshold;
responsive to a determination the drift has occurred and the difference exceeds the threshold, tune parameters of one or more machine-learning models in the set of machine-learning models using the current dataset to generate another set of machine-learning models; and
expose the another set of machine-learning models via an interface of a computing service.

### Claim 10 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the instructions when executed further cause the processor system to:
receive another current dataset;
for a selected machine-learning model, determine whether an accuracy of the selected machine-learning model with respect to the dataset or the current dataset has decreased below a threshold; and
responsive to a determination that the accuracy of the selected machine-learning model has decreased below the threshold, tune parameters of the selected machine-learning model using the another current dataset.

### Claim 11 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the instructions when executed further cause the processor system to:
for each machine-learning model of the one or more machine-learning models, allocate the machine-learning model to a respective compute resource in a set of compute resources for tuning the parameters of the machine-learning model.

### Claim 12 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the instructions when executed further cause the processor system to:
for each machine-learning model of the one or more machine-learning models, cache a corresponding dataset of the current dataset for tuning the parameters of the machine-learning model in the respective compute resource.

### Claim 13 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the another set of machine-learning models is exposed as a composite model via the interface, and wherein the interface is an application programming interface (API) or a web interface.

### Claim 14 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the instructions when executed further cause the processor system to:
receive, from a client device, a query via the interface exposing the another set of machine-learned models;
select at least one of the another set of machine-learning models for servicing the query;
generate a prediction for the query using the at least one machine-learning model; and
provide the prediction to the client device as a response to the query.

### Claim 15 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the set of keys represent one or a combination of geographical region, item, price, date, and time information.

### Claim 15

A computer system, comprising:
a processor system; and
a non-transitory computer-readable storage medium comprising stored instructions executable by a processor system, the instructions when executed causing the processor system to:
access a set of machine-learning models trained using a dataset, wherein the dataset comprises at least a set of keys and key-values for the set of keys, and wherein each machine-learning model is trained using a respective subset of the dataset corresponding to a respective set of key-values for the set of keys;
receive, via an interface, a current dataset that is an updated dataset;
determine whether drift has occurred with respect to the dataset used to train the set of machine-learning models, comprising determining whether a difference between the current dataset and the dataset exceeds a threshold;
responsive to a determination the drift has occurred and the difference exceeds the threshold, tune parameters of one or more machine-learning models in the set of machine-learning models using the current dataset to generate another set of machine-learning models; and
expose the another set of machine-learning models via an interface of a computing service.

### Claim 17 (depends on 16)

The computer system of claim 16, wherein the instructions when executed further cause the processor system to:
receive another current dataset;
for a selected machine-learning model, determine whether an accuracy of the selected machine-learning model with respect to the dataset or the current dataset has decreased below a threshold; and
responsive to a determination that the accuracy of the selected machine-learning model has decreased below the threshold, tune parameters of the selected machine-learning model using the another current dataset.

### Claim 18 (depends on 16)

The computer system of claim 16, wherein the instructions when executed further cause the processor system to:
for each machine-learning model of the one or more machine-learning models, allocate the machine-learning model to a respective compute resource in a set of compute resources for tuning the parameters of the machine-learning model.

### Claim 19 (depends on 18)

The computer system of claim 18, wherein the instructions when executed further cause the processor system to:
for each machine-learning model of the one or more machine-learning models, cache a corresponding dataset of the current dataset for tuning the parameters of the machine-learning model in the respective compute resource.

### Claim 20 (depends on 16)

The computer system of claim 16, wherein the another set of machine-learning models is exposed as a composite model via the interface, and wherein the interface is an application programming interface (API) or a web interface.

### Claim 21 (depends on 16)

The computer system of claim 16, wherein the instructions when executed further cause the processor system to:
receive, from a client device, a query via the interface exposing the another set of machine-learned models;
select at least one of the another set of machine-learning models for servicing the query;
generate a prediction for the query using the at least one machine-learning model; and
provide the prediction to the client device as a response to the query.
