# US 2024/0403706 A1 · Active multifidelity learning for language models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0403706 A1
- Document ID: US20240403706A1
- Status: Published application
- Kind: A1
- Application number: 18/616,315
- Filed: 2024-03-26
- Published: 2024-12-05
- Earliest claimed: 2023-05-31
- Assignees: Intuit Inc.
- Applicants: Intuit Inc.
- Inventors: Jiaxin ZHANG; Kamalika DAS; Sricharan Kallur Palli KUMAR
- Web page: https://patentgrep.com/patent/US20240403706A1

## CPC

- G06N 20/00: Machine learning
- G06N 3/045: Combinations of networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Aspects of the present disclosure provide techniques for active multifidelity machine learning. Embodiments include selecting, based on one or more criteria, a first subset of unlabeled training data for manual review and a second subset of unlabeled training data for providing to a pre-trained machine learning model for automated labeling. Embodiments include receiving manual label data for the first subset of unlabeled training data. Embodiments include providing inputs to the pre-trained machine learning model based on a subset of the manual label data and the second subset of training data. Embodiments include receiving, as outputs from the pre-trained machine learning model, automated label data for the second subset of unlabeled training data. Embodiments include generating a training data set for a target machine learning model based on the set of unlabeled training data, the manual label data, and the automated label data.

## Claims

### Claim 1

A method for active multifidelity machine learning, comprising:
receiving a set of unlabeled training data;
selecting, based on one or more criteria, a first subset of the set of unlabeled training data for providing to one or more users for manual review and a second subset of the set of unlabeled training data for providing to a pre-trained machine learning model for automated labeling;
receiving manual label data for the first subset of the set of unlabeled training data;
providing inputs to the pre-trained machine learning model based on a subset of the manual label data and the second subset of the set of unlabeled training data;
receiving, as outputs from the pre-trained machine learning model in response to the inputs, automated label data for the second subset of the set of unlabeled training data; and
generating a training data set for a target machine learning model based on the set of unlabeled training data, the manual label data, and the automated label data, wherein the training data set is used to fine-tune the target machine learning model through a supervised learning process by which the target machine learning model is iteratively adjusted based on the training data set.

### Claim 2 (depends on 1)

The method of claim 1, wherein the selecting, based on the one or more criteria, the first subset of the set of unlabeled training data for providing to the one or more users for manual review and the second subset of the set of unlabeled training data for providing to the pre-trained machine learning model for automated labeling is based on confidence scores output by the target machine learning model in response to respective unlabeled training data instances of the set of unlabeled training data.

### Claim 3 (depends on 2)

The method of claim 2, wherein the selecting, based on the one or more criteria, the first subset of the set of unlabeled training data for providing to the one or more users for manual review and the second subset of the set of unlabeled training data for providing to the pre-trained machine learning model for automated labeling is based further on applying a clustering algorithm to at least a subset of the set of unlabeled training data.

### Claim 4 (depends on 3)

The method of claim 3, wherein the first subset of the set of unlabeled training data and the second subset of the set of unlabeled training data correspond to central points of clusters determined through the applying of the clustering algorithm.

### Claim 5 (depends on 1)

The method of claim 1, wherein the pre-trained machine learning model has a larger number of parameters than the target machine learning model.

### Claim 6 (depends on 1)

The method of claim 1, wherein the subset of the manual label data is selected based on comparing embeddings of respective unlabeled training data instances in the first subset of the set of unlabeled training data to corresponding embeddings of given unlabeled training data instances in the second subset of the set of unlabeled training data.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first subset of the set of unlabeled training data is smaller than the second subset of the set of unlabeled training data.

### Claim 8 (depends on 1)

The method of claim 1, wherein, in a subsequent round of generating labeled training data, a respective subset of unlabeled training data is selected for manual labeling, and the respective subset is smaller than the first subset of the set of unlabeled training data.

### Claim 9 (depends on 1)

The method of claim 1, wherein the pre-trained machine learning model uses the manual label data for in-context learning when generating the automated label data for the second subset of the set of unlabeled training data.

### Claim 10

A system for active multifidelity machine learning, comprising:
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, cause the system to:
receive a set of unlabeled training data;
select, based on one or more criteria, a first subset of the set of unlabeled training data for providing to one or more users for manual review and a second subset of the set of unlabeled training data for providing to a pre-trained machine learning model for automated labeling;
receive manual label data for the first subset of the set of unlabeled training data;
provide inputs to the pre-trained machine learning model based on a subset of the manual label data and the second subset of the set of unlabeled training data;
receive, as outputs from the pre-trained machine learning model in response to the inputs, automated label data for the second subset of the set of unlabeled training data; and
generate a training data set for a target machine learning model based on the set of unlabeled training data, the manual label data, and the automated label data, wherein the training data set is used to fine-tune the target machine learning model through a supervised learning process by which the target machine learning model is iteratively adjusted based on the training data set.

### Claim 11 (depends on 10)

The system of claim 10, wherein the selecting, based on the one or more criteria, the first subset of the set of unlabeled training data for providing to the one or more users for manual review and the second subset of the set of unlabeled training data for providing to the pre-trained machine learning model for automated labeling is based on confidence scores output by the target machine learning model in response to respective unlabeled training data instances of the set of unlabeled training data.

### Claim 12 (depends on 11)

The system of claim 11, wherein the selecting, based on the one or more criteria, the first subset of the set of unlabeled training data for providing to the one or more users for manual review and the second subset of the set of unlabeled training data for providing to the pre-trained machine learning model for automated labeling is based further on applying a clustering algorithm to at least a subset of the set of unlabeled training data.

### Claim 13 (depends on 12)

The system of claim 12, wherein the first subset of the set of unlabeled training data and the second subset of the set of unlabeled training data correspond to central points of clusters determined through the applying of the clustering algorithm.

### Claim 14 (depends on 10)

The system of claim 10, wherein the pre-trained machine learning model has a larger number of parameters than the target machine learning model.

### Claim 15 (depends on 10)

The system of claim 10, wherein the subset of the manual label data is selected based on comparing embeddings of respective unlabeled training data instances in the first subset of the set of unlabeled training data to corresponding embeddings of given unlabeled training data instances in the second subset of the set of unlabeled training data.

### Claim 16 (depends on 10)

The system of claim 10, wherein the first subset of the set of unlabeled training data is smaller than the second subset of the set of unlabeled training data.

### Claim 17 (depends on 10)

The system of claim 10, wherein, in a subsequent round of generating labeled training data, a respective subset of unlabeled training data is selected for manual labeling, and the respective subset is smaller than the first subset of the set of unlabeled training data.

### Claim 18 (depends on 10)

The system of claim 10, wherein the pre-trained machine learning model uses the manual label data for in-context learning when generating the automated label data for the second subset of the set of unlabeled training data.

### Claim 19

A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of a computing system, cause the computing system to:
receive a set of unlabeled training data;
select, based on one or more criteria, a first subset of the set of unlabeled training data for providing to one or more users for manual review and a second subset of the set of unlabeled training data for providing to a pre-trained machine learning model for automated labeling;
receive manual label data for the first subset of the set of unlabeled training data;
provide inputs to the pre-trained machine learning model based on a subset of the manual label data and the second subset of the set of unlabeled training data;
receive, as outputs from the pre-trained machine learning model in response to the inputs, automated label data for the second subset of the set of unlabeled training data; and
generate a training data set for a target machine learning model based on the set of unlabeled training data, the manual label data, and the automated label data, wherein the training data set is used to fine-tune the target machine learning model through a supervised learning process by which the target machine learning model is iteratively adjusted based on the training data set.

### Claim 20 (depends on 19)

The non-transitory computer-readable medium of claim 19, wherein the selecting, based on the one or more criteria, the first subset of the set of unlabeled training data for providing to the one or more users for manual review and the second subset of the set of unlabeled training data for providing to the pre-trained machine learning model for automated labeling is based on confidence scores output by the target machine learning model in response to respective unlabeled training data instances of the set of unlabeled training data.
