# US 2026/0094050 A1 · Creating aligned machine learning models through bootstrapping with attention

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0094050 A1
- Document ID: US20260094050A1
- Status: Published application
- Kind: A1
- Application number: 18/901,432
- Filed: 2024-09-30
- Published: 2026-04-02
- Earliest claimed: 2024-09-30
- Assignees: Intuit Inc.
- Applicants: Intuit Inc.
- Inventors: Shai ARDAZI; Matan VETZLER; Kfir AHARON; Osnat Haj YAHIA
- Web page: https://patentgrep.com/patent/US20260094050A1

## CPC

- G06N 3/09: Supervised learning
- G06N 20/00: Machine learning
- G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/096: Transfer learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Aspects of the present disclosure provide techniques for resource-efficient machine learning model configuration. Embodiments include dividing a set of labeled training data into training data subsets. Embodiments include training a first machine learning model using a first training data subset of the training data subsets. Embodiments include training a second machine learning model that has a same architecture as the first machine learning model using a second training data subset of the training data subsets. Embodiments include creating an aligned weight matrix based on weights of the trained first machine learning model and the trained second machine learning model. Embodiments include configuring an aligned machine learning model that has the same architecture as the first machine learning model using the aligned weight matrix.

## Claims

### Claim 1

A method of resource-efficient machine learning model configuration, comprising:
dividing a set of labeled training data into training data subsets;
training a first machine learning model using a first training data subset of the training data subsets;
training a second machine learning model that has a same architecture as the first machine learning model using a second training data subset of the training data subsets;
creating an aligned weight matrix based on weights of the trained first machine learning model and the trained second machine learning model; and
configuring an aligned machine learning model that has the same architecture as the first machine learning model using the aligned weight matrix.

### Claim 2 (depends on 1)

The method of claim 1, wherein the creating of the aligned weight matrix comprises computing average weight vectors for each layer across the first machine learning model and the second machine learning model.

### Claim 3 (depends on 2)

The method of claim 2, wherein the creating of the aligned weight matrix further comprises computing a standard weight deviation for each layer across the first machine learning model and the second machine learning model.

### Claim 4 (depends on 3)

The method of claim 3, wherein the creating of the aligned weight matrix further comprises sampling values according to a normal distribution based on the average weight vectors and the standard weight deviation for each layer to produce the aligned weight matrix.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first machine learning model, the second machine learning model, and the aligned machine learning model are transformer models, and wherein the configuring of the aligned machine learning model comprises setting attention weights of the aligned machine learning model based on the aligned weight matrix.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first machine learning model and the second machine learning model have been previously trained, and wherein the training of the first machine learning model and the training of the second machine learning model comprise fine tuning processes.

### Claim 7 (depends on 1)

The method of claim 1, further comprising fine tuning the aligned machine learning model based on determining that an accuracy of the aligned machine learning model is below a threshold after the configuring.

### Claim 8 (depends on 1)

The method of claim 1, wherein the aligned machine learning model is used by a computing application after the configuring to generate an output related to one or more actions performed by the computing application.

### Claim 9

A system for resource-efficient machine learning model configuration, comprising:
one or more processors; and
a memory comprising instructions that, when executed by the one or more processors, cause the system to:
divide a set of labeled training data into training data subsets;
train a first machine learning model using a first training data subset of the training data subsets;
train a second machine learning model that has a same architecture as the first machine learning model using a second training data subset of the training data subsets;
create an aligned weight matrix based on weights of the trained first machine learning model and the trained second machine learning model; and
configure an aligned machine learning model that has the same architecture as the first machine learning model using the aligned weight matrix.

### Claim 10 (depends on 9)

The system of claim 9, wherein the creating of the aligned weight matrix comprises computing average weight vectors for each layer across the first machine learning model and the second machine learning model.

### Claim 11 (depends on 10)

The system of claim 10, wherein the creating of the aligned weight matrix further comprises computing a standard weight deviation for each layer across the first machine learning model and the second machine learning model.

### Claim 12 (depends on 11)

The system of claim 11, wherein the creating of the aligned weight matrix further comprises sampling values according to a normal distribution based on the average weight vectors and the standard weight deviation for each layer to produce the aligned weight matrix.

### Claim 13 (depends on 9)

The system of claim 9, wherein the first machine learning model, the second machine learning model, and the aligned machine learning model are transformer models, and wherein the configuring of the aligned machine learning model comprises setting attention weights of the aligned machine learning model based on the aligned weight matrix.

### Claim 14 (depends on 9)

The system of claim 9, wherein the first machine learning model and the second machine learning model have been previously trained, and wherein the training of the first machine learning model and the training of the second machine learning model comprise fine tuning processes.

### Claim 15 (depends on 9)

The system of claim 9, wherein the instructions, when executed by the one or more processors, further cause the system to fine tune the aligned machine learning model based on determining that an accuracy of the aligned machine learning model is below a threshold after the configuring.

### Claim 16 (depends on 9)

The system of claim 9, wherein the aligned machine learning model is used by a computing application after the configuring to generate an output related to one or more actions performed by the computing application.

### Claim 17

A non-transitory computer readable medium comprising instructions that, when executed by one or more processors of a computing system, cause the computing system to:
divide a set of labeled training data into training data subsets;
train a first machine learning model using a first training data subset of the training data subsets;
train a second machine learning model that has a same architecture as the first machine learning model using a second training data subset of the training data subsets;
create an aligned weight matrix based on weights of the trained first machine learning model and the trained second machine learning model; and
configure an aligned machine learning model that has the same architecture as the first machine learning model using the aligned weight matrix.

### Claim 18 (depends on 17)

The non-transitory computer readable medium of claim 17, wherein the creating of the aligned weight matrix comprises computing average weight vectors for each layer across the first machine learning model and the second machine learning model.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein the creating of the aligned weight matrix further comprises computing a standard weight deviation for each layer across the first machine learning model and the second machine learning model.

### Claim 20 (depends on 19)

The non-transitory computer readable medium of claim 19, wherein the creating of the aligned weight matrix further comprises sampling values according to a normal distribution based on the average weight vectors and the standard weight deviation for each layer to produce the aligned weight matrix.
