# US 2026/0073236 A1 · Data efficient alignment of large language models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073236 A1
- Document ID: US20260073236A1
- Status: Published application
- Kind: A1
- Application number: 19/089,993
- Filed: 2025-03-25
- Published: 2026-03-12
- Earliest claimed: 2024-09-11
- Assignees: Nutanix, Inc.
- Applicants: Nutanix, Inc.
- Inventors: Rajat GHOSH; Debojyoti DUTTA; Amrit KHERA
- Web page: https://patentgrep.com/patent/US20260073236A1

## CPC

- G06N 3/096: Transfer learning
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Techniques for data efficient alignment of large language models retrieving a dataset comprising a plurality of alignment data elements; calculating an entropy for the dataset; for each alignment data element, calculate a respective entropy change value based on a difference between the entropy of the dataset and an entropy specific to the alignment data element; and generating an alignment training dataset comprising a subset of the plurality of alignment data elements that are identified based on the respective entropy change values.

## Claims

### Claim 1

One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform steps of:
retrieving a dataset comprising a plurality of alignment data elements;
calculating an entropy for the dataset;
for each alignment data element, calculate a respective entropy change value based on a difference between the entropy of the dataset and an entropy specific to the alignment data element; and
generating an alignment training dataset comprising a subset of the plurality of alignment data elements that are identified based on the respective entropy change values.

### Claim 2 (depends on 1)

The one or more non-transitory computer-readable media of claim 1, wherein the steps further comprise determining the entropy specific to a first alignment data element based on an entropy of the dataset with the first alignment data element removed.

### Claim 3 (depends on 1)

The one or more non-transitory computer-readable media of claim 1, wherein the steps further comprise:
training one or more large language models using the alignment training dataset.

### Claim 4 (depends on 1)

The one or more non-transitory computer-readable media of claim 1, wherein the steps further comprise:
encoding the plurality of alignment data elements using an encoder from a large language model to generating a plurality of encoded datapoints; and
calculating the entropy of the dataset using probabilities of selecting each of the plurality of encoded datapoints.

### Claim 5 (depends on 4)

The one or more non-transitory computer-readable media of claim 4, wherein the steps further comprise modeling the plurality of encoded datapoints using a Gaussian mixture model.

### Claim 6 (depends on 1)

The one or more non-transitory computer-readable media of claim 1, wherein the subset of the plurality of alignment data elements includes alignment data elements having respective entropy change values that are larger than respective entropy change values of unselected ones of the plurality of alignment data elements.

### Claim 7 (depends on 1)

The one or more non-transitory computer-readable media of claim 1, wherein generating the alignment training dataset comprises:
selecting a predetermined number of alignment data elements corresponding to the plurality of alignment data elements having largest respective entropy change values.

### Claim 8 (depends on 7)

The one or more non-transitory computer-readable media of claim 7, wherein the predetermined number is ten percent of the alignment data elements in the dataset.

### Claim 9 (depends on 7)

The one or more non-transitory computer-readable media of claim 7, wherein the predetermined number is selected to control an amount of computing resources used when alignment training a large language model using the alignment training dataset.

### Claim 10 (depends on 1)

The one or more non-transitory computer-readable media of claim 1, wherein a respective alignment data element of the alignment data elements comprises at least one of: input for a large language model, a response from the large language model, an input-response pair associated with the large language model, or a session comprising a plurality of input-response pairs associated with the large language model.

### Claim 11

A computer-implemented method for generating alignment training data, the method comprising:
retrieving a dataset comprising a plurality of alignment data elements;
calculating an entropy for the dataset;
for each alignment data element, calculate a respective entropy change value based on a difference between the entropy of the dataset and an entropy specific to the alignment data element; and
generating an alignment training dataset comprising a subset of the plurality of alignment data elements that are identified based on the respective entropy change values.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, wherein the steps further comprise determining the entropy specific to a first alignment data element based on an entropy of the dataset with the first alignment data element removed.

### Claim 13 (depends on 11)

The computer-implemented method of claim 11, further comprising:
training one or more large language models using the alignment training dataset.

### Claim 14 (depends on 11)

The computer-implemented method of claim 11, further comprising:
encoding the plurality of alignment data elements using an encoder from a large language model to generating a plurality of encoded datapoints; and
calculating the entropy of the dataset using probabilities of selecting each of the plurality of encoded datapoints.

### Claim 15 (depends on 14)

The computer-implemented method of claim 14, further comprising modeling the plurality of encoded datapoints using a Gaussian mixture model.

### Claim 16 (depends on 11)

The computer-implemented method of claim 11, wherein the subset of the plurality of alignment data elements includes alignment data elements having respective entropy change values that are larger than respective entropy change values of unselected ones of the plurality of alignment data elements.

### Claim 17 (depends on 11)

The computer-implemented method of claim 11, wherein generating the alignment training dataset comprises:
selecting a predetermined number of alignment data elements corresponding to the plurality of alignment data elements having largest respective entropy change values.

### Claim 18 (depends on 17)

The computer-implemented method of claim 17, wherein the predetermined number is ten percent of the alignment data elements in the dataset.

### Claim 19 (depends on 17)

The computer-implemented method of claim 17, wherein the predetermined number is selected to control an amount of computing resources used when alignment training a large language model using the alignment training dataset.

### Claim 20 (depends on 11)

The computer-implemented method of claim 11, wherein a respective alignment data element of the alignment data elements comprises at least one of: input for a large language model, a response from the large language model, an input-response pair associated with the large language model, or a session comprising a plurality of input-response pairs associated with the large language model.

### Claim 21

A system comprising:
a memory storing instructions; and
one or more processors coupled to the memory and, when executing the instructions, are configured to perform steps comprising:
retrieving a dataset comprising a plurality of alignment data elements;
calculating an entropy for the dataset;
for each alignment data element, calculate a respective entropy change value based on a difference between the entropy of the dataset and an entropy specific to the alignment data element; and
generating an alignment training dataset comprising a subset of the plurality of alignment data elements that are identified based on the respective entropy change values.

### Claim 22 (depends on 21)

The system of claim 21, wherein the steps further comprise determining the entropy specific to a first alignment data element based on an entropy of the dataset with the first alignment data element removed.

### Claim 23 (depends on 21)

The system of claim 21, wherein the steps further comprise:
training one or more large language models using the alignment training dataset.

### Claim 24 (depends on 21)

The system of claim 21, wherein the steps further comprise:
encoding the plurality of alignment data elements using an encoder from a large language model to generating a plurality of encoded datapoints; and
calculating the entropy of the dataset using probabilities of selecting each of the plurality of encoded datapoints.

### Claim 25 (depends on 24)

The system of claim 24, wherein the steps further comprise modeling the plurality of encoded datapoints using a Gaussian mixture model.

### Claim 26 (depends on 21)

The system of claim 21, wherein the subset of the plurality of alignment data elements includes alignment data elements having respective entropy change values that are larger than respective entropy change values of unselected ones of the plurality of alignment data elements.

### Claim 27 (depends on 21)

The system of claim 21, wherein generating the alignment training dataset comprises:
selecting a predetermined number of alignment data elements corresponding to the plurality of alignment data elements having largest respective entropy change values.

### Claim 28 (depends on 27)

The system of claim 27, wherein the predetermined number is ten percent of the alignment data elements in the dataset.

### Claim 29 (depends on 27)

The system of claim 27, wherein the predetermined number is selected to control an amount of computing resources used when alignment training a large language model using the alignment training dataset.

### Claim 30 (depends on 21)

The system of claim 21, wherein a respective alignment data element of the alignment data elements comprises at least one of: input for a large language model, a response from the large language model, an input-response pair associated with the large language model, or a session comprising a plurality of input-response pairs associated with the large language model.
