# US 2025/0156644 A1 · Synthetic data generation using large language models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0156644 A1
- Document ID: US20250156644A1
- Status: Published application
- Kind: A1
- Application number: 18/505,739
- Filed: 2023-11-09
- Published: 2025-05-15
- Earliest claimed: 2023-11-09
- Assignees: NVIDIA Corporation
- Applicants: NVIDIA Corporation
- Inventors: Chandana NEERUKONDA; Rajath SHETTY; Felipe SOARES; Makesh Narsimhan SREEDHAR
- Web page: https://patentgrep.com/patent/US20250156644A1

## CPC

- G06F 40/35: Discourse or dialogue representation
- G06F 40/289: Phrasal analysis, e.g. finite state techniques or chunking
- G06F 40/30: Semantic analysis
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 5/041: {Abduction}
- G06N 20/00: Machine learning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

In various examples, synthetic question-answer (QA) pairs may be generated using question and answer generation models comprising corresponding language models (e.g., autoregressive LLMs). A repository of textual data representing a particular knowledge base may be used to source synthetic QA pairs by partitioning textual data from the repository into units of text (e.g., paragraphs) that represent context. For each unit of text, the question generation model may be prompted to generate a synthetic question from that unit of text, and the answer generation model may be prompted to generate a synthetic answer to the synthetic question. Textual entailment and/or human evaluations may be used to filter out low quality, incorrect, and/or non-productive QA pairs that may be a result of hallucinations. As such, the synthetic QA pairs may be used as, and/or may be used to generate, training data for one or more machine learning models.

## Claims

### Claim 1

A processor comprising:
one or more processing units to:
generate a synthetic question based at least on applying a representation of a unit of source text from a repository of textual data to one or more first language models;
generate a synthetic answer to the synthetic question based at least on applying a representation of the synthetic question to one or more second language models; and
update one or more parameters of one or more machine learning models based on at least one of the synthetic question or the synthetic answer.

### Claim 2 (depends on 1)

The processor of claim 1, wherein the one or more processing units are further to generate the synthetic answer based at least on applying the representation of the synthetic question and the unit of source text from the repository to the one or more second language models.

### Claim 3 (depends on 1)

The processor of claim 1, wherein the one or more processing units are further to determine to exclude the synthetic question and the synthetic answer from a dataset based at least on using one or more third language models tuned for question entailment to predict that the synthetic question cannot be answered from the unit of source text.

### Claim 4 (depends on 1)

The processor of claim 1, wherein the one or more processing units are further to determine to exclude the synthetic question and the synthetic answer from a dataset based at least on using one or more third language models tuned for answer entailment to predict that the synthetic answer was not extracted from the unit of source text.

### Claim 5 (depends on 1)

The processor of claim 1, wherein the one or more processing units are further to determine, using one or more third language models tuned for at least one of question entailment or answer entailment, that at least one of the synthetic question or the synthetic answer represents a hallucination.

### Claim 6 (depends on 1)

The processor of claim 1, wherein the one or more processing units are further to generate the one or more first language models based at least on tuning a base language model to tailor the base language model to a question generation task.

### Claim 7 (depends on 1)

The processor of claim 1, wherein the one or more processing units are further to generate the one or more second language models based at least on tuning a base language model to tailor the base language model to an answer generation task.

### Claim 8 (depends on 1)

The processor of claim 1, wherein the one or more processing units are further to generate at least one of the one or more first language models or the one or more second language models based at least on tuning using one or more question-answer pairs in a common domain as the unit of source text for the synthetic question.

### Claim 9 (depends on 1)

The processor of claim 1, wherein the processor is comprised in at least one of:
a control system for an autonomous or semi-autonomous machine;
a perception system for an autonomous or semi-autonomous machine;
a system for performing simulation operations;
a system for performing digital twin operations;
a system for performing light transport simulation;
a system for performing collaborative content creation for 3D assets;
a system for performing deep learning operations;
a system for performing remote operations;
a system for performing real-time streaming;
a system for generating or presenting one or more of augmented reality content, virtual reality content, or mixed reality content;
a system implemented using an edge device;
a system implemented using a robot;
a system for performing conversational AI operations;
a system implementing one or more language models;
a system implementing one or more large language models (LLMs);
a system for generating synthetic data;
a system for generating synthetic data using AI;
a system incorporating one or more virtual machines (VMs);
a system implemented at least partially in a data center; or
a system implemented at least partially using cloud computing resources.

### Claim 10

A system comprising one or more processing units to generate a synthetic question based at least on applying a representation of one or more sequences of source text from a repository to one or more first language models, and generate a synthetic answer to the synthetic question based at least on applying a representation of the synthetic question to one or more second language models.

### Claim 11 (depends on 10)

The system of claim 10, wherein the one or more processing units are further to generate the synthetic answer based at least on applying the representation of the synthetic question and the one or more sequences of source text from the repository to the one or more second language models.

### Claim 12 (depends on 10)

The system of claim 10, wherein the one or more processing units are further to determine to exclude the synthetic question and the synthetic answer from a dataset based at least on using one or more third language models tuned for question entailment to predict that the synthetic question cannot be answered from the one or more sequences of source text.

### Claim 13 (depends on 10)

The system of claim 10, wherein the one or more processing units are further to determine to exclude the synthetic question and the synthetic answer from a dataset based at least on using one or more third language models tuned for answer entailment to predict that the synthetic answer was not extracted from the one or more sequences of source text.

### Claim 14 (depends on 10)

The system of claim 10, wherein the one or more processing units are further to determine, using one or more third language models tuned for at least one of question entailment or answer entailment, that at least one of the synthetic question or the synthetic answer represents a hallucination.

### Claim 15 (depends on 10)

The system of claim 10, wherein the one or more processing units are further to generate the one or more first language models based at least on tuning a base language model to tailor the base language model to a question generation task.

### Claim 16 (depends on 10)

The system of claim 10, wherein the one or more processing units are further to generate the one or more second language models based at least on tuning a base language model to tailor the base language model to an answer generation task.

### Claim 17 (depends on 10)

The system of claim 10, wherein the one or more processing units are further to generate at least one of the one or more first language models or the one or more second language models based at least on tuning using one or more question-answer pairs in a common domain as the one or more sequences of source text for the synthetic question.

### Claim 18 (depends on 10)

The system of claim 10, wherein the system is comprised in at least one of:
a control system for an autonomous or semi-autonomous machine;
a perception system for an autonomous or semi-autonomous machine;
a system for performing simulation operations;
a system for performing digital twin operations;
a system for performing light transport simulation;
a system for performing collaborative content creation for 3D assets;
a system for performing deep learning operations;
a system for performing remote operations;
a system for performing real-time streaming;
a system for generating or presenting one or more of augmented reality content, virtual reality content, or mixed reality content;
a system implemented using an edge device;
a system implemented using a robot;
a system for performing conversational AI operations;
a system implementing one or more language models;
a system implementing one or more large language models (LLMs);
a system for generating synthetic data;
a system for generating synthetic data using AI;
a system incorporating one or more virtual machines (VMs);
a system implemented at least partially in a data center; or
a system implemented at least partially using cloud computing resources.

### Claim 19

A method comprising:
generate a synthetic question based at least on applying a representation of a sequence of source text from a repository to one or more first language models;
generate a synthetic answer to the synthetic question based at least on applying a representation of the synthetic question to one or more second language models; and
update one or more machine learning models based on at least one of the synthetic question or the synthetic answer.

### Claim 20 (depends on 19)

The method of claim 19, wherein the method is performed by at least one of:
a control system for an autonomous or semi-autonomous machine;
a perception system for an autonomous or semi-autonomous machine;
a system for performing simulation operations;
a system for performing digital twin operations;
a system for performing light transport simulation;
a system for performing collaborative content creation for 3D assets;
a system for performing deep learning operations;
a system for performing remote operations;
a system for performing real-time streaming;
a system for generating or presenting one or more of augmented reality content, virtual reality content, or mixed reality content;
a system implemented using an edge device;
a system implemented using a robot;
a system for performing conversational AI operations;
a system implementing one or more language models;
a system implementing one or more large language models (LLMs);
a system for generating synthetic data;
a system for generating synthetic data using AI;
a system incorporating one or more virtual machines (VMs);
a system implemented at least partially in a data center; or
a system implemented at least partially using cloud computing resources.
