# US 2026/0228452 A1 · Multilingual Batch Alignment Training For Language Models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0228452 A1
- Document ID: US20260228452A1
- Status: Published application
- Kind: A1
- Application number: 19/199,099
- Filed: 2025-05-05
- Published: 2026-08-06
- Earliest claimed: 2025-02-04
- Assignees: Oracle International Corporation
- Applicants: Oracle International Corporation
- Inventors: Amit Agarwal; Tao Sheng; Hansa Meghwani
- Web page: https://patentgrep.com/patent/US20260228452A1

## CPC

- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
- G06F 40/216: using statistical methods
- G06F 40/284: Lexical analysis, e.g. tokenisation or collocates
- G06F 40/30: Semantic analysis
- G06F 40/35: Discourse or dialogue representation
- G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/045: Combinations of networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/047: Probabilistic or stochastic networks
- G06N 3/08: Learning methods
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N 3/092: Reinforcement learning
- G06N 5/02: Knowledge representation; Symbolic representation
- G06N 5/022: Knowledge engineering; Knowledge acquisition
- G06N 5/04: Inference or reasoning models
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 20/00: Machine learning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Techniques for multilingual batch alignment training and/or fine-tuning for language models are included herein. The system generates and/or accesses data points from batches of data having semantically equivalent content across languages and/or semantically equivalent prompts across languages. The prompts include queries related to a topic or a predictive language task. The data points include one or more sets of resources that are semantic equivalents in different languages. Data points for which a resource enables a correct response are used as positive training data points for reinforcement learning. Data points for which a resource does not enable a correct response are considered as negative training data points for reinforcement learning. The data points are used for alignment training and/or other reinforcement learning for generative language models.

## Claims

### Claim 1

A method comprising:
defining a batch of data points including a first data point and a second data point by:
accessing (a) a first instruction within a prompt to perform a first language task involving a first language, (b) one or more resources in the first language, (c) a second instruction within the prompt to perform a second language task involving a second language, and (d) one or more resources in the second language, the one or more resources in the second language having semantically similar content relative to the one or more resources in the first language;
constructing the first data point of the batch of data points based on the prompt, the first language task and the one or more resources in the first language; and
constructing the second data point of the batch of data points based on the prompt, the second language task, and the one or more resources in the second language;
inputting the batch of data points into a learning framework to produce an optimized language model; and
storing the optimized language model at one or more storage devices;
wherein the method is performed on a device comprising at least one hardware processor.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the first language task comprises at least one of: answering a first query in the first language or predicting a first ground truth in the first language;
the second language task comprises at least one of: answering a second query in the second language or predicting a second ground truth in the second language;
the first data point comprises a first answer based on (a) the at least one of the first query in the first language or the first ground truth and (b) the one or more resources in the first language; and
the second data point comprises a second answer based on (a) the at least one of the second query in the second language or the second ground truth and (b) the one or more resources in the second language.

### Claim 3 (depends on 1)

The method of claim 1, wherein:
the first language is a high resource language for the learning framework;
the second language is not a high resource language for the learning framework; and
the prompt includes instructions in the first language requesting that the first language task be performed and requesting that the second language task be performed.

### Claim 4 (depends on 1)

The method of claim 1, wherein:
the first language task comprises at least one of: answering a first query in the first language or predicting a first ground truth in the first language;
the second language task comprises at least one of: answering a second query in the first language or predicting a second ground truth in the first language.

### Claim 5 (depends on 1)

The method of claim 1, wherein:
the prompt further comprises:
a third language task comprising at least one of: answering a third query in a third language or predicting a third ground truth in the third language;
one or more resources in the third language, the one or more resources in the third language being semantically equivalent to the one or more resources in the first language and the one or more resources in the second language;
the method further comprising:
generating a third data point of the batch of data points based on the prompt, the third language task, and the one or more resources in the third language.

### Claim 6 (depends on 1)

The method of claim 1, wherein:
the prompt comprises a first query in the first language and a second query in the second language that is semantically equivalent to the first query.

### Claim 7 (depends on 1)

The method of claim 1, wherein:
the prompt comprises at least one of: (a) a first ground truth for the first language task and the second language task or (b) a first ground truth for the first language task in the first language and a second ground truth for the second language task in the second language, the second ground truth being semantically equivalent to the first ground truth.

### Claim 8 (depends on 1)

The method of claim 1, wherein:
the prompt in the first language comprises a semantic query in the first language, the prompt in the second language comprise a semantic query in the second language, the one or more resources in the first language include a first text in the first language, and the one or more resources in the second language include a second text in the second language, and the first text and the second text are semantically equivalent.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
the one or more resources in the first language include a first conversation in the first language;
the one or more resources in the second language include a second conversation in the second language that is semantically equivalent to the first conversation;
the first data point includes a first indication whether a first answer to a first request in the prompt to predict a first missing phrase for the first conversation matches a ground truth in the first language; and
the second data point includes a second indication whether a second answer to a second request to predict a second missing phrase for the second conversation matches a ground truth in the second language;
the method further comprising:
obtaining, from a language model:
the first answer based on the first request in the prompt to predict the first missing phrase for the first conversation; and
the second answer based on the second request in the prompt to predict the second missing phrase for the second conversation.

### Claim 10 (depends on 1)

The method of claim 1, wherein:
the one or more resources in the first language comprises a first set of document chunks in the first language;
the one or more resources in the second language comprises a second set of document chunks in the second language that are semantically equivalent to the first set of document chunks;
the prompt comprises a request to (a) determine if a first answer to a first query in the first language is included in the first set of document chunks and (b) determine if a second answer to a second query in the second language is included in the second set of document chunks, the first query in the first language being semantically equivalent to the second query in the second language.

### Claim 11 (depends on 1)

The method of claim 1, wherein:
the first data point comprises: (a) a prompt in the first language, (b) a resource in the first language including a valid response to the prompt in the first language, and (c) one or more resources in the first language not including the valid response to the prompt in the first language; and
the second data point comprises: (a) a prompt in the second language, (b) a resource in the second language including a valid response to the prompt in the second language, and (c) one or more resources in the second language not including the valid response to the prompt in the second language.

### Claim 12 (depends on 1)

The method of claim 1, further comprising:
accessing second batch of data points including:
a first negative data point comprising: (a) a query in the first language, and (b) a plurality of resources in the first language not including a valid response to the query in the first language; and
a second negative data point comprising: (a) a query in the second language and (b) a plurality of resources in the second language not including a valid response to the query in the second language; and
inputting the second batch of data points into the learning framework to produce the optimized language model.

### Claim 13 (depends on 1)

The method of claim 1, wherein:
the one or more resources in the first language and the one or more resources in the second language are related to a first topic; the method further comprising:
accessing a first negative data point, the first negative data point comprising: (a) the prompt in the first language, and (b) a plurality of resources in the first language related to the first topic that do not enable a valid response; and
accessing a second negative data point, the second negative data point comprising: (a) the prompt in the second language, and (b) a plurality of resources in the second language related to the first topic that do not enable a valid response to the prompt.

### Claim 14 (depends on 1)

The method of claim 1, wherein:
the one or more resources in the first language and the one or more resources in the second language are related to a first topic or first conversation; the method further comprising:
accessing a first negative data point, the first negative data point comprising: (a) the prompt in the first language, and (b) a plurality of resources in the first language not related to the first topic or first conversation; and
accessing a second negative data point, the second negative data point comprising: (a) the prompt in the second language, and (b) a plurality of resources in the second language not related to the first topic or first conversation.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
generating the batch of data points by:
identifying a topic associated with a plurality of resources;
selecting the one or more resources in the first language based on the one or more resources in the first language being associated with the topic;
selecting the one or more resources in the second language based on the one or more resources in the second language being associated with the topic;
generating a first query associated with the topic and a second query associated with the topic; and
storing a first plurality of data points in a first batch of data points based on generating a first plurality of answers by inputting the first query into a pretrained language model;
storing a second plurality of data points in a second batch of data points based on generating a second plurality of answers by inputting the second query into the pretrained language model; and
performing reinforcement learning to result in the optimized language model by using the first batch of data points and the second batch of data points as alignment training data to optimize the pretrained language model.

### Claim 16 (depends on 1)

The method of claim 1, wherein:
inputting the batch of data points into the learning framework to produce the optimized language model comprises performing reinforcement learning during an initial training phase to result in the optimized language model.

### Claim 17 (depends on 1)

The method of claim 1:
wherein the first language is a high resource language for a pretrained generative language model previously trained with the high resource language; and
wherein inputting the batch of data points into the learning framework to produce the optimized language model comprises performing reinforcement learning, on the pretrained generative language model previously trained with the high resource language, to result in the optimized language model.

### Claim 18 (depends on 16)

The method of claim 16, further comprising:
measuring a first performance score of a pretrained generative language model;
inputting the first data point and the second data point as training data into a plurality of reinforcement learning frameworks;
subsequently measuring a plurality of performance scores of a plurality of reinforced language models respectively corresponding to the plurality of reinforcement learning frameworks being used to optimize one or more versions of the pretrained generative language model; and
selecting a reinforcement learning framework having a higher performance score than the first performance score based on the higher performance score being greater than one or more other scores of the plurality of performance scores.

### Claim 19

One or more non-transitory computer readable media comprising instructions which, when executed by one or more hardware processors, cause performance of operations comprising:
defining a batch of data points comprising a first data point and a second data point by:
accessing (a) a first instruction within a prompt to perform a first language task involving a first language, (b) one or more resources in the first language, (c) a second instruction within the prompt to perform a second language task involving a second language, and (d) one or more resources in the second language, the one or more resources in the second language having semantically similar content relative to the one or more resources in the first language;
constructing the first data point of the batch of data points based on the prompt, the first language task and the one or more resources in the first language; and
constructing the second data point of the batch of data points based on the prompt, the second language task, and the one or more resources in the second language;
inputting the batch of data points into a learning framework to produce an optimized language model; and
storing the optimized language model at one or more storage devices; wherein
the first language task comprises at least one of: answering a first query in the first language or predicting a first ground truth in the first language;
the second language task comprises at least one of: answering a second query in the second language or predicting a second ground truth in the second language;
the first data point comprises a first answer based on (a) the at least one of the first query in the first language or the first ground truth and (b) the one or more resources in the first language;
the second data point comprises a second answer based on (a) the at least one of the second query in the second language or the second ground truth and (b) the one or more resources in the second language.

### Claim 20

A system, comprising:
at least one device including a hardware processor;
the system being configured to perform operations comprising:
defining a batch of data points comprising a first data point and a second data point by:
accessing (a) a first instruction within a prompt to perform a first language task involving a first language, (b) one or more resources in the first language, (c) a second instruction within the prompt to perform a second language task involving a second language, and (d) one or more resources in the second language, the one or more resources in the second language having semantically similar content relative to the one or more resources in the first language;
constructing the first data point of the batch of data points based on the prompt, the first language task and the one or more resources in the first language; and
constructing the second data point of the batch of data points based on the prompt, the second language task, and the one or more resources in the second language;
inputting the batch of data points into a learning framework to produce an optimized language model; and
storing the optimized language model at one or more storage devices.
