# US 2026/0031234 A1 · Systems and Methods for Predicting Outcomes Using Large Language Models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0031234 A1
- Document ID: US20260031234A1
- Status: Published application
- Kind: A1
- Application number: 19/282,259
- Filed: 2025-07-28
- Published: 2026-01-29
- Earliest claimed: 2024-07-26
- Applicants: Elevance Health, Inc.
- Inventors: Shaheen GAUHER; Teja Simha KANCHINADAM
- Web page: https://patentgrep.com/patent/US20260031234A1

## CPC

- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/30: for calculating health indices; for individual health risk assessment
- G06F 40/284: Lexical analysis, e.g. tokenisation or collocates
- G06N 20/00: Machine learning
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Systems, methods and user interfaces are provided for training a causal language model for predicting outcomes using large language models. The method may include obtaining a training dataset that includes structured data including codes. The method may also include preprocessing the structured data to convert raw events data into a structured token sequence. The method may also include training a causal language model using the structured token sequence to predict an outcome. The method may also include generating a synthetic dataset based on fine-tuning the trained causal language model on an evaluation dataset. The method may also include evaluating the trained causal language model.

## Claims

### Claim 1

A method of training a causal language model for predicting outcomes, the method comprising:
obtaining a training dataset that includes structured data including codes;
preprocessing the structured data to convert raw event requests into a structured token sequence, including:
performing a sorting algorithm to organize codes within each event request in the structured data into a clinically logical sequence, including chronologically ordering event requests for a respective individual to form a temporally sequenced dataset thereby enabling a machine learning model to learn chronological order of events;
inserting one or more delimiter tokens into the structured data for concatenating intra-event request codes, inter-event request codes for the respective individual, and data for different individuals, thereby enabling batch data processing; and
tokenizing the structured data using a tokenizer to obtain a sequence of tokens, wherein the tokenizer preserves the one or more delimiter tokens to maintain context of event request data, wherein the tokenizer is trained on event request data with a predetermined vocabulary size; and
training a causal language model using the structured token sequence to predict an outcome, wherein training the causal language model comprises predicting a next code in the structured token sequence based on prior codes, thereby generating a sequence of codes for each event request in a causally coherent manner, wherein predicting the next code is modeled as a probability distribution over possible codes.

### Claim 2

A method of training a causal language model for predicting clinical outcomes, the method comprising:
obtaining a training dataset that includes structured data including codes;
preprocessing the structured data to convert raw event requests into a structured token sequence; and
training a causal language model using the structured token sequence to predict an outcome.

### Claim 3 (depends on 2)

The method of claim 2, wherein the structured data includes a respective dataset for a plurality of individuals, each dataset including a plurality of event requests, wherein each individual has a corresponding set of event requests, each event request comprising a set of codes, wherein each code is either a diagnosis code or a procedural code.

### Claim 4 (depends on 2)

The method of claim 2, wherein each event request in the structured data corresponds to an individual-provider encounter, aggregates medical codes in a non-sequential order.

### Claim 5 (depends on 2)

The method of claim 2, wherein preprocessing the structured data comprises:
performing a sorting algorithm to organize codes within each event request in the structured data into a clinically logical sequence, including chronologically ordering event requests for a respective individual to form a temporally sequenced dataset thereby enabling a machine learning model to learn chronological order of events.

### Claim 6 (depends on 5)

The method of claim 5, wherein the sorting algorithm σ organizes the codes within each event request cij into a clinically logical sequence,
c
i
⁢
j
l
=
σ
⁡
(
e
ijl
,
e
ij
⁢
2
,
…
,
e
ijk
)
,
wherein event requests
C
i
l
=
c
i
⁢
1
l
,
c
i
⁢
2
l
,
…
,
c
i
⁢
C
l
is chronologically ordered as
′
=
⋃
p
=
1
P
{
sort
(
C
p
,
date
)
}
forming a temporally sequenced dataset, enabling the causal language model to learn the chronological order of events.

### Claim 7 (depends on 2)

The method of claim 2, wherein preprocessing the structured data comprises:
intra-event request codes, inter-event request codes for the respective individual, and data for different individuals, thereby enabling batch data processing.

### Claim 8 (depends on 2)

The method of claim 2, wherein preprocessing the structured data comprises:
tokenizing the structured data using a tokenizer to obtain a sequence of tokens, wherein the tokenizer preserves one or more delimiter tokens to maintain context of data, wherein the tokenizer is trained on event requests data with a predetermined vocabulary size.

### Claim 9 (depends on 8)

The method of claim 8, wherein the tokenizer uses Byte-Level Byte-Pair Encoding for creating a fixed-size vocabulary balancing medical language specificity with capacity of the causal language model.

### Claim 10 (depends on 8)

The method of claim 8, wherein the causal language model is trained on the sequence of tokens to predict a subsequent token in the sequence, with a loss function measuring the accuracy of predictions
Loss
(
Θ
)
=
-
∑
t
=
1
L
⁢
log
⁢
P
⁡
(
t
|
t
-
1
,
t
-
2
,
…
,
1
;
Θ
)
,
wherein
P
⁡
(
t
|
t
-
1
,
t
-
2
,
…
,
1
;
Θ
)
represents the causal language model's assigned probability to a true next token t, given all previous tokens in the sequence.

### Claim 11 (depends on 2)

The method of claim 2, wherein the training dataset includes event requests data that covers a plurality of individual demographics and conditions from a plurality of care settings.

### Claim 12 (depends on 2)

The method of claim 2, wherein the training dataset comprises billions of event requests corresponding to millions of individuals, tens of thousands of diagnosis codes, and tens of thousands of unique procedure codes, and wherein the training dataset excludes invalid codes resulting from intake or ingestion errors.

### Claim 13 (depends on 2)

The method of claim 2, wherein training the causal language model using the structured token sequence comprises predicting a next code in the structured token sequence based on prior codes, thereby generating a sequence of codes for each claim in a causally coherent manner.

### Claim 14 (depends on 13)

The method of claim 13, wherein predicting the next code is modeled as a probability distribution over possible codes.

### Claim 15 (depends on 14)

The method of claim 14, wherein the probability distribution over the possible codes is formulated as P (eijk euj; 0)=M (eu), wherein 0 denotes the parameters of the causal language model, wherein sequence of codes eij=(eijt, eij2, eij (k-1)) for the jth event request of the ith individual, wherein the language model predicts the next code eijk thereby generating the sequence of codes for each event request in a causally coherent manner, reflective of the actual progression of events documented in the event requests data.

### Claim 16 (depends on 2)

The method of claim 2, further comprising:
using zero-shot prompting for forecasting outcomes.

### Claim 17 (depends on 16)

The method of claim 16, wherein using zero-shot prompting comprises inputting, to the causal language model, an individual's event request history for an observation period and analyzing output generated by the causal language model for event occurrence.

### Claim 18 (depends on 2)

The method of claim 2, further comprising:
generating a synthetic dataset based on fine-tuning the trained causal language model on an evaluation dataset.

### Claim 19 (depends on 18)

The method of claim 18, wherein fine-tuning the trained causal language model comprises introducing special tokens |pos| and |neg| to enable the fine-tuned model to generate synthetic event requests corresponding to positive and negative samples, respectively
M
ft
=
FineTune
⁡
(
M
,
eval
,
❘
"\[LeftBracketingBar]"
pos
❘
"\[RightBracketingBar]"
,
❘
"\[LeftBracketingBar]"
neg
❘
"\[RightBracketingBar]"
)
wherein M denotes the trained causal language model, eval denotes the evaluation dataset, Mft denotes the model after fine-tuning, and |pos| or |neg| are used prompts for generating the synthetic dataset.

### Claim 20

A computer system for predicting outcomes using large language models, comprising:
one or more processors;
a display; and
memory;
wherein the memory stores one or more programs configured for execution by the one or more processors, and the one or more programs comprising instructions for:
obtaining a training dataset that includes structured data including codes;
preprocessing the structured data to convert raw event requests into a structured token sequence, including:
performing a sorting algorithm to organize codes within each event request in the structured data into a clinically logical sequence, including chronologically ordering event requests for a respective individual to form a temporally sequenced dataset thereby enabling a machine learning model to learn chronological order of events;
inserting one or more delimiter tokens into the structured data for concatenating intra-event request codes, inter-event request codes for the respective individual, and data for different individuals, thereby enabling batch data processing; and
tokenizing the structured data using a tokenizer to obtain a sequence of tokens, wherein the tokenizer preserves the one or more delimiter tokens to maintain context of event request data, wherein the tokenizer is trained on event request data with a predetermined vocabulary size; and
training a causal language model using the structured token sequence to predict an outcome, wherein training the causal language model comprises predicting a next code in the structured token sequence based on prior codes, thereby generating a sequence of codes for each event request in a causally coherent manner, wherein predicting the next code is modeled as a probability distribution over possible codes.
