# US 2026/0094065 A1 · Self-supervised learning for tabular data models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0094065 A1
- Document ID: US20260094065A1
- Status: Published application
- Kind: A1
- Application number: 19/340,109
- Filed: 2025-09-25
- Published: 2026-04-02
- Earliest claimed: 2024-09-30
- Assignees: The Toronto-Dominion Bank
- Applicants: The Toronto-Dominion Bank
- Inventors: Valentin Patrick Marie Thomas; Junwei Ma; Rasa Hosseinzadeh; Hamidreza Kamkari; Alexander Jacob Labach; Keyvan Golestan Irani; Maksims Volkovs; Guangwei Yu; Jesse Cole Cresswell; Anthony Lawrence Caterini
- Web page: https://patentgrep.com/patent/US20260094065A1

## CPC

- G06N 20/00: Machine learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A foundational tabular data model is trained on a plurality of different data sets that may include non-simulated, real-world data. The tabular data model processes an input including a set of context data samples with corresponding labels and a query to be processed with the contexts and label as an example. The tabular data model may be applied to new data sets outside the training data using only the context of the new data set. To do so, the tabular data model is trained with training batches that include data samples from the plurality of data sets with different data fields (columns) selected as the target for tabular prediction of differing tasks and inputting data samples with inputs excluding the selected target, enabling the tabular data model to learn complex and varied relationships from real data without predefined labels or task objectives.

## Claims

### Claim 1

A system for self-supervised learning for tabular data, comprising:
one or more processors configured to execute instructions; and
one or more computer-readable media containing instructions executable by the one or more processor for:
identifying a plurality of training data sets, each training data set containing a plurality of data fields and data samples having values in the plurality of data fields;
for each training data set of the plurality of data sets:
selecting a target data field from the plurality of data fields;
determining a training data input including a subset of data samples from the plurality of data samples and comprising one or more context data samples and one or more query data samples, each of the subset of data samples described as input features determined without the target data field and having a label based on the target data field; and
training a tabular data model with the training batch to learn the label for the one or more queries of each of the plurality of training data inputs.

### Claim 2 (depends on 1)

The system of claim 1, wherein determining the training data input comprises normalizing the input features for each data sample to a standardized feature quantity.

### Claim 3 (depends on 1)

The system of claim 1, wherein determining the training data input comprises shuffling the data field ordering or removing one or more data fields.

### Claim 4 (depends on 1)

The system of claim 1, wherein the target data field is not pre-determined or labeled in the plurality of training data sets.

### Claim 5 (depends on 1)

The system of claim 1, wherein the plurality of training data sets are non-simulated data sets.

### Claim 6 (depends on 1)

The system of claim 1, wherein the target data field is selected with a stochastic process.

### Claim 7 (depends on 1)

The system of claim 1, wherein determining the training data input comprises selecting the subset of data samples from a neighborhood in the training data set.

### Claim 8 (depends on 7)

The system of claim 7, wherein the instructions are further executable by the processor for selecting the neighborhood based on a distance metric that excludes the target data field.

### Claim 9 (depends on 1)

The system of claim 1, wherein the tabular data model configured to output values for a plurality of tasks includes a regression task and a classification task; and
the instructions are further executable for:
selecting a training task and generating training data input comprises converting values for the target data field to values compatible with the selected task.

### Claim 10 (depends on 9)

The system of claim 9, wherein the task is selected before selecting the target data field; and wherein selecting the target data field is based on the selected task.

### Claim 11 (depends on 1)

The system of claim 1, wherein the instructions are further executable by the processor for applying the tabular data model to an inference data input corresponding to a data set not included in the plurality of training data sets.

### Claim 12

A method for self-supervised learning, comprising:
identifying a plurality of training data sets, each training data set containing a plurality of data fields and data samples having values in the plurality of data fields;
for each training data set of the plurality of data sets:
selecting a target data field from the plurality of data fields;
determining a training data input including a subset of data samples from the plurality of data samples and comprising one or more context data samples and one or more query data samples, each of the subset of data samples described as input features determined without the target data field and having a label based on the target data field; and
training a tabular data model with the training batch to learn the label for the one or more queries of each of the plurality of training data inputs.

### Claim 13 (depends on 12)

The method of claim 12, wherein determining the training data input comprises normalizing the input features for each data sample to a standardized feature quantity.

### Claim 14 (depends on 12)

The method of claim 12, wherein determining the training data input comprises shuffling the data field ordering or removing one or more data fields.

### Claim 15 (depends on 12)

The method of claim 12, wherein the target data field is not pre-determined or labeled in the plurality of training data sets.

### Claim 16 (depends on 12)

The method of claim 12, wherein the plurality of training data sets are non-simulated data sets.

### Claim 17 (depends on 12)

The method of claim 12, wherein the target data field is selected with a stochastic process.

### Claim 18 (depends on 12)

The method of claim 12, wherein determining the training data input comprises selecting the subset of data samples from a neighborhood in the training data set.

### Claim 19 (depends on 18)

The method of claim 18, further comprising selecting the neighborhood based on a distance metric that excludes the target data field.

### Claim 20

A non-transitory computer-readable medium for self-supervised learning for tabular data, the non-transitory computer-readable medium comprising instructions executable by a processor for:
identifying a plurality of training data sets, each training data set containing a plurality of data fields and data samples having values in the plurality of data fields;
for each training data set of the plurality of data sets:
selecting a target data field from the plurality of data fields;
determining a training data input including a subset of data samples from the plurality of data samples and comprising one or more context data samples and one or more query data samples, each of the subset of data samples described as input features determined without the target data field and having a label based on the target data field; and
training a tabular data model with the training batch to learn the label for the one or more queries of each of the plurality of training data inputs.
