# US 2022/0284433 A1 · Unidimensional embedding using multi-modal deep learning models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284433 A1
- Document ID: US20220284433A1
- Status: Published application
- Kind: A1
- Application number: 17/192,405
- Filed: 2021-03-04
- Published: 2022-09-08
- Earliest claimed: 2021-03-04
- Assignees: Capital One Services, LLC
- Applicants: Capital One Services, LLC
- Inventors: Minh LE; Zachary KULIS; Tarek LAHLOU
- Web page: https://patentgrep.com/patent/US20220284433A1

## CPC

- G06Q 20/4016: {involving fraud or risk level assessment in transaction processing}
- G06Q 40/12: Accounting
- G06F 17/18: for evaluating statistical data {, e.g. average values, frequency distributions, probability functions, regression analysis (forecasting specially adapted for a specific administrative, business or logistic context G06Q10/04)}
- G06N 3/045: Combinations of networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0499: Feedforward networks
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06Q 20/389: {Keeping log of transactions for guaranteeing non-repudiation of a transaction}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Unidimensional embedding using multi-modal deep learning models. An autoencoder executing on a processor may receive transaction data for a plurality of transactions, the transaction data including a plurality of fields, the plurality of fields including a plurality of different data types. An embeddings layer of the autoencoder may generate an embedding vector for a first transaction, the embedding vector includes floating point values to represent the plurality of data types of the transaction data. One or more fully connected layers of the autoencoder may generate, based on the embedding vector, a plurality of statistical distributions for the first transaction, each statistical distribution includes a respective embedding vector. A sampling layer of the autoencoder may sample a first statistical distribution of the plurality of statistical distributions. A decoder of the autoencoder may decode the first statistical distribution to generate an output representing the first transaction.

## Claims

### Claim 1

A computer-implemented method, comprising:
receiving, by an autoencoder executing on a processor, transaction data for a plurality of transactions, the transaction data comprising a plurality of fields, the plurality of fields comprising a plurality of data types, the plurality of data types comprising different data types;
generating, by an embeddings layer of the autoencoder, an embedding vector for a first transaction of the plurality of transactions, the embedding vector comprising floating point values to represent the plurality of data types;
generating, by one or more fully connected layers of the autoencoder based on the embedding vector, a plurality of statistical distributions for the first transaction, each statistical distribution comprising a respective embedding vector;
sampling, by a sampling layer of the autoencoder, a first statistical distribution of the plurality of statistical distributions;
decoding, by a decoder of the autoencoder, the first statistical distribution to generate an output representing the first transaction; and
storing the output in a storage medium.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising:
masking, by the processor, a value for a first element of the first statistical distribution; and
generating, by the fully connected layers of the autoencoder based on the first statistical distribution including the masked value for the first element, an output vector for another transaction, the output vector including a value for the first element, the another transaction not included in the plurality of transactions of the transaction data.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, further comprising:
masking, by the processor, a value for a first element of the first statistical distribution; and
generating, by the fully connected layers of the autoencoder based on the first statistical distribution including the masked value for the first element, an output comprising a value for the first element.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein a first field of the plurality of fields is dependent on a second field of the plurality of fields, wherein the embedding vector and the plurality of statistical distributions reflect the dependency of the first field on the second field.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, further comprising:
masking, by the processor, a value for a first element of the first statistical distribution and a value for a second element of the first statistical distribution, wherein the first element and the second element of the first statistical distribution correspond to the first field and the second field, respectively; and
generating, by the fully connected layers of the autoencoder based on the first statistical distribution including the masked values for the first and second elements, an output comprising a respective value for the first element and second elements.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising:
generating, by the fully connected layers of the autoencoder based on the first statistical distribution, an output vector for another transaction, the another transaction subsequent to the plurality of transactions of the transaction data.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein first statistical distribution is associated with a first account of a plurality of accounts, the method further comprising:
generating, by the fully connected layers of the autoencoder based on the first statistical distribution, an output vector for another transaction associated with a second account of the plurality of accounts.

### Claim 8

A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a processor, cause the processor to:
receive, by an autoencoder, transaction data for a plurality of transactions, the transaction data comprising a plurality of fields, the plurality of fields comprising a plurality of data types, the plurality of data types comprising different data types;
generate, by an embeddings layer of the autoencoder, an embedding vector for a first transaction of the plurality of transactions, the embedding vector comprising floating point values to represent the plurality of data types;
generate, by one or more fully connected layers of the autoencoder based on the embedding vector, a plurality of statistical distributions for the first transaction, each statistical distribution comprising a respective embedding vector;
sample, by a sampling layer of the autoencoder, a first statistical distribution of the plurality of statistical distributions;
decode, by a decoder of the autoencoder, the first statistical distribution to generate an output representing the first transaction; and
store the output in a storage medium.

### Claim 9 (depends on 8)

The computer-readable storage medium of claim 8, wherein the instructions further configure the processor to:
mask a value for a first element of the first statistical distribution; and
generate, by the fully connected layers of the autoencoder based on the first statistical distribution including the masked value for the first element, an output vector for another transaction, the output vector including a value for the first element, the another transaction not included in the plurality of transactions of the transaction data.

### Claim 10 (depends on 8)

The computer-readable storage medium of claim 8, wherein the instructions further configure the processor to:
mask a first element of the first statistical distribution; and
generate, by the fully connected layers of the autoencoder based on the first statistical distribution including the masked value for the first element, an output comprising a value for the first element.

### Claim 11 (depends on 8)

The computer-readable storage medium of claim 8, wherein a first field of the plurality of fields is dependent on a second field of the plurality of fields, wherein the embedding vector and the plurality of statistical distributions reflect the dependency of the first field on the second field.

### Claim 12 (depends on 11)

The computer-readable storage medium of claim 11, wherein the instructions further configure the processor to:
mask a value for a first element of the first statistical distribution and a value for a second element of the first statistical distribution, wherein the first element and the second element of the first statistical distribution correspond to the first field and the second field, respectively; and
generate, by the fully connected layers of the autoencoder based on the first statistical distribution including the masked values of the first and second elements, an output comprising a respective value for the first element and second elements.

### Claim 13 (depends on 8)

The computer-readable storage medium of claim 8, wherein the instructions further configure the processor to:
generate, by the fully connected layers of the autoencoder based on the first statistical distribution, an output vector for another transaction, the another transaction subsequent to the plurality of transactions of the transaction data.

### Claim 14 (depends on 8)

The computer-readable storage medium of claim 8, wherein the first statistical distribution is associated with a first account of a plurality of accounts, wherein the instructions further configure the processor to:
generate, by the fully connected layers of the autoencoder based on the first statistical distribution, an output vector for another transaction associated with a second account of the plurality of accounts.

### Claim 15

A computing apparatus comprising:
a processor; and
a memory storing instructions that, when executed by the processor, configure the processor to:
receive, by an autoencoder executing on the processor, transaction data for a plurality of transactions, the transaction data comprising a plurality of fields, the plurality of fields comprising a plurality of data types, the plurality of data types comprising different data types;
generate, by an embeddings layer of the autoencoder, an embedding vector for a first transaction of the plurality of transactions, the embedding vector comprising floating point values to represent the plurality of data types;
generate, by one or more fully connected layers of the autoencoder based on the embedding vector, a plurality of statistical distributions for the first transaction, each statistical distribution comprising a respective embedding vector;
sample, by a sampling layer of the autoencoder, a first statistical distribution of the plurality of statistical distributions;
decode, by a decoder of the autoencoder, the first statistical distribution to generate an output representing the first transaction; and
store the output in a storage medium.

### Claim 16 (depends on 15)

The computing apparatus of claim 15, wherein the instructions further configure the apparatus to:
mask a value for a first element of the first statistical distribution; and
generate, by the fully connected layers of the autoencoder based on the first statistical distribution including the masked value for the first element, an output vector for another transaction, the output vector including a value for the first element, the another transaction not included in the plurality of transactions of the transaction data.

### Claim 17 (depends on 15)

The computing apparatus of claim 15, wherein the instructions further configure the processor to:
mask a value for a first element of the first statistical distribution; and
generate, by the fully connected layers of the autoencoder based on the first statistical distribution including the masked value for the first element, an output comprising a value for the first element.

### Claim 18 (depends on 15)

The computing apparatus of claim 15, wherein a first field of the plurality of fields is dependent on a second field of the plurality of fields, wherein the embedding vector and the plurality of statistical distributions reflect the dependency of the first field on the second field, wherein the instructions further configure the processor to:
mask a value for a first element of the first statistical distribution and a value for second element of the first statistical distribution, wherein the first element and the second element of the first statistical distribution correspond to the first field and the second field, respectively; and
generate, by the fully connected layers of the autoencoder based on the first statistical distribution including the masked values for the first and second elements, an output comprising a respective value for the first element and second elements.

### Claim 19 (depends on 15)

The computing apparatus of claim 15, wherein the instructions further configure the apparatus to:
generate, by the fully connected layers of the autoencoder based on the first statistical distribution, an output vector for another transaction, the another transaction subsequent to the plurality of transactions of the transaction data.

### Claim 20 (depends on 15)

The computing apparatus of claim 15, wherein the first statistical distribution is associated with a first account of a plurality of accounts, wherein the instructions further configure the apparatus to:
generate, by the fully connected layers of the autoencoder based on the first statistical distribution, an output vector for another transaction associated with a second account of the plurality of accounts.
