# US 2022/0027986 A1 · Systems and methods for augmenting data by performing reject inference

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0027986 A1
- Document ID: US20220027986A1
- Status: Published application
- Kind: A1
- Application number: 17/385,452
- Filed: 2021-07-26
- Published: 2022-01-27
- Earliest claimed: 2020-07-24
- Assignees: ZestFinance, Inc.
- Applicants: ZestFinance, Inc.
- Inventors: Peyman Hesami; Sean Kamkar; Jerome Budzik
- Web page: https://patentgrep.com/patent/US20220027986A1

## CPC

- G06N 3/08: Learning methods
- G06Q 40/03: Credit; Loans; Processing thereof
- G06N 3/045: Combinations of networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06N 3/09: Supervised learning
- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- G06N 20/20: Ensemble learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Systems and methods for augmenting data by performing reject inference are disclosed. In one embodiment, the disclosed process trains an auto-encoder based on a subset of known labeled rows (e.g., non-default loan applicants). The process then infers labels for unlabeled rows using the auto-encoder (e.g., label some rows as non-default and some as default). The process then trains a machine learning model based on the known labeled rows and the inferred labeled rows. Applicant data is then processed by this new machine learning model to determine if a loan applicant is likely to default. If the loan applicant is not likely to default, the loan applicant is funded. For example, the loan applicant may be mailed a physical working credit card. However, if the loan applicant is likely to default, the loan applicant is rejected. For example, the loan applicant may be mailed a physical adverse action letter.

## Claims

### Claim 1

A method of funding a loan, the method comprising:
training a first auto-encoder based on a first subset of a plurality of labeled rows, wherein the first subset primarily includes rows indicative of non-default loan applicants;
inferring a first label for a first unlabeled row using the first auto-encoder;
training a first machine learning model based on the plurality of labeled rows, the first unlabeled row, and the first inferred label; and
funding a first loan based on the first machine learning model.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
training a second auto-encoder based on a second subset of the plurality of labeled rows, wherein the second subset primarily includes rows indicative of default loan applicants;
inferring a second label for a second unlabeled row using the first auto-encoder and the second auto-encoder;
training a second machine learning model based on the plurality of labeled rows, the second unlabeled row, and the second inferred label; and
funding a second loan based on the second machine learning model.

### Claim 3 (depends on 1)

The method of claim 1, wherein training the first auto-encoder includes training a neural network to recreate inputs through a compression layer.

### Claim 4 (depends on 3)

The method of claim 3, further comprising employing a grid search of hyper parameters associated with the first auto-encoder to minimize reconstruction error.

### Claim 5 (depends on 3)

The method of claim 3, further comprising employing a Bayesian search of hyper parameters associated with the first auto-encoder to minimize reconstruction error.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
evaluating the first machine learning model using a fairness evaluation system;
determining if the first machine learning model meets a fairness criteria; and
adjusting the first machine learning model to meet the fairness criteria.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
training a second machine learning model based on a plurality of labeled rows indicative of the plurality of funded loan applicants;
evaluating a first performance of the first machine learning model;
evaluating a second performance of the second machine learning model; and
comparing the first performance and the second performance to document an improved machine learning model.

### Claim 8

A method of funding a loan, the method comprising:
training a first auto-encoder based on a first subset of a plurality of labeled rows, wherein the first subset primarily includes rows indicative of non-delinquent loan applicants;
inferring a first label for a first unlabeled row using the first auto-encoder;
training a first machine learning model based on the plurality of labeled rows, the first unlabeled row, and the first inferred label; and
funding a first loan based on the first machine learning model.

### Claim 9

An apparatus for funding a loan, the apparatus comprising:
a processor;
an inout device operatively coupled to the processor;
an output device operatively coupled to the processor; and
a memory device operatively coupled to the processor, the memory device storing data and instructions to:
train a first auto-encoder based on a first subset of a plurality of labeled rows, wherein the first subset primarily includes rows indicative of non-default loan applicants;
infer a first label for a first unlabeled row using the first auto-encoder;
train a first machine learning model based on the plurality of labeled rows, the first unlabeled row, and the first inferred label; and
fund a first loan based on the first machine learning model.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the instructions are further structured to:
train a second auto-encoder based on a second subset of the plurality of labeled rows, wherein the second subset primarily includes rows indicative of default loan applicants;
infer a second label for a second unlabeled row using the first auto-encoder and the second auto-encoder;
train a second machine learning model based on the plurality of labeled rows, the second unlabeled row, and the second inferred label; and
fund a second loan based on the second machine learning model.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein training the first auto-encoder includes training a neural network to recreate inputs through a compression layer.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the instructions are further structured to employ a grid search of hyper parameters associated with the first auto-encoder to minimize reconstruction error.

### Claim 13 (depends on 11)

The apparatus of claim 11, wherein the instructions are further structured to employ a Bayesian search of hyper parameters associated with the first auto-encoder to minimize reconstruction error.

### Claim 14 (depends on 9)

The apparatus of claim 9, wherein the instructions are further structured to:
evaluate the first machine learning model using a fairness evaluation system;
determine if the first machine learning model meets a fairness criteria; and
adjust the first machine learning model to meet the fairness criteria.

### Claim 15 (depends on 9)

The apparatus of claim 9, wherein the instructions are further structured to:
train a second machine learning model based on a plurality of labeled rows indicative of the plurality of funded loan applicants;
evaluate a first performance of the first machine learning model;
evaluate a second performance of the second machine learning model; and
compare the first performance and the second performance to document an improved machine learning model.
