# US 2026/0065129 A1 · Adaptive fairness repair pipeline for mitigating machine learning bias

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065129 A1
- Document ID: US20260065129A1
- Status: Published application
- Kind: A1
- Application number: 18/820,759
- Filed: 2024-08-30
- Published: 2026-03-05
- Earliest claimed: 2024-08-30
- Assignees: Optum Services (Ireland) Limited
- Applicants: Optum Services (Ireland) Limited
- Inventors: Daniel KELLY; Karim Mahmoud Mohamed MOUSTAFA; Harutyun SHAHUMYAN; Arjit AGRAWAL
- Web page: https://patentgrep.com/patent/US20260065129A1

## CPC

- G06N 20/00: Machine learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Various embodiments of the present disclosure provide improved bias mitigation techniques for machine learning technology. The bias mitigation techniques include receiving a machine learning biasing attribute and a set of outputs generated by a target machine learned model and determining a divergence score based at least in part on a difference between a first distribution and a second distribution of the set of outputs. In response to the divergence score meeting or exceeding a threshold, the bias mitigation techniques include generating, using a fairness learning model, a transformation to one or more set of outputs to decrease the divergence score and storing the transformation and an identifier. Through a plurality of iterations, a learned transformation sequence may be generated that may be applied to transform outputs of a machine learning model to mitigate machine learning bias.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving, by one or more processors, a machine learning biasing attribute and a set of outputs generated by a target machine learned model comprising a first subset of outputs generated using a first subset of input data associated with a first attribute value and a second subset of outputs generated using a second subset of input data associated with a second attribute value, wherein the first attribute value and the second attribute value are values of the machine learning biasing attribute;
determining, by the one or more processors, a divergence score based at least in part on a difference between a first distribution of the first subset of outputs and a second distribution of the second subset of outputs;
determining, by the one or more processors, that the divergence score meets or exceeds a divergence score threshold;
responsive to determining that the divergence score meets or exceeds the divergence score threshold, generating, by the one or more processors and using a fairness learning model, a transformation to one or more of the second subset of outputs or the second distribution of the second subset of outputs to decrease the divergence score;
storing, by the one or more processors, the transformation and an identifier of the first attribute value and the second attribute value; and
generating, by the one or more processors, at least one of a transformed second subset of outputs or a transformed second distribution by altering at least one of the one or more of the second subset of outputs or the second distribution of the second subset of outputs using the transformation.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising:
receiving a second set of input data for input to the target machine learned model;
generating, using the target machine learned model and using the second set of input data, a model output;
retrieving the transformation based at least in part on determining the second set of input data is associated with at least one of the first attribute value or the second attribute value; and
altering the model output by the transformation as a transformed model output.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, further comprising:
iteratively repeating a first stage comprising determining another divergence score and determining that the other divergence score meets or exceeds the divergence score threshold and a second stage comprising determining another transformation until a stopping condition is reached;
storing multiple transformations as a sequence of transformations; and
altering a subsequent output of the target machine learned model using the sequence of transformations.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the transformation is further based at least in part on a transformation weight that scales a magnitude of the transformation.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the divergence score threshold is based on at least one of:
a number of iterations preceding a particular iteration;
a change in a plurality of divergence scores of a previous n iterations of the altering, where n is a positive integer; or
a change in an accuracy of one or more prediction outputs associated with the first attribute value, the second attribute value, or a value associated with a second attribute.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining that the first attribute value is a majority attribute value based at least in part on determining that the first attribute value is associated with more data objects in an evaluation dataset than data objects associated with one of the second attribute value or any other attribute value associated with the machine learning biasing attribute,
wherein the transformation is generated such that the transformation results in at least one of shifting, scaling, or transforming the second distribution to increase a similarity of the second distribution to the first distribution, responsive to determining that the first attribute value is the majority attribute value.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, wherein the divergence score is determined based at least in part on a quantile divergence between the first distribution and the second distribution, wherein the second attribute value is a minority attribute value.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein:
an evaluation dataset comprises (i) an unlabeled training dataset for the target machine learned model and (ii) the set of outputs generated by the target machine learned model using the unlabeled training dataset; and
the unlabeled training dataset comprises a set of input data comprising the first subset of input data and a second set of input data associated with at least one of the first attribute value or the second attribute value.

### Claim 9

A system comprising memory and one or more processors communicatively coupled to the memory, the one or more processors configured to:
receive a machine learning biasing attribute and a set of outputs generated by a target machine learned model comprising a first subset of outputs generated using a first subset of input data associated with a first attribute value and a second subset of outputs generated using a second subset of input data associated with a second attribute value;
determine a divergence score based at least in part on a first distribution of the first subset of outputs and a second distribution of the second subset of outputs;
determine that the divergence score meets or exceeds a divergence score threshold;
responsive to determining that the divergence score meets or exceeds the divergence score threshold, generate, using a fairness learning model, a transformation to one or more of the second subset of outputs or the second distribution of the second subset of outputs to decrease the divergence score;
store the transformation and an identifier of the first attribute value and the second attribute value; and
generate at least one of a transformed second subset of outputs or a transformed second distribution by altering at least one of the one or more of the second subset of outputs or the second distribution of the second subset of outputs using the transformation.

### Claim 10 (depends on 9)

The system of claim 9, wherein the one or more processors are further configured to:
receive a second set of input data for input to the target machine learned model;
generate, using the target machine learned model and using the second set of input data, a model output;
retrieve the transformation based at least in part on determining the second set of input data is associated with at least one of the first attribute value or the second attribute value; and
alter the model output by the transformation as a transformed model output.

### Claim 11 (depends on 9)

The system of claim 9, wherein the one or more processors are further configured to:
iteratively repeating a first stage comprising determining another divergence score and determining that the other divergence score meets or exceeds the divergence score threshold and a second stage comprising determining another transformation until a stopping condition is reached;
storing multiple transformations as a sequence of transformations; and
altering a subsequent output of the target machine learned model using the sequence of transformations.

### Claim 12 (depends on 9)

The system of claim 9, wherein the transformation is further based at least in part on a transformation weight that scales a magnitude of the transformation.

### Claim 13 (depends on 9)

The system of claim 9, wherein the divergence score threshold is based on at least one of:
a number of iterations preceding a particular iteration;
a change in a plurality of divergence scores of a previous n iterations of the altering, where n is a positive integer; or
a change in an accuracy of one or more prediction outputs associated with the first attribute value, the second attribute value, or a value associated with a second attribute.

### Claim 14 (depends on 9)

The system of claim 9, wherein the one or more processors are further configured to:
determine that the first attribute value is a majority attribute value based at least in part on determining that the first attribute value is associated with more data objects in an evaluation dataset than data objects associated with one of the second attribute value or any other attribute value associated with the machine learning biasing attribute,
wherein the transformation is generated such that the transformation results in at least one of shifting, scaling, or transforming the second distribution to increase a similarity of the second distribution to the first distribution, responsive to determining that the first attribute value is the majority attribute value.

### Claim 15 (depends on 14)

The system of claim 14, wherein the divergence score is determined based at least in part on a quantile divergence between the first distribution associated with the majority attribute value and a second distribution associated with a minority attribute value, wherein the second attribute value is the minority attribute value.

### Claim 16 (depends on 9)

The system of claim 9, wherein:
an evaluation dataset comprises (i) an unlabeled training dataset for the target machine learned model and (ii) the set of outputs generated by the target machine learned model using the unlabeled training dataset; and
the unlabeled training dataset comprises a set of input data comprising the first subset of input data and a second set of input data associated with at least one of the first attribute value or the second attribute value.

### Claim 17

One or more non-transitory computer-readable storage media including instructions that, when executed by one or more processors, cause the one or more processors to:
receive a machine learning biasing attribute and a set of outputs generated by a target machine learned model comprising a first subset of outputs generated using a first subset of input data associated with a first attribute value and a second subset of outputs generated using a second subset of input data associated with a second attribute value;
determine a divergence score based at least in part on a first distribution of the first subset of outputs and a second distribution of the second subset of outputs;
determine that the divergence score meets or exceeds a divergence score threshold;
responsive to determining that the divergence score meets or exceeds the divergence score threshold, generate, using a fairness learning model, a transformation to one or more of the second subset of outputs or the second distribution of the second subset of outputs to decrease the divergence score;
store the transformation and an identifier of the first attribute value and the second attribute value; and
generate at least one of a transformed second subset of outputs or a transformed second distribution by altering at least one of the one or more of the second subset of outputs or the second distribution of the second subset of outputs using the transformation.

### Claim 18 (depends on 17)

The one or more non-transitory computer-readable storage media of claim 17, wherein the one or more processors are further caused to:
receive a second set of input data for input to the target machine learned model;
generate, using the target machine learned model and using the second set of input data, a model output;
retrieve the transformation based at least in part on determining the second set of input data is associated with at least one of the first attribute value or the second attribute value; and
alter the model output by the transformation as a transformed model output.

### Claim 19 (depends on 17)

The one or more non-transitory computer-readable storage media of claim 17, wherein the divergence score is determined based at least in part on a quantile divergence between the first distribution associated with a majority attribute value and a second distribution associated with a minority attribute value.

### Claim 20 (depends on 17)

The one or more non-transitory computer-readable storage media of claim 17, wherein the one or more processors are further caused to:
determine that the first attribute value is a majority attribute value based at least in part on determining that the first attribute value is associated with more data objects in an evaluation dataset than data objects associated with one of the second attribute value or any other attribute value associated with the machine learning biasing attribute,
wherein the transformation is generated such that the transformation results in at least one of shifting, scaling, or transforming the second distribution to increase a similarity of the second distribution to the first distribution, responsive to determining that the first attribute value is the majority attribute value.
