# US 2026/0065146 A1 · Bias mitigation method and system for ai systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065146 A1
- Document ID: US20260065146A1
- Status: Published application
- Kind: A1
- Application number: 19/107,049
- Filed: 2023-05-26
- Published: 2026-03-05
- Earliest claimed: 2022-10-28
- Applicants: NEC Laboratories Europe GmbH
- Inventors: Sascha SARALAJEW; Carolin LAWRENCE; Wiem BEN RIM
- Web page: https://patentgrep.com/patent/US20260065146A1

## CPC

- G06N 20/00: Machine learning
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

A computer-implemented method for supporting bias mitigation in an artificial intelligence (AI) system includes determining a set of sensitive attributes and providing a dataset including a number of data elements. Each data element is labelled with sensitive attributes. The AI system runs on the dataset and determines whether a prediction for an element is correct. Upon checking whether a bias with regard to a sensitive attribute is present, for each sensitive attribute that exhibits a bias, a model is trained for an attribute-based global explanation for each class of correct and incorrect predictions. For each incorrectly predicted data element based on the trained model for the at least one attribute-based global explanation, a counterfactual data element is generated that leads to a correct classification. The method has applications including, but not limited to, use cases in facial recognition and medical/healthcare for optimizing machine learning and supporting decision making.

## Claims

### Claim 1

A computer-implemented method for supporting bias mitigation in an existing artificial intelligence (AI) system, the method comprising:
determining a set of one or more sensitive attributes and providing a dataset including a number of data elements, where each of the data elements is labelled with the attributes of the determined set of one or more sensitive attributes;
running the existing AI system on the dataset and determining for each data element of the dataset whether a prediction of the existing AI system is correct or not;
checking whether a bias with regard to a sensitive attribute is present and training, for each sensitive attribute that exhibits a bias, a model for at least one attribute-based global explanation for each class of correct predictions and incorrect predictions; and
generating, for each incorrectly predicted data element of the dataset based on the trained model for the at least one attribute-based global explanation, a counterfactual data element that leads to a correct classification by the existing AI system.

### Claim 2 (depends on 1)

The method according to claim 1, wherein checking whether the bias with regard to the sensitive attribute is present includes:
determining, by computing a corresponding conditional probability or by using diversity and inclusion metrics, whether the predictions of the existing AI system on the data elements with a respective sensitive attribute are disproportionally more often wrong.

### Claim 3 (depends on 1)

The method according to claim 1, wherein prototype-based learning is used for training the model for at least one attribute-based global explanation for each of the classes of correct predictions and incorrect predictions.

### Claim 4 (depends on 1)

The method according to claim 1, further comprising:
creating, for each incorrectly predicted data element of the dataset and/or for each generated counterfactual data element, a local explanation by computing a classification correlation matrix.

### Claim 5 (depends on 1)

The method according to claim 1, further comprising:
creating, for each data element of the dataset and for each generated counterfactual data element, a series of inputs that gradually transition from original to counterfactual by binning correlation values and replacing features of the original data element of the dataset with features of the counterfactual data element.

### Claim 6 (depends on 5)

The method according to claim 5, further comprising:
using the generated counterfactual data elements together with the original data elements of the dataset as training data to update the existing AI system.

### Claim 7 (depends on 6)

The method according to claim 6, further comprising:
using, during the updating of the existing AI system, continual learning techniques to keep track of previously correct predictions of the existing AI system.

### Claim 8 (depends on 6)

The method according to claim 6, wherein the update of the existing AI system is terminated once the original data elements of the dataset are predicated correctly.

### Claim 9 (depends on 6)

The method according to claim 6, further comprising:
providing the update of the existing AI system as an updated system for making predictions with less bias with regard to the determined sensitive attributes.

### Claim 10

A computer system programmed for supporting bias mitigation in an existing artificial intelligence (AI) system, the computer system comprising one or more processors which, alone or in combination, are configured to provide for execution of the following steps:
running the existing AI system on a dataset including a number of data elements, where each of the data elements is labelled with attributes of a determined set of one or more sensitive attributes, and determining for each data element of the dataset whether a prediction of the existing AI system is correct or not;
checking whether a bias with regard to a sensitive attribute is present and learning, for each sensitive attribute that exhibits a bias, a model for at least one attribute-based global explanation for each class of correct predictions and incorrect predictions; and
generating, for each incorrectly predicted data element of the dataset based on the trained model for the at least one attribute-based global explanation, a counterfactual data element that leads to a correct classification by the existing AI system.

### Claim 11 (depends on 10)

The system according to claim 10, further comprising an attribute-based global explanation generator configured to:
determine, by computing a corresponding conditional probability or by using diversity and inclusion metrics, whether the predictions of the existing AI system on the data elements with a respective sensitive attribute are disproportionally more often wrong; and
use prototype-based learning for training the model for at least one attribute-based global explanation for each of the classes of correct predictions and incorrect predictions.

### Claim 12 (depends on 10)

The system according to claim 10, further comprising a local explanation generator configured to create, for each incorrectly predicted data element of the dataset and/or for each generated counterfactual data element, a local explanation by computing a classification correlation matrix.

### Claim 13 (depends on 10)

The system according to claim 10, further comprising a counterfactual generator configured to:
compute, for each data element of the dataset incorrectly classified by the existing AI system and using the trained model for at least one attribute-based global explanation, a counterfactual data element that causes the existing AI system to output a correct prediction.

### Claim 14 (depends on 10)

The system according to claim 10, further comprising a system updater configured to
create, for each data element of the dataset incorrectly classified by the existing AI system, a series of counterfactual data elements; and
use the series of counterfactual data elements as training data to update the existing AI system.

### Claim 15

A tangible, non-transitory computer-readable medium supporting bias mitigation in an existing artificial intelligence (AI) system having instructions thereon, which, upon being executed by one or more processors, provide for execution of the following steps:
running the existing AI system on a dataset including a number of data elements, where each of the data elements is labelled with attributes of a determined set of one or more sensitive attributes, and determining for each data element of the dataset whether a prediction of the existing AI system is correct or not;
checking whether a bias with regard to a sensitive attribute is present and learning, for each sensitive attribute that exhibits a bias, a model for at least one attribute-based global explanation for each class of correct predictions and incorrect predictions; and
generating, for each incorrectly predicted data element of the dataset based on the learned model for the at least one attribute-based global explanation, a counterfactual data element that leads to a correct classification by the existing AI system.
