US 2025/0028977 A1Published application

Artificial intelligence-based auditors of artificial intelligence

AssigneeBank of America Corporation

InventorsManu Kurian, Ana Maxim, Vinesh Patel, Michael Young

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and methods for an artificial intelligence-based auditor of artificial intelligence may be provided. The artificial-intelligence-based auditor may operate on one or more hardware processors. The artificial intelligence-based auditor may continually scan one or more operating artificial intelligence systems for productivity and operability. The scan may identify a data source powering the one or more operating artificial intelligence systems. The scan may measure a delta between an output from each of the one or more operating artificial intelligence systems. The scan may identify trends in quality of the one or more operating artificial intelligence systems. The scan may analyze instances where the one or more operating artificial intelligence systems outputted data outside of a parameter range. Based on the scan, the auditor may label each of the one or more operating artificial intelligence systems as positive, neutral or negative.

Claims18

Dependent claims

A network of artificial intelligence-based auditors of artificial intelligence, the network of artificial-intelligence-based auditors operating on one or more hardware processors, the network of artificial intelligence-based auditors comprising:

a level one artificial intelligence-based auditor, the level one auditor operable to:
continually scan an operating artificial intelligence system for productivity and operability;
and
output a first productivity and operability score for the operating artificial intelligence system;
a level two artificial intelligence-based auditor, the level two auditor operable to:
continually scan the one or more operating artificial intelligence systems for productivity and operability;
and
output a second productivity and operability score for the operating artificial intelligence system;
a level three artificial intelligence-based auditor, the level three auditor operable to:
continually scan the one or more operating artificial intelligence systems for productivity and operability;
and
output a third productivity and operability score for the operating artificial intelligence system;
a level four artificial intelligence-based auditor, the level four auditor operable to:
continually scan the one or more operating artificial intelligence systems for productivity and operability;
and
output a fourth productivity and operability score for the operating artificial intelligence system;
an artificial intelligence-based syndicator operable to:
group the first productivity and operability score, the second productivity and operability score, the third productivity and operability score and the fourth productivity and operability score into a productivity and operability score grouping;
identify an outlier within the productivity and operability score grouping, the outlier being one of the first productivity and operability score, the second productivity and operability score, the third productivity and operability score or the fourth productivity and operability score;
remove the outlier from the grouping;
output a syndicated productivity and operability score, the syndicated productivity and operability score including a combination of the productivity and operability scores included within the grouping;
an artificial intelligence-based labeler operable to label the operating artificial intelligence system as positive, neutral or negative based on the syndicated productivity and operability score;
wherein:
the level one auditor operates independently from the level two, level three and level four auditors;
the level two auditor operates independently from the level one, level three and level four auditors;
the level three auditor operates independently from the level one, level two and level four auditors;
and
the level four auditor operates independently from the level one, level two and level three auditors.

25 more elements

A method for auditing artificial intelligence-based systems, the method comprising:

continually scanning, by a level one artificial intelligence-based auditor, an operating artificial intelligence system for productivity and operability;
and
outputting, by the level one artificial intelligence-based auditor, a first productivity and operability score for the operating artificial intelligence system;
continually scanning, by a level two artificial intelligence-based auditor, the one or more operating artificial intelligence systems for productivity and operability;
and
outputting, by the level two artificial intelligence-based auditor, a second productivity and operability score for the operating artificial intelligence system;
continually scanning, by a level three artificial intelligence-based auditor, the one or more operating artificial intelligence systems for productivity and operability;
and
outputting, by the level three artificial intelligence-based auditor, a third productivity and operability score for the operating artificial intelligence system;
continually scanning, by a level four artificial intelligence-based auditor, the one or more operating artificial intelligence systems for productivity and operability;
and
outputting, by the level four artificial intelligence-based auditor, a fourth productivity and operability score for the operating artificial intelligence system;
grouping, by an artificial intelligence-based syndicator, the first productivity and operability score, the second productivity and operability score, the third productivity and operability score and the fourth productivity and operability score into a productivity and operability score grouping;
identifying an outlier within the productivity and operability score grouping, the outlier being one of the first productivity and operability score, the second productivity and operability score, the third productivity and operability score or the fourth productivity and operability score;
removing the outlier from the grouping;
outputting a syndicated productivity and operability score, the syndicated productivity and operability score including a combination of the productivity and operability scores included within the grouping;
labeling, by an artificial intelligence-based labeler, the operating artificial intelligence system as positive, neutral or negative based on the syndicated productivity and operability score;
wherein:
the level one auditor operates independently from the level two, level three and level four auditors;
the level two auditor operates independently from the level one, level three and level four auditors;
the level three auditor operates independently from the level one, level two and level four auditors;
and
the level four auditor operates independently from the level one, level two and level three auditors.

20 more elements

Dependencies are inferred from the claim text.