Systems and methods include processors for receiving training data for a user activity; receiving bias criteria; determining a set of model parameters for a machine learning model including: (1) applying the machine learning model to the training data; (2) generating model prediction errors; (3) generating a data selection vector to identify non-outlier target variables based on the model prediction errors; (4) utilizing the data selection vector to generate a non-outlier data set; (5) determining updated model parameters based on the non-outlier data set; and (6) repeating steps (1)-(5) until a censoring performance termination criterion is satisfied; training classifier model parameters for an outlier classifier machine learning model; applying the outlier classifier machine learning model to activity-related data to determine non-outlier activity-related data; and applying the machine learning model to the non-outlier activity-related data to predict future activity-related attributes for the user activity.
Drawings
Claims20
A method comprising:
receiving, by at least one processor from at least one computing device associated with at least one production environment, a production-ready model request comprising a training data set of data records;
wherein each data record comprises an independent variable and a target variable;
and
wherein each data record comprises an actual value associated with the target variable;
determining, by the at least one processor, at least one bias criteria;
selecting, by the at least one processor, at least one machine learning model based at least in part on the production-ready model request;
iteratively refining, by the at least one processor, a set of model parameters of the at least one machine learning model until a termination criterion is met, wherein the iterative refining comprises iteratively repeating steps comprising:
determining a plurality of model predicted values using the set of model parameters of the at least one machine learning based on each independent variable of the training data set,
determining an outlier data set and a non-outlier data set associated with the training data set based at least in part on:
an error calculation between each model predicted value relative to each actual value of the training data set, and
the at least one bias criteria;
training the at least one machine learning model using the non-outlier data set to update the set of model parameters;
outputting, by the at least one processor, a production-ready machine learning model of the at least one machine learning model comprising the set of model parameters.
10 more elements
A system comprising:
at least one processor in communication with a non-transitory computer-readable storage medium having software instructions stored thereon, wherein the software instructions, when executed, cause the at least one processor to perform steps to:
receive, from at least one computing device associated with at least one production environment, a production-ready model request comprising a training data set of data records;
wherein each data record comprises an independent variable and a target variable;
and
wherein each data record comprises an actual value associated with the target variable;
determine at least one bias criteria;
select at least one machine learning model based at least in part on the production-ready model request;
iteratively refine a set of model parameters of the at least one machine learning model until a termination criterion is met, wherein the iterative refining comprises iteratively repeating steps comprising:
determining a plurality of model predicted values using the set of model parameters of the at least one machine learning based on each independent variable of the training data set,
determining an outlier data set and a non-outlier data set associated with the training data set based at least in part on:
an error calculation between each model predicted value relative to each actual value of the training data set, and
the at least one bias criteria;
training the at least one machine learning model using the non-outlier data set to update the set of model parameters;
output a production-ready machine learning model of the at least one machine learning model comprising the set of model parameters.
18 Sep 2040Estimated · howhide20 years from earliest known nonprovisional domestic filing plus recorded patent term adjustment. Maintenance-fee lapses, terminal disclaimers and statutory extensions have not been checked. The continuity chain may be incomplete; this is not an enforceability determination.
About 13 years 11 months of term left · ends 18 Sep 2040 (estimated)
Priority18 Sep 2019
Filed10 May 2022
Granted7 Mar 2023
Today12 Oct 2026
Term ends18 Sep 2040
Priority18 Sep 2019
Granted7 Mar 2023
Term ends18 Sep 2040
Priority claimedParent application 62/902,074
Application filedUS 17/741,417
PublishedUS 2022/0092346 A1
Assigned to Hartford Steam Boiler Inspection and Insurance Companyassignment of assignor's interest
GrantedUS 11,599,740 B2
Assigned to The Hartford Steam Boiler Inspection and Insurance Companycorrective assignment to correct the assignee's name previously recorded at reel: 62503 frame: 322. assignor(s) hereby confirms the assignment .
Assigned to The Hartford Steam Boiler Inspection and Insurance Companycorrective assignment to correct the assignee's name previously recorded at reel: 62503 frame: 322. assignor(s) hereby confirms the assignment .
#A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright rights whatsoever. The following notice applies to the software and data as described below and in drawings that form a part of this document: Copyright, Hartford Steam Boiler Inspection and Insurance Company, All Rights Reserved.
#The present disclosure generally relates to improved computer-based systems, computing components and computing objects configured to implement bias reduction in machine learning models.
#A machine learning model may include one or more computers or processing devices to form predictions or determinations based on patterns and inferences learned from sample/training data. Bias in sample/training data selection can propagate into machine learning model predictions and determinations.
Brief description of the drawings19 figures
#Various embodiments of the present disclosure can be further explained with reference to the attached drawings, wherein like structures are referred to by like numerals throughout the several views. The drawings shown are not necessarily to scale, with emphasis instead generally being placed upon illustrating the principles of the present disclosure. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ one or more illustrative embodiments.
#FIG. 1 depicts a block diagram of an exemplary computer-based system 100 for bias reduction in machine learning in accordance with one or more embodiments of the present disclosure.
#FIG. 2 depicts a block diagram of another exemplary computer-based system/platform 200 in accordance with one or more embodiments of the present disclosure.
Detailed description32,708 words
#Various detailed embodiments of the present disclosure, taken in conjunction with the accompanying figures, are disclosed herein; however, it is to be understood that the disclosed embodiments are merely illustrative. In addition, each of the examples given in connection with the various embodiments of the present disclosure is intended to be illustrative, and not restrictive.
#Throughout the specification, the following terms take the meanings explicitly associated herein, unless the context clearly dictates otherwise. The phrases “in one embodiment” and “in some embodiments” as used herein do not necessarily refer to the same embodiment(s), though it may. Furthermore, the phrases “in another embodiment” and “in some other embodiments” as used herein do not necessarily refer to a different embodiment, although it may. Thus, as described below, various embodiments may be readily combined, without departing from the scope or spirit of the present disclosure.
#In addition, the term “based on” is not exclusive and allows for being based on additional factors not described, unless the context clearly dictates otherwise. In addition, throughout the specification, the meaning of “a,” “an,” and “the” include plural references. The meaning of “in” includes “in” and “on.”