System and method for removing biases within a distributable model
AssigneeQomplx LLC
InventorsJason Crabtree, Andrew Sellers
Life of this patent
Estimating the term…
Abstract
A system for improving a distributable model with distributed data is provided, comprising a network-connected distributable model source configured to serve instances of a distributable model; and a directed computation graph module configured to receive at least an instance of the distributable model from the network-connected computing system, create a cleansed dataset from data stored in the memory with at least biases within the data stored in memory corrected, train the instance of the distributable model with the cleansed dataset, and generate an update report based at least in part by updates to the instance of the distributable model.
Claims18
A system for improving a distributable model with distributed data, comprising:
- a computing system comprising a processor, a memory, and a network interface, a directed computational graph subsystem comprising a plurality of programming instructions stored in the memory and operable on the processor, wherein the programming instructions, when operating on the processor, cause the computing system to:
- receive an instance of a distributable model from a distributable model source via a computer network;
- operate a directed computational graph comprising a plurality of data transformation nodes configured to process model data stored on the computing system by removing data biases wherein each of the plurality of data transformation nodes executes code to perform one or more data transformations on input data and outputs transformed data;
- train the instance of the distributed model on the model data to remove a plurality of data biases within the instance of the distributable model using the directed computational graph;
- create a cleansed dataset based on the trained instance of the distributable model and the removed biases;
- wherein the biases comprise trends exhibited within the data;
- wherein the biases are automatically intelligently weighted and corrected by the directed computational graph to generalize the dataset for use in a distributable model;
- train the instance of the distributable model with the cleansed dataset;
- and
- generate an update report based upon which remote instances of the distributable model may be adjusted to take into account the training of the instance of the distributable model using the cleansed dataset.
A method for improving a distributable model with distributed data, comprising the steps of:
- using a directed computational graph subsystem comprising a plurality of programming instructions stored in a memory and operating on a processor of a computing system:
- receiving an instance of a distributable model from a distributable model source via a computer network;
- operating a directed computational graph comprising a plurality of data transformation nodes configured to process model data stored on the computing system by removing data biases, wherein each of the plurality of data transformation nodes executes code to perform one or more data transformations on input data and outputs transformed data;
- training the instance of the distributed model on the model data to remove a plurality of data biases within the instance of the distributable model using the directed computational graph;
- creating a cleansed dataset based on the trained instance of the distributable model and the removed biases;
- wherein the biases comprise trends exhibited within the data;
- wherein the biases are automatically intelligently weighted and corrected by the directed computational graph to generalize the dataset for use in a distributable model;
- training the instance of the distributable model with the cleansed dataset;
- and
- generating an update report based upon which remote instances of the distributable model may be adjusted to take into account the training of the instance of the distributable model using the cleansed dataset.
Dependencies are inferred from the claim text.