One pass modeling of data sets
AssigneeIS Technologies, LLC
InventorPhilip R. Morrison
Life of this patent
Estimating the term…
Abstract
The system and process used for modeling of data sets is improved by achieving one pass modeling which proactively anticipates issues with the model and deals with these issues prior to model formation. The anticipated issues include those involving offending variables, which are initially identified and eliminated so as to avoid any further contribution by those variables. Once offending variables are eliminated, the process then deals with variables having only minimal contributions. To create a simplified and more effective model, these minimal contributors are then eliminated before completion of the model.
Claims16
A method for one-pass modeling of data segments to provide a predictive model usable as an analytical tool suggestive of an outcome, comprising:
- collecting data from a segment and calculating a plurality of model coefficients and variables which will produce a preliminary model for the segment;
- identifying offending variables in the preliminary model and removing the most significant offending variable until all offending variables are removed;
- identifying variables contributing less than a predetermined contribution amount and identifying a least contributing variable, removing the least contributing variable;
- repeat the step of identifying variables contributing less than the predetermined amount, and removing the least contributing variable until all variables contribute above the predetermined amount;
- and
- calculating the predictive model using remaining variables.
A system for one-pass modeling of data segments to provide a predictive model usable as an analytical tool suggestive of an outcome, comprising:
- a distributed data storage system containing multiple data segments;
- a modeling system for collecting data from a selected segment in the data storage system and calculating a plurality of model coefficients and variables which will produce a preliminary model for the segment, the modeling system further identifying offending variables in the preliminary model and removing the most significant offending variable until all offending variables are removed, the modeling system subsequently identifying variables contributing less than a predetermined contribution amount and identifying a least contributing variable, removing the least contributing variable, and repeating the step of identifying and removing variables contributing less than the predetermined amount until all variables contribute above the predetermined amount, the system then calculating the predictive model using remaining variables;
- and
- a code generating system for generating code capable of implementing the calculated predictive model using the multiple data segments.
A method for one-pass modeling of data segments to provide a predictive model usable as an analytical tool suggestive of an outcome, comprising:
- conditioning a data segment by removing irregularities and scaling, thus producing a conditioned segment;
- collecting data from the conditioned segment and calculating a plurality of potential model coefficients and variables which may be used to produce a preliminary model for the segment;
- analyzing the potential model coefficients and variables and identifying offending variables in the preliminary model;
- removing the most significant offending variable and continuing to analyze the remaining potential variables until all offending variables are removed;
- identifying variables contributing less than a predetermined contribution amount and identifying a least contributing variable, removing the least contributing variable;
- repeat the step of identifying variables contributing less than the predetermined amount, and removing the least contributing variable until all variables contribute above the predetermined amount;
- and
- calculating the predictive model using remaining variables.
Dependencies are inferred from the claim text.