# US 8,751,273 B2 · Predictor variable selection and dimensionality reduction for a predictive model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,751,273 B2
- Document ID: US8751273B2
- Status: Granted
- Kind: B2
- Application number: 12/787,956
- Filed: 2010-05-26
- Published: 2011-03-24
- Granted: 2014-06-10
- Earliest claimed: 2004-04-16
- Assignees: Brindle Data L.L.C.
- Applicants: Stephen K. Pinto; Richard J. W. Mansfield; Donald B. Rubin; Jay C. Hirshberg
- Inventors: Stephen K. Pinto; Richard J. W. Mansfield; Donald B. Rubin; Jay C. Hirshberg
- Web page: https://patentgrep.com/patent/US8751273B2

## CPC

- G06Q 10/06: Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06F 30/00: Computer-aided design [CAD]
- G06Q 10/063: Operations research, analysis or management
- G06Q 10/0633: Workflow analysis
- G06Q 10/0635: Risk analysis of enterprise or organisation activities
- G06Q 10/067: Enterprise or organisation modelling
- G06Q 30/0202: Market predictions or forecasting for commercial activities
- G06F 2111/08: Probabilistic or stochastic CAD
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Models are generated using a variety of tools and features of a model generation platform. For example, in connection with a project in which a user generates a predictive model based on historical data about a system being modeled, the user is provided through a graphical user interface a structured sequence of model generation activities to be followed, the sequence including dimension reduction, model generation, model process validation, and model re-generation. In connection with a project in which a user generates a predictive model based on historical data about a system being modeled, and in which the project includes a series of user choice points and actions or parameter settings that govern the generation of the model based on rules, which direct the user to select and apply an optimal model.

## Claims

### Claim 1

A method for use by a computing system comprising one or more computing devices, the method comprising:
performing, by the computing system, based on an outcome variable selected for modeling, a cascade of a plurality of filtering operations, wherein the plurality of filtering operations comprises a determination of a first subset of a plurality of variables having a probability of non-contribution less than a first value and a determination, based on cross products of the first subset of the plurality of variables, of a second subset of the plurality of variables having a probability of non-contribution less than a second value;
determining, by the computing system, a subset of predictor variables from among the plurality of variables and a subset of excluded variables from among the plurality of variables;
generating, by the computing system, a sample predictive model comprising a model of the outcome variable based on variables in the subset of predictor variables;
receiving, by the computing system, a request to change the subset of predictor variables, wherein the request to change the subset of predictor variables comprises at least one of a request to add one of the subset of excluded variables to the subset of predictor variables, a request to add a new variable to the subset of predictor variables, and a request to remove a variable from the subset of predictor variables;
generating, by the computing system, a predictive model comprising a model of the outcome variable based on the variables in the changed subset of predictor variables, wherein the changed subset of predictor variables has fewer variables than the plurality of variables such that a dimensionality of the changed subset of predictor variables is different than a dimensionality of the plurality of variables; and
outputting, by the computing system, the generated predictive model.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
displaying, by the computing system, a list of the subset of predictor variables and a list of the subset of excluded variables.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving, by the computing system, a request to change a dimensionality of a dataset.

### Claim 4 (depends on 3)

The method of claim 3, wherein generating the predictive model comprises generating, by the computing system, the predictive model based on the request to change the dimensionality of the dataset.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
receiving, by the computing system, a request to apply a variable transform to one or more of the variables in the subset of predictor variables.

### Claim 6 (depends on 5)

The method of claim 5, wherein generating the predictive model comprises generating, by the computing system, the predictive model based on the request to apply the variable transform.

### Claim 7 (depends on 6)

The method of claim 6, wherein the variable transform comprises one or more of a logarithm variable transform, a square variable transform, a square root variable transform, and an interaction variable transform.

### Claim 8 (depends on 1)

The method of claim 1, the method further comprising:
partitioning, by the computing system, one of the subset of predictor variables into a plurality of predictive components;
wherein generating the predictive model comprises generating, by the computing system, the predictive model based on the plurality of predictive components.

### Claim 9

A computer readable medium having instructions thereon for use by one or more computing devices, the instructions comprising:
instructions to perform, by the one or more computing devices, based on an outcome variable selected for modeling, a cascade of a plurality of filtering operations, wherein the plurality of filtering operations comprises a determination of a first subset of a plurality of variables having a probability of non-contribution less than a first value and a determination, based on cross products of the first subset of the plurality of variables, of a second subset of the plurality of variables having a probability of non-contribution less than a second value;
instructions to determine, by the one or more computing devices, a subset of predictor variables from among the plurality of variables and a subset of excluded variables from among the plurality of variables;
instructions to generate, by the one or more computing devices, a sample predictive model comprising a model of the outcome variable based on variables in the subset of predictor variables;
instructions to receive, by the one or more computing devices, a request to change the subset of predictor variables, wherein the request to change the subset of predictor variables comprises at least one of a request to add one of the subset of excluded variables to the subset of predictor variables, a request to add a new variable to the subset of predictor variables, and a request to remove a variable from the subset of predictor variables;
instructions to generate, by the one or more computing devices, a predictive model comprising a model of the outcome variable based on the variables in the changed subset of predictor variables, wherein the changed subset of predictor variables has fewer variables than the plurality of variables such that a dimensionality of the changed subset of predictor variables is different than a dimensionality of the plurality of variables; and
instructions to output, by the one or more computing devices, the generated predictive model.

### Claim 10 (depends on 9)

The computer readable medium of claim 9, the instructions further comprising:
instructions to receive, by the one or more computing devices, a request to change a dimensionality of a dataset;
wherein the instructions to generate the predictive model comprise instructions to generate, by the one or more computing devices, the predictive model based on the request to change the dimensionality of the dataset.

### Claim 11 (depends on 9)

The computer readable medium of claim 9, the instructions further comprising:
instructions to receive, by the one or more computing devices, a request to apply a variable transform to one or more of the variables in the subset of predictor variables;
wherein the instructions to generate the predictive model comprise the instructions to generate, by the one or more computing devices, the predictive model based on the request to apply the variable transform; and
wherein the variable transform comprises one or more of a logarithm variable transform, a square variable transform, a square root variable transform, and an interaction variable transform.

### Claim 12 (depends on 9)

The computer readable medium of claim 9, the instructions further comprising:
instructions to partition, by the one or more computing devices, one of the subset of predictor variables into a plurality of predictive components;
wherein the instructions to generate the predictive model comprise instructions to generate, by the one or more computing devices, the predictive model based on the plurality of predictive components.

### Claim 13

A system comprising:
at least one processor; and
a computer readable medium having instructions thereon, the instructions comprising:
instructions to perform, by the system, based on an outcome variable selected for modeling, a cascade of a plurality of filtering operations, wherein the plurality of filtering operations comprises a determination of a first subset of a plurality of variables having a probability of non-contribution less than a first value and a determination, based on cross products of the first subset of the plurality of variables, of a second subset of the plurality of variables having a probability of non-contribution less than a second value;
instructions to determine, by the system, a subset of predictor variables from among the plurality of variables and a subset of excluded variables from among the plurality of variables;
instructions to generate, by the system, a sample predictive model comprising a model of the outcome variable based on variables in the subset of predictor variables;
instructions to receive, by the system, a request to change the subset of predictor variables, wherein the request to change the subset of predictor variables comprises at least one of a request to add one of the subset of excluded variables to the subset of predictor variables, a request to add a new variable to the subset of predictor variables, and a request to remove a variable from the subset of predictor variables;
instructions to generate, by the system, a predictive model comprising a model of the outcome variable based on the variables in the changed subset of predictor variables, wherein the changed subset of predictor variables has fewer variables than the plurality of variables such that a dimensionality of the changed subset of predictor variables is different than a dimensionality of the plurality of variables; and
instructions to output, by the system, the generated predictive model.

### Claim 14 (depends on 13)

The system of claim 13, the instructions further comprising:
instructions to receive, by the system, a request to change a dimensionality of a dataset;
wherein the instructions to generate the predictive model comprise instructions to generate, by the system, the predictive model based on the request to change the dimensionality of the dataset.

### Claim 15 (depends on 13)

The system of claim 13, the instructions further comprising:
instructions to receive, by the system, a request to apply a variable transform to one or more of the variables in the subset of predictor variables;
wherein the instructions to generate the predictive model comprise the instructions to generate, by the system, the predictive model based on the request to apply the variable transform; and
wherein the variable transform comprises one or more of a logarithm variable transform, a square variable transform, a square root variable transform, and an interaction variable transform.

### Claim 16 (depends on 13)

The system of claim 13, the instructions further comprising:
instructions to partition, by the system, one of the subset of predictor variables into a plurality of predictive components;
wherein the instructions to generate the predictive model comprise instructions to generate, by the system, the predictive model based on the plurality of predictive components.

### Claim 17

A system comprising:
means for performing, by a computing system, based on an outcome variable selected for modeling, a cascade of a plurality of filtering operations, wherein the plurality of filtering operations comprises a determination of a first subset of a plurality of variables having a probability of non-contribution less than a first value and a determination, based on cross products of the first subset of the plurality of variables, of a second subset of the plurality of variables having a probability of non-contribution less than a second value;
means for determining, by the computing system, a subset of predictor variables from among the plurality of variables and a subset of excluded variables from among the plurality of variables;
means for generating, by the computing system, a sample predictive model comprising a model of the outcome variable based on variables in the subset of predictor variables;
means for receiving, by the computing system, a request to change the subset of predictor variables, wherein the request to change the subset of predictor variables comprises at least one of a request to add one of the subset of excluded variables to the subset of predictor variables, a request to add a new variable to the subset of predictor variables, and a request to remove a variable from the subset of predictor variables;
means for generating, by the computing system, a predictive model comprising a model of the outcome variable based on the variables in the changed subset of predictor variables, wherein the changed subset of predictor variables has fewer variables than the plurality of variables such that a dimensionality of the changed subset of predictor variables is different than a dimensionality of the plurality of variables; and
means for outputting, by the computing system, the generated predictive model.

### Claim 18 (depends on 17)

The system of claim 17, further comprising:
means for receiving, by the system, a request to change a dimensionality of a dataset;
wherein the means for generating the predictive model comprises means for generating, by the system, the predictive model based on the request to change the dimensionality of the dataset.

### Claim 19 (depends on 17)

The system of claim 17, further comprising:
means for receiving, by the system, a request to apply a variable transform to one or more of the variables in the subset of predictor variables;
wherein the means for generating the predictive model comprises means for generating, by the system, the predictive model based on the request to apply the variable transform; and
wherein the variable transform comprises one or more of a logarithm variable transform, a square variable transform, a square root variable transform, and an interaction variable transform.

### Claim 20 (depends on 17)

The system of claim 17, further comprising:
means for partitioning, by the system, one of the subset of predictor variables into a plurality of predictive components;
wherein the means for generating the predictive model comprises means for generating, by the system, the predictive model based on the plurality of predictive components.