# US 2010/0169158 A1 · Squashed matrix factorization for modeling incomplete dyadic data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0169158 A1
- Document ID: US20100169158A1
- Status: Published application
- Kind: A1
- Application number: 12/346,641
- Filed: 2008-12-30
- Published: 2010-07-01
- Earliest claimed: 2008-12-30
- Assignees: Yahoo! Inc.
- Inventors: Deepak K. AGARWAL; Srujana Merugu
- Web page: https://patentgrep.com/patent/US20100169158A1

## CPC

- G06Q 10/063: Operations research, analysis or management
- G06F 18/2321: using statistics or function optimisation, e.g. modelling of probability density functions
- G06N 5/02: Knowledge representation; Symbolic representation
- G06N 20/00: Machine learning
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method of predicting a response relationship between elements of two sets includes: specifying a dyadic response matrix; specifying covariates that measure additional dyadic relationships; specifying a number of row clusters and a number of column clusters for clustering the rows and columns of the response matrix; specifying a rank for cluster factors that model average interactions between row clusters and column clusters by products of cluster factors; and determining prediction parameters for predicting responses between elements of the first set and the second set by improving a likelihood value that relates the prediction parameters to the response matrix, the covariates, the observation weights, the row clusters and the column clusters. Determining the prediction parameters includes: updating the prediction parameters for fixed assignments of row clusters and column clusters, and updating assignments for row clusters and column clusters for fixed prediction parameters.

## Claims

### Claim 1

A method of predicting a response relationship between elements of two sets, comprising:
specifying a response matrix that measures a response relationship between elements of a first set corresponding to rows of the response matrix and a second set corresponding to columns of the response matrix;
specifying covariates that measure additional relationships between elements of the first set and the second set;
specifying observation weights for weighing measurements for elements of the first set and the second set;
specifying a number of row clusters for clustering elements of the first set into row clusters;
specifying a number of column clusters for clustering elements of the second set into column clusters;
specifying a rank for cluster factors that model average interactions between row clusters and column clusters by products of cluster factors;
determining prediction parameters for predicting responses between elements of the first set and the second set by improving a likelihood value that relates the prediction parameters to the response matrix, the covariates, the observation weights, the row clusters and the column clusters, wherein determining the prediction parameters includes:
updating the prediction parameters for fixed assignments of row clusters and column clusters, and
updating assignments for row clusters and column clusters for fixed prediction parameters; and
saving one or more values for the prediction parameters in a computer-readable medium.

### Claim 2 (depends on 1)

A method according to claim 1, wherein one of the sets corresponds to consumer choices for goods or services, another of the sets corresponds to individual consumers, and the response matrix corresponds to preferences of the individual consumers for the consumer choices.

### Claim 3 (depends on 1)

A method according to claim 1, wherein the observation weights are scaled to indicate a presence or an absence of values for the response matrix for specific combinations of rows and columns of the response matrix.

### Claim 4 (depends on 1)

A method according to claim 1, wherein improving the likelihood value corresponds to fitting the parameters to the response matrix through a family of probability distributions for predicting the response matrix.

### Claim 5 (depends on 1)

A method according to claim 1, wherein the prediction parameters include mixture prior probabilities for assigning rows and columns to row clusters and column clusters.

### Claim 6 (depends on 1)

A method according to claim 1, wherein the prediction parameters include regression coefficients for using combinations of the covariates to predict the response relationship between elements of the two sets.

### Claim 7 (depends on 1)

A method according to claim 1, wherein the prediction parameters include row cluster factors and column cluster factors for using products of the row cluster factors and the column cluster factors to predict the response relationship between elements of the two sets.

### Claim 8 (depends on 1)

A method according to claim 1, wherein updating assignments for row clusters and column clusters includes calculating probability values for assigning rows and columns by using products of cluster factors to estimate effects of possible assignments.

### Claim 9 (depends on 1)

A method according to claim 1, further comprising: using the prediction parameters to predict a likelihood over response values between elements of the two sets.

### Claim 10

A computer-readable medium that stores a computer program for predicting a response relationship between elements of two sets, wherein the computer program includes instructions for:
specifying a response matrix that measures a response relationship between elements of a first set corresponding to rows of the response matrix and a second set corresponding to columns of the response matrix;
specifying covariates that measure additional relationships between elements of the first set and the second set;
specifying observation weights for weighing measurements for elements of the first set and the second set;
specifying a number of row clusters for clustering elements of the first set into row clusters;
specifying a number of column clusters for clustering elements of the second set into column clusters;
specifying a rank for cluster factors that model average interactions between row clusters and column clusters by products of cluster factors;
determining prediction parameters for predicting responses between elements of the first set and the second set by improving a likelihood value that relates the prediction parameters to the response matrix, the covariates, the observation weights, the row clusters and the column clusters, wherein determining the prediction parameters includes:
updating the prediction parameters for fixed assignments of row clusters and column clusters, and
updating assignments for row clusters and column clusters for fixed prediction parameters; and
saving one or more values for the prediction parameters.

### Claim 11 (depends on 10)

A computer-readable medium according to claim 10, wherein one of the sets corresponds to consumer choices for goods or services, another of the sets corresponds to individual consumers, and the response matrix corresponds to preferences of the individual consumers for the consumer choices.

### Claim 12 (depends on 10)

A computer-readable medium according to claim 10, wherein the observation weights are scaled to indicate a presence or an absence of values for the response matrix for specific combinations of rows and columns of the response matrix.

### Claim 13 (depends on 10)

A computer-readable medium according to claim 10, wherein improving the likelihood value corresponds to fitting the parameters to the response matrix through a family of probability distributions for predicting the response matrix.

### Claim 14 (depends on 10)

A computer-readable medium according to claim 10, wherein the prediction parameters include mixture prior probabilities for assigning rows and columns to row clusters and column clusters.

### Claim 15 (depends on 10)

A computer-readable medium according to claim 10, wherein the prediction parameters include regression coefficients for using combinations of the covariates to predict the response relationship between elements of the two sets.

### Claim 16 (depends on 10)

A computer-readable medium according to claim 10, wherein the prediction parameters include row cluster factors and column cluster factors for using products of the row cluster factors and the column cluster factors to predict the response relationship between elements of the two sets.

### Claim 17 (depends on 10)

A computer-readable medium according to claim 10, wherein updating assignments for row clusters and column clusters includes calculating probability values for assigning rows and columns by using products of cluster factors to estimate effects of possible assignments.

### Claim 18 (depends on 10)

A computer-readable medium according to claim 10, wherein the computer program further includes instructions for: using the prediction parameters to predict a likelihood over response values between elements of the two sets.

### Claim 19

An apparatus for predicting a response relationship between elements of two sets, the apparatus comprising a computer for executing computer instructions, wherein the computer includes computer instructions for:
specifying a response matrix that measures a response relationship between elements of a first set corresponding to rows of the response matrix and a second set corresponding to columns of the response matrix;
specifying covariates that measure additional relationships between elements of the first set and the second set;
specifying observation weights for weighing measurements for elements of the first set and the second set;
specifying a number of row clusters for clustering elements of the first set into row clusters;
specifying a number of column clusters for clustering elements of the second set into column clusters;
specifying a rank for cluster factors that model average interactions between row clusters and column clusters by products of cluster factors;
determining prediction parameters for predicting responses between elements of the first set and the second set by improving a likelihood value that relates the prediction parameters to the response matrix, the covariates, the observation weights, the row clusters and the column clusters, wherein determining the prediction parameters includes:
updating the prediction parameters for fixed assignments of row clusters and column clusters, and
updating assignments for row clusters and column clusters for fixed prediction parameters; and
saving one or more values for the prediction parameters.

### Claim 20 (depends on 19)

An apparatus according to claim 19, wherein the computer includes a processor with memory for executing at least some of the computer instructions.

### Claim 21 (depends on 19)

An apparatus according to claim 19, wherein the computer includes circuitry for executing at least some of the computer instructions.
