Dynamic metadata filtering for classifier prediction
AssigneeMicrosoft Corporation
InventorsLei ZHAO, Zhanliang CHEN, Yanbiao ZHAO
Life of this patent
Estimating the term…
Abstract
A classifier is used to predict relevant results with arbitrary filtering conditions specified by the user. The classifier model is stored as a database table and joined with a metadata properties table instead of calculating the query result probability using the full classifier model. A user-specified query based filter is applied to the joined tables to obtain the list of documents satisfying the filter. The probability is then computed using the sub-model.
Claims20
A method to be executed at least in part in a computing device for predicting query results in a document search system utilizing metadata properties, the method comprising:
- receiving a metadata property table;
- receiving a classifier model table;
- joining the metadata property table and the classifier model table;
- applying a filter condition to the joined table based on user-specified query conditions;
- obtaining a list of documents satisfying the filter condition;
- computing a probability of a document satisfying a user-specified query based on the list of documents;
- and
- presenting the probability to the user.
The method of claim 10, wherein the probability is computed using:
- log
-
-
- Pr
-
- (
- query
- |
- doc
- )
- =
- log
-
-
- cache
-
- (
- doc
- )
- +
- ∑
- w
- i
- ∈
-
- query
-
-
- termprob
-
- (
- i
- ,
- doc
- )
- termprob
-
- (
- i
- ,
- doc
- )
- =
- log
-
-
- Pr
-
- (
- w
- i
- =
- 1
- |
- doc
- )
- -
- log
-
-
- Pr
-
- (
- w
- i
- =
- 0
- |
- doc
- )
- where term probabilities (termprob) are derived from raw counts of a training data set associated with the classifier model.
A system for predicting query results in a document search system utilizing metadata properties, the system comprising:
- a memory;
- a processor coupled to the memory, capable of executing:
- a service application configured to:
- receive a user defined metadata schema;
- generate a metadata property table based on the received schema;
- a prediction engine configured to:
- receive a classifier model table based on training data associated with documents stored by the document search system;
- join the metadata property table and the classifier model table;
- apply a filter condition to the joined table based on user-specified query conditions;
- obtain a list of documents satisfying the filter condition;
- and
- compute a probability of a document satisfying a user-specified query based on the list of documents.
A computer-readable storage medium with instructions encoded thereon for predicting query results in a document search system utilizing metadata properties, the instructions comprising:
- receiving custom metadata schema;
- generating a metadata property table based on the received schema;
- receiving a classifier model matrix based on a training data set associated with documents processed by the system;
- generating a classifier model table from the sparse classifier model matrix;
- joining the metadata property table and the classifier model table;
- applying at least one filter condition to the joined table based on user-specified query conditions;
- obtaining a list of documents satisfying the at least one filter condition;
- and
- computing a probability of a document satisfying a user-specified query based on the list of documents.
Dependencies are inferred from the claim text.