Determining word information entropies
AssigneeAlibaba Group Holding Limited
InventorKaimin Jin
Life of this patent
Estimating the term…
Abstract
Determining and using word information entropies includes: determining one or more categories that correspond to a plurality of queries; sorting the plurality of queries into one or more groups based at least in part on the determined categories of the plurality of queries; segmenting queries that correspond to each of the one or more groups into a first plurality of phrases, wherein each phrase includes one or more words; determining occurrence probabilities for the plurality of phrases; and determining word information entropies for the plurality of phrases based at least in part on the determined occurrence probabilities.
Claims25
A method, comprising:
- determining one or more categories that correspond to a plurality of queries;
- sorting the plurality of queries into one or more groups based at least in part on the determined categories of the plurality of queries;
- segmenting queries that correspond to each of the one or more groups into a first plurality of phrases, wherein each phrase includes one or more words;
- determining occurrence probabilities for the first plurality of phrases;
- and
- determining word information entropies for the first plurality of phrases based at least in part on the determined occurrence probabilities.
A system, comprising:
- one or more processors configured to:
- determine one or more categories that correspond to a plurality of queries,
- sort the plurality of queries into one or more groups based at least in part on the determined categories of the plurality of queries,
- segment queries that correspond to each of the one or more groups into a first plurality of phrases, wherein each phrase includes one or more words,
- determine occurrence probabilities for the first plurality of phrases, and
- determine word information entropies for the first plurality of phrases based at least in part on the determined occurrence probabilities;
- and
- one or more memories coupled to the one or more processors and configured to provide the processor with instructions.
A computer program product, the computer program product being embodied in a computer readable storage medium and comprising computer instructions for:
- determining one or more categories that correspond to a plurality of queries;
- sorting the plurality of queries into one or more groups based at least in part on the determined categories of the plurality of queries;
- segmenting queries that correspond to each of the one or more groups into a first plurality of phrases, wherein each phrase includes one or more words;
- determining occurrence probabilities for the first plurality of phrases;
- determining word information entropies for the first plurality of phrases based at least in part on the determined occurrence probabilities;
- and
- performing a search based at least in part on the determined word information entropies.
Dependencies are inferred from the claim text.