Clustering a set of natural language queries based on significant events
AssigneeInternational Business Machines Corporation
InventorsSwaminathan Chandrasekaran, Joseph N Kozhaya, Lakshminarayanan Krishnamurthy
Life of this patent
Estimating the term…
Abstract
Clustering a set of natural language queries NLQs based on a set of significant events retrieved from a corpus stored in a computer system is described. A set of NLQs is used by a search engine for searching a selected corpus to retrieve respective sets of significant events. The set of NLQs is clustered into a plurality of NLQ clusters according to a number of common significant events being returned by the search engine for respective members of an NLQ cluster.
Claims19
An improved method for searching a selected corpus by clustering a set of natural language queries (NLQ) based on a set of significant events retrieved from a corpus stored in a computer system comprising:
- using a set of NLQs by a search engine for searching a selected corpus to retrieve respective sets of significant events from the selected corpus;
- for each NLQ in the set of NLQs, using a first set of entities from the NLQ and using the first set of entities to search for a first set of significant events in the selected corpus;
- using a second set of entities from the first set of significant events to search for a second set of significant events in the selected corpus;
- producing a distribution profile for each NLQ based on a number of common significant events retrieved using the first set of entities and a number of common significant events retrieved using the second set of entities;
- clustering the set of NLQs into NLQ clusters according to the distribution profiles;
- and
- using a respective NLQ cluster for a function in the search engine.
Apparatus, comprising:
- a processor;
- computer memory holding computer program instructions executed by the processor for improved searching of a selected corpus by clustering a set of natural language queries (NLQ), the computer program instructions comprising:
- program code, operative to use a set of NLQs by for searching a selected corpus to retrieve respective sets of significant events from the selected corpus;
- program code, operative for each NLQ in the set of NLQs to use a first set of entities from the NLQ and to use the first set of entities to search for a first set of significant events in the selected corpus;
- program code, operative to use a second set of entities from the first set of significant events to search for a second set of significant events in the selected corpus;
- program code, operative to produce a distribution profile for each NLQ based on a number of common significant events retrieved using the first set of entities and a number of common significant events retrieved using the second set of entities;
- program code, operative to cluster the set of NLQs into NLQ clusters according to the distribution profiles;
- and
- program code, operative to use a respective NLQ cluster for a function in the search engine.
A computer program product in a non-transitory computer readable medium for use in a data processing system, the computer program product holding computer program instructions executed by the data processing system for improved searching of a selected corpus by performing clustering of natural language queries (NLQ), the computer program instructions comprising:
- program code, operative to use a set of NLQs by for searching a selected corpus to retrieve respective sets of significant events from the selected corpus;
- program code, operative for each NLQ in the set of NLQs to use a first set of entities from the NLQ and to use the first set of entities to search for a first set of significant events in the selected corpus;
- program code, operative to use a second set of entities from the first set of significant events to search for a second set of significant events in the selected corpus;
- program code, operative to produce a distribution profile for each NLQ based on a number of common significant events retrieved using the first set of entities and a number of common significant events retrieved using the second set of entities;
- program code, operative to cluster the set of NLQs into NLQ clusters according to the distribution profiles;
- and
- program code, operative to use a respective NLQ cluster for a function in the search engine.
Dependencies are inferred from the claim text.