System and method for thematically grouping documents into clusters
AssigneeFTI Technology LLC
InventorsDan Gallivan, Kenji Kawai
Life of this patent
Estimating the term…
Abstract
A system and method for thematically grouping documents into clusters is provided. Concepts are extracted from a plurality of documents. The concepts include nouns or noun phrases. A number of occurrences for each concept are determined within each document. A bounded range is applied to the concepts and a subset of the concepts is selected by removing the concepts that fall outside the bounded range. The bounded range includes upper edge conditions and lower edge conditions. Themes are generated from the subset of concepts by identifying two or more concepts with common semantic meaning. Clusters of the documents are generated based on the themes.
Claims20
A system for thematically grouping documents into clusters, comprising:
- an extraction module to extract from a plurality of documents, concepts comprising at least one of nouns and noun phrases;
- a frequency determination module to determine a number of occurrences for each concept within each document;
- a threshold module to select the documents having the concepts with the occurrences that satisfy a bounded range comprising upper edge conditions and lower edge conditions;
- a theme generator module to generate themes for the selected documents from the subset of concepts by identifying two or more concepts with common semantic meaning;
- and
- a cluster module to generate clusters of the selected documents based on the themes;
- and
- a processor to execute the modules.
A method for thematically grouping documents into clusters, comprising the steps of:
- extracting from a plurality of documents, concepts comprising at least one of nouns and noun phrases;
- determining a number of occurrences for each concept within each document;
- selecting the documents having the concepts with the occurrences that satisfy a bounded range comprising upper edge conditions and lower edge conditions;
- generating themes for the selected documents from the subset of concepts by identifying two or more concepts with common semantic meaning;
- and
- generating clusters of the selected documents based on the themes,
- wherein the steps are performed by a suitably programmed computer.
Dependencies are inferred from the claim text.