Back to results
US 8,266,077 B2Granted
Method of analyzing documents
AssigneeXerox Corporation
InventorJohn C. Handley
Life of this patent
Estimating the term…
Abstract
A method for analyzing documents is disclosed. The method compares concepts consisting of groups of terms for similarity within a corpus of document, clusters documents that contain certain concept term sets together. It may also rank the documents within each cluster according to the frequency of term co-occurrence within the concepts.
Claims20
A computerized method of analyzing a plurality of documents, comprising:
- collecting and filtering terms from a plurality of documents;
- identifying a term-frequency vector for each of the documents;
- identifying a term-frequency matrix using the term-frequency vector, wherein rows of the term-frequency matrix comprise values for the term-frequency vectors;
- projecting the term-frequency matrix onto a lower dimensional space using latent semantic analysis, to create a transformed term matrix;
- developing a correlation matrix comprising columns and rows corresponding to terms of the transformed term matrix, and a plurality of elements each having a correlation value indicating a statistical relationship exclusively between two of the terms;
- converting the correlation values to distance values;
- creating a concept graph of connected components using the distance values that are greater than or less than a concept threshold, where each connected component is a concept set of terms that corresponds to a concept;
- and
- clustering documents that contain the terms of the concept set together.
6 more elements
A computerized method of determining product problems from field service logs, comprising:
- collecting and filtering terms from a plurality of service logs;
- identifying a term-frequency vector for each of the logs;
- identifying a term-frequency matrix using the term-frequency vector, wherein rows of the term-frequency matrix comprise values for the term-frequency vectors;
- projecting the term-frequency matrix onto a lower dimensional space using latent semantic analysis, to create a transformed term matrix;
- determining a correlation matrix comprising columns and rows corresponding to terms of the transformed term matrix, and a plurality of elements each having a correlation value indicating a statistical relationship exclusively between two of the terms;
- converting the correlation values to distance values;
- creating a concept graph of connected components using the distance values that are greater than or less than a concept threshold, where each connected component comprises a concept set of terms that corresponds to a concept;
- clustering documents that contain terms of the concept set together;
- ranking logs in the documents that were clustered by frequency of occurrence of terms in the concept set.
6 more elements
A computerized method of analyzing a plurality of documents, comprising:
- collecting and filtering terms from a plurality of documents;
- identifying a term-frequency vector for each of the documents;
- identifying a term-frequency matrix using the term-frequency vector, wherein rows of the matrix comprise values for the term-frequency vectors;
- projecting the term-frequency matrix onto a lower dimensional space using latent semantic analysis, to create a transformed term matrix;
- developing a correlation matrix comprising columns and rows corresponding, to terms of the transformed term matrix, and a plurality of elements each having a correlation value indicating a statistical relationship exclusively between two of the terms;
- creating a dendrogram of related concepts using a function of the correlation matrix;
- identifying branches of the dendrogram corresponding to related concepts;
- and
- clustering documents that contain concept term sets together.
6 more elements
Dependencies are inferred from the claim text.