Back to results
US 10,394,875 B2Granted
Document relationship analysis system
AssigneeVortext Analytics, Inc.
InventorsMatthew Cody Lambert, Peter Joseph Angerani, Gregory David Ostermayr
Life of this patent
Estimating the term…
Abstract
A document relationship analysis system. Aspects of the system include ingesting, discovering, recommending, analyzing, and exporting documents of interest. The system dynamically searches large or streaming datasets using a tiered, multi-step approach that includes discovery techniques and recommender components to filter and refine these larger datasets to smaller datasets of documents of interest. The system dynamically selects and renders an appropriate visualization for result datasets based on predetermined measures that allow for facilitate analysis of the documents of interest.
Claims13
A system for analyzing relationships between documents, the system comprising:
- a user interface;
- an ingest memory configured to store source documents retrieved from an external document source;
- a text index memory configured to store a text index;
- a cluster index memory configured to store document vectors associated with each source document;
- a text extraction pipeline automatically extracting text from source documents added to the ingest memory;
- a document vector calculator including a processor configured to automatically compute document vectors for source documents by applying term weights to the extracted text associated with the source document;
- an indexer automatically building an index of the extracted text and storing the text index in the text index memory;
- a dataset manager component generating a result dataset containing documents of interest from a target dataset containing selected source documents based on a query, wherein the dataset manager component further comprises a recommender component and discovery component;
- a relationship analyzer component automatically selecting a visualization model for clustering the documents of interest based the number of documents of interest in the result dataset and rendering the result set using selected visualization model in the user interface;
- a user property memory configured to store profile documents, wherein the document vector calculator automatically computes document vectors for profile documents added to the user property memory;
- a combined profile document vector generated from document vectors calculated for a plurality of profile documents selected for use in a query against a target dataset;
- and
- a result dataset generated by evaluating similarities between the combined profile document vector and the document vector calculated for each source document in the target dataset.
10 more elements
A method of analyzing relationships between documents, the method comprising the acts of:
- extracting text from source documents received from an external document source;
- storing the extracted text;
- creating an index of the extracted text;
- computing a document vector for each source document using the extracted text automatically when the extracted text is stored;
- storing the document vectors for each source document;
- receiving a selection of a plurality of source documents as a target dataset and parameters of a query via a user interface;
- generating a result dataset containing documents of interest from the target dataset based on the query;
- and
- automatically selecting a visualization model for clustering the documents of interest based the number of documents of interest in the result dataset and rendering the result set using selected visualization model in a user interface,
- wherein the act of extracting text from source documents received from an external document source further comprises the act of automatically routing each source document to a text extraction component selected from a plurality of text extraction components based on an evaluation of features of the source document against at least one scheduling parameter, and
- wherein the act of act of automatically routing each source document to a text extraction component further comprises the acts of:
- routing source documents having a file size less than a first size threshold to a small text file extraction component configured for extracting text from files with file sizes less than the first size threshold;
- routing source documents having a file size greater than a second size threshold to a large text file extraction component configured for extracting text from files with file sizes greater than the second size threshold;
- and
- routing source documents having a file size between the first size threshold and the second size threshold to either the small text file extraction component or the large text file extraction component based a weighted average of sizes of source documents having a file size between the first size threshold and the second size threshold.
12 more elements
A method of analyzing relationships between documents, the method comprising the acts of:
- extracting text from source documents received from an external document source;
- storing the extracted text;
- creating an index of the extracted text;
- computing a document vector for each source document using the extracted text automatically when the extracted text is stored;
- storing the document vectors for each source document;
- receiving a selection of a plurality of source documents as a target dataset and parameters of a query via a user interface;
- generating a result dataset containing documents of interest from the target dataset based on the query;
- automatically selecting a visualization model for clustering the documents of interest based the number of documents of interest in the result dataset and rendering the result set using selected visualization model in a user interface,
- extracting text from profile documents received from an external document source;
- storing the extracted text from the profile documents;
- computing a document vector for each profile document using the extracted text automatically when the extracted text is stored;
- computing a combined profile document vector from the profile document vectors of selected profile documents associated with a query;
- generating a result dataset by evaluating similarities between the combined profile document vector and the document vector calculated for each source document in the target dataset.
10 more elements
A computer readable medium containing computer executable instructions which, when executed by a computer, perform a method for analyzing relationships between documents, the method comprising the acts of:
- extracting text from source documents received from an external document source;
- storing the extracted text;
- creating an index of the extracted text;
- indexing the extracted text from each source document automatically when the extracted text is stored;
- storing the indexed text;
- computing a document vector for each source document using the extracted text automatically when the extracted text is stored;
- storing the document vectors for each source document;
- receiving a selection of a plurality of source documents as a target dataset and parameters of a query via a user interface;
- generating a result dataset containing documents of interest from the target dataset based on the query;
- automatically selecting a visualization model for clustering the documents of interest based the number of documents of interest in the result dataset and rendering the result set using selected visualization model in a user interface;
- extracting text from profiles documents received from an external document source;
- storing the extracted text from the profile documents;
- computing a document vector for each profile document using the extracted text automatically when the extracted text is stored;
- and
- generating a result dataset by evaluating similarities between each profile document vector and the document vector calculated for each source document in the target dataset.
12 more elements
Dependencies are inferred from the claim text.