Statistical natural language processing algorithm for use with massively parallel relational database management system
AssigneeThe Greentree Group
InventorJonathon Mitchell
Life of this patent
Estimating the term…
Abstract
A methodology and processing model utilize a unique set of data structures and processing algorithms, which are capable of being leveraged on a Massively Parallel Relational Database Management System (RDBMS) to provide fast, accurate, and scalable access to text data that is stored in these data structures. The methodology relies on a positional co-occurrence-based Statistical Natural Language Processing (SNLP) algorithm, a set of data structures that define the data to be searched and contain the co-occurrence patterns that are created by the SNLP algorithm, a real-time relevancy formula and weighting structure that returns the most relevant documents to the user.
Claims38
A method for identifying a co-occurrence pattern in a text collection, comprising:
- identifying a combination of terms found in at least one of a plurality of documents in a text collection;
- and
- calculating co-occurrences of the combination of terms at each of a plurality of positional variances between the combination of terms.
A method for processing a query, comprising:
- calculating a plurality of term variances for at least one term combination associated with a query, wherein each term variance is associated with a specific positional variance between the term combination;
- generating a query set based upon the plurality of calculated term variances;
- and
- querying a text collection using the generated query set.
A method for processing a query, comprising:
- selecting, for at least one term combination associated with a query, at least one positional variance between the terms in the term combination, based upon a co-occurrence of the terms in the term combination in a text collection at the positional variance;
- and
- querying the text collection to identify documents in the text collection having the terms in the term combination at the selected positional variance.
An apparatus, comprising:
- a computer readable medium;
- and
- program code resident in the computer readable medium and configured to identify a co-occurrence pattern in a text collection by identifying a combination of terms found in at least one of a plurality of documents in the text collection and calculating co-occurrences of the combination of terms at each of a plurality of positional variances between the combination of terms.
An apparatus, comprising:
- a computer readable medium;
- and
- program code resident in the computer readable medium and configured to process a query by calculating a plurality of term variances for at least one term combination associated with a query, generating a query set based upon the plurality of calculated term variances, and querying a text collection using the generated query set, wherein each term variance is associated with a specific positional variance between the term combination.
Dependencies are inferred from the claim text.