Processor for fast contextual matching
AssigneeSAP America, Inc.
InventorsRamana B. Rao, Swapnil Hajela, Nareshkumar Rajkumar
Life of this patent
Estimating the term…
Abstract
Words having selected characteristics in a corpus of documents are found using a data processor arranged to execute queries. Memory stores an index structure in which entries in the index structure map words and marks for words having the selected characteristics to locations within documents in the corpus. Entries in the index structure represent words and other entries represent marks with the location information of a marked word. The entries for the marks can be tokens coalesced with prefixes of respective marked words or adjacent. A query processor forms a modified query by adding a mark for a word to the query. The processor executes the modified query.
Claims21
An article of manufacture for use with a data processor for finding information in a corpus of documents, comprising:
- a non-transitory machine readable data storage medium including executable instructions to:
- identify selected words in the corpus of documents;
- for a designated selected word, form a contextual derivation of the selected word including a contextual term associated with the selected word and a character from the selected word;
- define a dictionary including stopwords, unique words and a contextual derivation associated with the corpus of documents;
- form a contextual derivation query from a character of a marked word in a query and a contextual term associated with the marked word;
- and
- apply the contextual derivation query to the dictionary to identify a match.
A method for finding information in a corpus of documents, the method being implemented by one or more data processors and comprising:
- identifying, by at least one data processor, selected words in the corpus of documents;
- for a designated selected word, forming, by at least one data processor, a contextual derivation of the selected word including a contextual term associated with the selected word and a character from the selected word;
- defining, by at least one data processor, a dictionary including stopwords, unique words and a contextual derivation associated with the corpus of documents;
- forming, by at least one data processor, a contextual derivation query from a character of a marked word in a query and a contextual term associated with the marked word;
- and
- applying, by at least one data processor, the contextual derivation query to the dictionary to identify a match.
An apparatus for finding information in a corpus of documents comprising:
- at least one data processor;
- and
- memory coupled to the at least one data processor, the memory storing instructions, which when executed, cause the at least one data processor to:
- identify selected words in the corpus of documents;
- for a designated selected word, form a contextual derivation of the selected word including a contextual term associated with the selected word and a character from the selected word;
- define a dictionary including stopwords, unique words and a contextual derivation associated with the corpus of documents;
- form a contextual derivation query from a character of a marked word in a query and a contextual term associated with the marked word;
- and
- apply the contextual derivation query to the dictionary to identify a match.
Dependencies are inferred from the claim text.