Generating and implementing local search engines over large databases

A computer program product for implementing a method for providing local search engines over large databases, the computer program product comprising one or more computer-readable storage media having stored thereon computer-executable instructions that, when executed by one or more processors of a computing system, cause the computing system to perform the method, the method comprising:

• receiving as inputs one or more data records stored in a database;
• parsing the data records into one or more file pairs that each include a keyword file and record ID file, each file pair implicitly forming a set of inverted lists from the keywords in the keyword file to add record IDs to the record ID file;
• merging a plurality of file pairs into a keyword file and a record ID file, the keyword file including keywords in sorted order, the record ID file including a list of record IDs for keywords in the keyword file;
• creating an offset file which stores offset values for starting addresses of record ID lists in the record ID file;
• generating an index of keywords by assigning unique identifiers to the keywords in the keyword file, the index allowing searches to return those keyword IDs that correspond to keywords that are sufficiently similar to a search term;
• and
• providing a query interface that allows the database's data records to be searched using the generated index of keywords.

At a computer system including at least a processor and memory, a computer-implemented method for providing local search engines over large databases, the method comprising:

• receiving as inputs one or more data records stored in a database;
• parsing the data records into one or more file pairs that each include a keyword file and record ID file, each file pair implicitly forming a set of inverted lists from the keywords in the keyword file to add record IDs to the record ID file;
• merging a plurality of file pairs into a keyword file and a record ID file, the keyword file including keywords in sorted order, the record ID file including a list of record IDs for keywords in the keyword file;
• creating an offset file which stores offset values for starting addresses of record ID lists in the record ID file;
• generating an index of keywords by assigning unique identifiers to the keywords in the keyword file, the index allowing searches to return those keyword IDs that correspond to keywords that are sufficiently similar to a search term;
• and
• providing a query interface that allows the database's data records to be searched using the generated index of keywords.