Metadata search via N-gram index

A system comprising:

• at least one hardware processor;
• and
• at least one memory storing instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform operations comprising:
• storing a log associated with an operation performed on a source table;
• creating or updating an index record for a N-Gram index associated with the source table to generate a new version of the N-Gram index based on the log using a background process;
• receiving, from a user, a search request including a search string;
• and
• in response to the search request, processing the search request by performing steps including:
• loading, in a log cache, log data associated with new logs not yet reflected in the N-Gram index;
• retrieving index records matching the search string;
• storing the matched index records in an index cache;
• merging the log data in the log cache with the matched index records in the index cache to generate merged data;
• and
• generating results of the search request based on the merged data, wherein processing the search request is a separate process than the background process used for updating the new logs in the N-gram index.

A machine-storage medium embodying instructions that, when executed by a machine, cause the machine to perform operations comprising:

• storing a log associated with an operation performed on a source table;
• creating or updating an index record for a N-Gram index associated with the source table to generate a new version of the N-Gram index based on the log using a background process;
• receiving, from a user, a search request including a search string;
• and
• in response to the search request, processing the search request by performing steps including:
• loading, in a log cache, log data associated with new logs not yet reflected in the N-Gram index;
• retrieving index records matching the search string;
• storing the matched index records in an index cache;
• merging the log data in the log cache with the matched index records in the index cache to generate merged data;
• and
• generating results of the search request based on the merged data, wherein processing the search request is a separate process than the background process used for updating the new logs in the N-gram index.