Movement of stored data utilizing sizes of indexes in an indexing data structure

A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device:

• to obtain data from a plurality of data sources in an enterprise system, the obtained data being associated with an n-gram indexing data structure;
• to store at least a portion of the obtained data from the plurality of data sources in a first storage having a first set of read and write access times, the stored data comprising one or more n-gram strings;
• to estimate frequencies of occurrence of respective one of the one or more n-gram strings in the stored data, the estimated frequency of occurrence of a given n-gram string being based at least in part on a size of a given n-gram index in the n-gram indexing data structure corresponding to the given n-gram string;
• in response to detecting one or more designated conditions, to select a portion of the stored data based at least in part on the estimated frequencies of occurrence of the one or more n-gram strings;
• and
• to move the selected portion of the stored data from the first storage having the first set of read and write access times to a second storage having a second set of read and write access times slower than the first set of read and write access times.

An apparatus comprising:

• at least one processing device comprising a processor coupled to a memory;
• the at least one processing device being configured:
• to obtain data from a plurality of data sources in an enterprise system, the obtained data being associated with an n-gram indexing data structure;
• to store at least a portion of the obtained data from the plurality of data sources in a first storage having a first set of read and write access times, the stored data comprising one or more n-gram strings;
• to estimate frequencies of occurrence of respective one of the one or more n-gram strings in the stored data, the estimated frequency of occurrence of a given n-gram string being based at least in part on a size of a given n-gram index in the n-gram indexing data structure corresponding to the given n-gram string;
• in response to detecting one or more designated conditions, to select a portion of the stored data based at least in part on the estimated frequencies of occurrence of the one or more n-gram strings;
• and
• to move the selected portion of the stored data from the first storage having the first set of read and write access times to a second storage having a second set of read and write access times slower than the first set of read and write access times.