Servicing queries during data ingress

A database system comprises:

• a set of memory resources;
• at least one processor;
• and
• a memory that stores operational instructions that, when executed by the at least one processor, cause the database system to:
• receive an initial set of records to be processed for long-term storage;
• based on receiving the initial set of records to be processed for long-term storage, temporarily store the initial set of records in the set of memory resources of a temporary ingress storage system during a first temporal period corresponding to a data ingress process;
• receive a query for processing during the first temporal period;
• generate a query resultant by facilitating execution of the query, wherein the query resultant is generated based on processing a filtered set of records that includes only a proper subset of the initial set of records based on accessing the proper subset of the initial set of records in at least one memory resource of the set of memory resources during the first temporal period based on filtering parameters of the query;
• send the query resultant to an entity that is distinct from a long-term storage system;
• based on receiving the initial set of records and storing the initial set of records in the set of memory resources, process the initial set of records during the first temporal period to generate a set of segments for long-term storage that includes all of the initial set of records received to be processed for long-term storage;
• facilitate migration of all of the initial set of records from the temporary ingress storage system to the long-term storage system for storage during a second temporal period that begins after the first temporal period has elapsed by sending the set of segments to the long-term storage system;
• receive a second set of records to be processed for long-term storage during the second temporal period, wherein the second set of records is distinct from the initial set of records;
• temporarily store the second set of records in the set of memory resources during the second temporal period based on receiving the second set of records to be processed for long-term storage;
• and
• generate a second query resultant by facilitating execution of the second query, wherein the second query resultant is based on processing only a second filtered set of records that includes, based on second filtering parameters of the second query, only a second proper subset of the initial set of records and only a first proper subset of the second set of records based on accessing the second proper subset of the initial set of records in the long-term storage system during the second temporal period and based on further accessing the first proper subset of the second set of records in the set of memory resources during the second temporal period.

A non-transitory computer readable storage medium comprises:

• at least one memory section that stores operational instructions that, when executed by a processing module that includes a processor and a memory, causes the processing module to:
• receive an initial set of records to be processed for long-term storage;
• based on receiving the initial set of records to be processed for long-term storage, temporarily store the initial set of records in a set of memory resources during a first temporal period corresponding to a data ingress process;
• receive a query for processing during the first temporal period;
• generate a query resultant by facilitating execution of the query, wherein the query resultant is generated based on processing a filtered set of records that includes only a proper subset of the initial set of records based on accessing the proper subset of the initial set of records in at least one memory resource of the set of memory resources during the first temporal period based on filtering parameters of the query;
• send the query resultant to an entity that is distinct from a long-term storage system;
• based on receiving the initial set of records and storing the initial set of records in the set of memory resources, process the initial set of records during the first temporal period to generate a set of segments for long-term storage that includes all of the initial set of records received to be processed for long-term storage;
• facilitate migration of all of the initial set of records to the long-term storage system for storage during a second temporal period that begins after the first temporal period has elapsed by sending the set of segments to the long-term storage system;
• receive a second set of records to be processed for long-term storage during the second temporal period, wherein the second set of records is distinct from the initial set of records;
• temporarily store the second set of records in the set of memory resources during the second temporal period based on receiving the second set of records to be processed for long-term storage;
• and
• generate a second query resultant by facilitating execution of the second query, wherein the second query resultant is based on processing only a second filtered set of records that includes, based on second filtering parameters of the second query, only a second proper subset of the initial set of records and only a first proper subset of the second set of records based on accessing the second proper subset of the initial set of records in the long-term storage system during the second temporal period and based on further accessing the first proper subset of the second set of records in the set of memory resources during the second temporal period.