Low-Latency Data Management And Query Processing Cross-Optimizations

A method, comprising:

• ingesting data from one or more data sources directly into a low-latency memory buffer;
• responsive to ingesting the data, accessing the ingested data in the low-latency memory buffer to execute a query without requiring creation of a copy of the ingested data;
• and
• subsequent to executing the query, purging the ingested data from the low-latency memory buffer based on a recency of use of a dataset corresponding to the ingested data for query execution.

An apparatus, comprising:

• a memory storing instructions;
• and
• a processor configured to execute the instructions to:
• ingest data from one or more data sources directly into a low-latency memory buffer;
• execute, without requiring creation of a copy of the ingested data, a query using the ingested data accessed in the low-latency memory buffer;
• and
• purge the ingested data from the low-latency memory buffer based on a recency of use of a dataset corresponding to the ingested data for query execution.