US 2026/0030232 A1 · IO Pipeline System SW/HW Overlay

Abstract

A database system including a query and response sub-system that includes pluralities of first computing nodes. A set of the first computing nodes implements an input/output (IO) pipeline compiler for a query regarding a dataset, wherein the IO pipeline compiler generates first instructions to create a plurality of IO pipelines for a plurality of segments and second instructions to create a pipeline IO control module. The database system further including a store and computing sub-system that includes a plurality of memory devices that store, in a long-term storage (LTS) format, the plurality of segments and a plurality of processing modules that execute the first instructions to produce the plurality of IO pipelines. The plurality of processing modules further executes the second instructions to produce the pipeline IO control module. The pipeline IO control module controls the plurality of IO pipelines retrieving and converting the plurality of segments from LTS format to a query ready raw data format.

Claims20

Dependent claims

A database system comprises:

a query and response sub-system that includes pluralities of first computing nodes, wherein a set of first computing nodes of the pluralities of first computing nodes is configured to implement an input/output (IO) pipeline compiler for a query regarding a dataset, wherein the IO pipeline compiler is operable to:
generate first instructions to create a plurality of IO pipelines for a plurality of segments of the dataset;
and
generate second instructions to create a pipeline IO control module;
and
a store and computing sub-system that includes:
a plurality of memory devices that stores, in a long-term storage (LTS) format, the plurality of segments of the dataset;
a plurality of processing modules operable to:
execute the first instructions to produce the plurality of IO pipelines;
execute the second instructions to produce the pipeline IO control module, wherein the pipeline IO control module is operable to:
control the plurality of IO pipelines retrieving the plurality of segments from the plurality of memory devices;
and
control the plurality of IO pipelines converting the plurality of segments from LTS format to a query ready raw data format.

10 more elements

A computer readable memory comprises:

a first memory that stores operational instructions that, when executed by a set of first computing nodes of pluralities of first computing nodes of a query and response sub-system, causes the set of first computing nodes to:
be configured to implement an input/output (IO) pipeline compiler for a query regarding a dataset,
a second memory that stores operational instructions that, when executed by the IO pipeline compiler, causes the IO pipeline compiler to:
generate first instructions to create a plurality of IO pipelines for a plurality of segments of the dataset;
and
generate second instructions to create a pipeline IO control module;
and
a third memory that stores operational instructions that, when executed by a plurality of processing modules of a store and computing sub-system, causes the plurality of processing modules to:
execute the first instructions to produce the plurality of IO pipelines;
execute the second instructions to produce the pipeline IO control module, wherein the pipeline IO control module is operable to:
control the plurality of IO pipelines retrieving the plurality of segments from a plurality of memory devices of the store and computing sub-system;
and
control the plurality of IO pipelines converting the plurality of segments from LTS format to a query ready raw data format.

10 more elements

Dependencies are inferred from the claim text.

IO Pipeline System SW/HW Overlay

Life of this patent

IO Pipeline System SW/HW Overlay

Life of this patent

Abstract

Claims20