Virtual segment parallelism in a database system and methods for use therewith

A node of a computing device comprising:

• at least one processor;
• and
• memory that stores executable instructions that, when executed by the at least one processor, cause at least one processing module of the node to:
• response to receiving a query from a computing device via a network:
• determine the query for execution over a plurality of time windows;
• select a set of segments required to execute the query;
• and
• process the set of segments over the plurality of time windows to generate a result of the query based on:
• processing a first proper subset of the set of segments that correspond to physical segments by retrieving segments of the first proper subset of the set of segments from a set of memory drives based on utilization data of the set of memory drives for each time window of the plurality of time windows;
• processing a second proper subset of the set of segments that correspond to virtual segments based on locally rebuilding segments in the second proper subset of the set of segments by utilizing a recovery scheme based on a corresponding plurality of physical segments retrieved from another set of nodes:
• selecting a third proper subset of the set of segments that includes at least one segment of the rebuilt segments in the second proper subset for processing in parallel in a first time window of the plurality of time windows;
• processing the selected third proper subset of the set of segments within the first time window to generate a first partial result of the query by executing a first partial execution of the query based on utilizing a corresponding set of parallel threads of a segment processing module of the node, wherein each segment of the third proper subset of the set of segments is processed by utilizing parallel thread of the corresponding set of parallel threads;
• selecting a fourth proper subset of the set of segments that includes other at least one segment of the rebuilt segments in the second proper subset for processing in parallel in a second time window of the plurality of time windows, wherein the first time window and the second time window have a null overlap;
• and
• processing the selected fourth proper subset of the set of segments that includes the other at least one segment of the rebuilt segments in the second proper subset of the set of segments within the second time window to generate a second partial result of the query by executing a second partial execution of the query based on utilizing another corresponding set of parallel threads of the segment processing module;
• wherein the result of the query includes the first partial result and the second partial result.

A non-transitory computer readable storage medium comprises:

• at least one memory section that stores operational instructions that, when executed by a processing module that includes a processor and a memory, causes the processing module to:
• response to receiving a query from a computing device via a network:
• determine the query for execution over a plurality of time windows;
• select a set of segments required to execute the query;
• and
• process the set of segments over the plurality of time windows to generate a result of the query based on:
• processing a first proper subset of the set of segments that correspond to physical segments by retrieving segments of the first proper subset of the set of segments from a set of memory drives based on utilization data of the set of memory drives for each time window of the plurality of time windows;
• processing a second proper subset of the set of segments that correspond to virtual segments based on locally rebuilding segments in the second proper subset of the set of segments by utilizing a recovery scheme upon a corresponding plurality of physical segments retrieved from another set of nodes;
• selecting a third proper subset of the set of segments that includes at least one segment of the rebuilt segments in the second proper subset for processing in parallel in a first time window of the plurality of time windows;
• processing the selected third proper subset of the set of segments within the first time window to generate a first partial result of the query by executing a first partial execution of the query based on utilizing a corresponding set of parallel threads of a segment processing module of the node, wherein each segment of the third proper subset of the set of segments is processed by utilizing en-e a parallel thread of the corresponding set of parallel threads;
• selecting a fourth proper subset of the set of segments that includes other at least one segment of the rebuilt segments in the second proper subset for processing in parallel in a second time window of the plurality of time windows, wherein the first time window and the second time window have a null overlap;
• and
• processing the selected fourth proper subset of the set of segments that includes the other at least one segment of the rebuilt segments in the second proper subset within the second time window to generate a second partial result of the query by executing a second partial execution of the query based on utilizing another corresponding set of parallel threads of the segment processing module;
• wherein the result of the query includes the first partial result and the second partial result.