Query based dynamic partition allocation
AssigneeCisco Technology, Inc.
InventorsSourav Pal, Arindam Bhattacharjee, Kishore Reddy Ramasayam, Alexander Douglas James
Life of this patent
Estimating the term…
Abstract
Systems and methods are disclosed for processing and executing queries against one or more dataset sources, where the queries identify a set of data to be processed and a manner of processing the set of data. To query the dataset sources, a query coordinator generates a query processing scheme that includes a dynamic allocation of multiple layers of partitions. The query is then executed based on the query processing scheme.
Claims21
(canceled)
A method comprising:
- receiving, by a data intake and query system, a query identifying a set of data to be processed and a manner of processing the set of data;
- defining, by the data intake and query system, a query processing scheme, the query processing scheme including:
- first instructions to dynamically allocate a first subset of a set of processors to process the set of data based at least in part on the query identifying the manner of processing the set of data, wherein the set of data is associated with a plurality of dataset sources, and
- second instructions to dynamically allocate a second subset of the set of processors to output results of processing the set of data;
- and
- executing the query based at least in part on the query processing scheme.
A computing system, comprising:
- one or more processing devices configured to:
- receive a query identifying a set of data to be processed and a manner of processing the set of data;
- define, a query processing scheme, the query processing scheme including:
- first instructions to dynamically allocate a first subset of a set of processors to process the set of data based at least in part on the query identifying the manner of processing the set of data, wherein the set of data is associated with a plurality of dataset sources, and
- second instructions to dynamically allocate a second subset of the set of processors to output results of processing the set of data;
- and
- execute the query based at least in part on the query processing scheme.
Non-transitory computer readable media comprising computer-executable instructions that, when executed by a computing system, cause the computing system to:
- receive a query identifying a set of data to be processed and a manner of processing the set of data;
- define, a query processing scheme, the query processing scheme including:
- first instructions to dynamically allocate a first subset of a set of processors to process the set of data based at least in part on the query identifying the manner of processing the set of data, wherein the set of data is associated with a plurality of dataset sources, and
- second instructions to dynamically allocate a second subset of the set of processors to output results of processing the set of data;
- and
- execute the query based at least in part on the query processing scheme.
Dependencies are inferred from the claim text.