Multi-partitioning determination for combination operations
AssigneeSplunk Inc.
InventorsArindam Bhattacharjee, Sourav Pal, Christopher Pride
Life of this patent
Estimating the term…
Abstract
Systems and methods are disclosed for processing and executing queries against one or more dataset. As part of processing the query, the system determines whether the query is susceptible to a significantly imbalanced partition. In the event, the query is susceptible to an imbalanced partition, the system monitors the query and determines whether to perform a multi-partitioning determination to avoid a significantly imbalanced partition.
Claims30
A method comprising:
- determining that a query associated with a first dataset and a second dataset is susceptible to generating a significantly imbalanced partition;
- monitoring execution of the query;
- and
- performing, based on the monitoring, a multi-partition operation on a first group of data entries of the first dataset and a second group of data entries of the second dataset.
A computing system, comprising:
- one or more processing devices configured to:
- determine that a query associated with a first dataset and a second dataset is susceptible to generating a significantly imbalanced partition;
- monitor execution of the query;
- and
- perform, based on the monitoring, a multi-partition operation on a first group of data entries of the first dataset and a second group of data entries of the second dataset.
Non-transitory computer readable media comprising computer-executable instructions that, when executed by a computing system, cause the computing system to:
- determine that a query associated with a first dataset and a second dataset is susceptible to generating a significantly imbalanced partition;
- monitor execution of the query;
- and
- perform, based on the monitoring, a multi-partition operation on a first group of data entries of the first dataset and a second group of data entries of the second dataset.
Dependencies are inferred from the claim text.