Multi-partitioning determination for combination operations
AssigneeSplunk Inc.
InventorsArindam Bhattacharjee, Sourav Pal, Christopher Pride
Life of this patent
Estimating the term…
Abstract
Systems and methods are disclosed for processing and executing queries against one or more dataset. As part of processing the query, the system determines whether the query is susceptible to a significantly imbalanced partition. In the event, the query is susceptible to an imbalanced partition, the system monitors the query and determines whether to perform a multi-partitioning determination to avoid a significantly imbalanced partition.
Claims30
A method comprising:
- determining, based on syntax of a search query associated with a first dataset and a second dataset, that the search query is susceptible to generating a first partition that includes more data entries than a second partition;
- based on the determining, monitoring execution of the search query;
- and
- performing, based on the monitoring, a multi-partition operation on a first group of data entries of the first dataset and a second group of data entries of the second dataset.
A computing system, comprising:
- a memory;
- one or more processors configured to:
- determine, based on syntax of a search query associated with a first dataset and a second dataset, that the search query is susceptible to generating a first partition that includes more data entries than a second partition;
- based on a determination that the search query is susceptible to generating a first partition that includes more data entries than a second partition, monitor execution of the search query;
- and
- perform, based on a result of monitoring execution of the search query, a multi-partition operation on a first group of data entries of the first dataset and a second group of data entries of the second dataset.
Non-transitory computer readable media comprising computer-executable instructions that, when executed by a computing system, cause the computing system to:
- determine, based on syntax of a search query associated with a first dataset and a second dataset, that the search query is susceptible to generating a first partition that includes more data entries than a second partition;
- based on a determination that the search query is susceptible to generating a first partition that includes more data entries than a second partition, monitor execution of the search query;
- and
- perform, based on a result of monitoring execution of the search query, a multi-partition operation on a first group of data entries of the first dataset and a second group of data entries of the second dataset.
Dependencies are inferred from the claim text.