Determining records generated by a processing task of a query
AssigneeSplunk Inc.
InventorsSourav Pal, Arindam Bhattacharjee, Asha Andrade
Life of this patent
Estimating the term…
Abstract
Systems and methods are described for determining a quantity of records generated by a processing task of a query executed in a data intake and query. The system receives a query and identifies a processing task of the query and a quantity of records to be processed according to the query. The system determines the number of records generated by the processing task based on the number of records to be processed and a record generation estimate. The system can allocate compute resources or determine a query execution time for at least a portion of the query based on the determined quantity of records generated.
Claims30
A method, comprising:
- receiving a query, wherein the query identifies a set of data and a manner of processing the set of data;
- identifying a processing task of the query and a quantity of records to be processed according to the processing task;
- determining a quantity of records generated by the processing task based on the quantity of records to be processed and a record generation estimate;
- and
- at least one of:
- allocating compute resources for at least a portion of the query based on the determined quantity of records generated by the processing task;
- or
- estimating a processing time for the at least a portion of the query based on the determined quantity of records generated by the processing task.
A computing system of a data intake and query system, the computing system comprising:
- memory;
- and
- one or more processing devices coupled to the memory and configured to:
- receive a query, wherein the query identifies a set of data and a manner of processing the set of data;
- identify a processing task of the query and a quantity of records to be processed according to the processing task;
- determine a quantity of records generated by the processing task based on the quantity of records to be processed and a record generation estimate;
- and
- at least one of:
- allocate compute resources for at least a portion of the query based on the determined quantity of records generated by the processing task;
- or
- estimate a processing time for the at least a portion of the query based on the determined quantity of records generated by the processing task.
Non-transitory computer-readable media comprising computer-executable instructions that, when executed by a computing system of a data intake and query system, cause the computing system to:
- receive a query, wherein the query identifies a set of data and a manner of processing the set of data;
- identify a processing task of the query and a quantity of records to be processed according to the processing task;
- determine a quantity of records generated by the processing task based on the quantity of records to be processed and a record generation estimate;
- and
- at least one of:
- allocate compute resources for at least a portion of the query based on the determined quantity of records generated by the processing task;
- or
- estimate a processing time for the at least a portion of the query based on the determined quantity of records generated by the processing task.
Dependencies are inferred from the claim text.