Back to results
US 12,613,864 B2Granted
Using worker nodes to process results of a subquery
AssigneeCisco Technology, Inc.
InventorsSourav Pal, Arindam Bhattacharjee
Life of this patent
Estimating the term…
Abstract
Systems and methods are disclosed for executing a query that includes an indication to process data managed by an external data system. The system identifies the external data system that manages the data to be processed and generates a subquery for the external data system indicating that the results of the subquery are to be sent to one worker node of multiple worker nodes. The system instructs the one worker node to distribute the results received from the external data system to multiple worker nodes for processing.
Claims20
A computer-implemented method, comprising:
- receiving, at a data intake and query system including a search head, a query identifying a set of data to be processed and a manner of processing the set of data, wherein the data intake and query system comprises at least one computing device;
- determining that the set of data includes at least a first subset of data associated with an external data system;
- obtaining search configuration data from the external data system;
- determining a subquery for the external data system based on the search configuration data obtained from the external data system, the subquery identifying the first subset of data and a manner of processing the first subset of data;
- generating instructions for one or more worker nodes to receive and process results of the subquery to form first processed results and to provide the first processed results to the data intake and query system;
- communicating the subquery to the external data system using the one or more worker nodes,
- wherein at least one worker node communicates the subquery to the external data system,
- wherein the external data system processes the first subset of data based on the subquery and distributes the results of the subquery to the one or more worker nodes over a network, and
- wherein the one or more worker nodes process the results of the subquery based on the instructions;
- and
- receiving the first processed results from the external data system via the one or more worker nodes.
8 more elements
A computing system of a data intake and query system, the computing system comprising:
- memory;
- and
- one or more processing devices coupled to the memory and configured to:
- receive, at a data intake and query system including a search head, a query identifying a set of data to be processed and a manner of processing the set of data, wherein the data intake and query system comprises at least one computing device;
- determine that the set of data includes at least a first subset of data associated with an external data system;
- obtain search configuration data from the external data system;
- determine a subquery for the external data system based on the search configuration data obtained from the external data system, the subquery identifying the first subset of data and a manner of processing the first subset of data;
- generate instructions for one or more worker nodes to receive and process results of the subquery to form first processed results and to provide the first processed results to the data intake and query system;
- communicate the subquery to the external data system using the one or more worker nodes,
- wherein at least one worker node communicates the subquery to the external data system,
- wherein the external data system processes the first subset of data based on the subquery and distributes the results of the subquery to the one or more worker nodes over a network, and
- wherein the one or more worker nodes process the results of the subquery based on the instructions;
- and
- receive the first processed results from the external data system via the one or more worker nodes.
11 more elements
Non-transitory computer readable media comprising computer-executable instructions that, when executed by a computing system of a first data intake and query system, cause the computing system to:
- receive, at a data intake and query system including a search head, a query identifying a set of data to be processed and a manner of processing the set of data, wherein the data intake and query system comprises at least one computing device;
- determine that the set of data includes at least a first subset of data associated with an external data system;
- obtain search configuration data from the external data system;
- determine a subquery for the external data system based on the search configuration data obtained from the external data system, the subquery identifying the first subset of data and a manner of processing the first subset of data;
- generate instructions for one or more worker nodes to receive and process results of the subquery to form first processed results and to provide the first processed results to the data intake and query system;
- communicate the subquery to the external data system using the one or more worker nodes,
- wherein at least one worker node communicates the subquery to the external data system,
- wherein the external data system processes the first subset of data based on the subquery and distributes the results of the subquery to the one or more worker nodes over a network, and
- wherein the one or more worker nodes process the results of the subquery based on the instructions;
- and
- receive the first processed results from the external data system via the one or more worker nodes.
8 more elements
Dependencies are inferred from the claim text.