# US 2019/0171678 A1 · Search functionality of worker nodes in a data fabric service system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171678 A1
- Document ID: US20190171678A1
- Status: Published application
- Kind: A1
- Application number: 16/264,462
- Filed: 2019-01-31
- Published: 2019-06-06
- Earliest claimed: 2016-09-26
- Assignees: Splunk Inc.
- Applicants: Splunk Inc.
- Inventors: Sourav Pal; Christopher Pride; Arindam Bhattacharjee; Xiaowei Wang; James Alasdair Robert Hodge; Mustafa Ahamed
- Web page: https://patentgrep.com/patent/US20190171678A1

## CPC

- G06F 16/951: Indexing; Web crawling techniques
- G06F 16/211: {Schema design and management}
- G06F 16/212: {with details for data modelling support}
- G06F 16/2455: Query execution
- G06F 16/2471: {Distributed queries}
- G06F 16/248: Presentation of query results
- G06F 16/252: {between a Database Management System and a front-end application}
- G06F 16/258: {Data format conversion from or to a database}
- G06F 16/27: Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F 16/9024: {Graphs; Linked lists (G06F16/9027 takes precedence)}
- G06F 16/90335: {Query processing}
- G06F 16/9038: Presentation of query results
- G06F 16/904: Browsing; Visualisation therefor (for navigating the web G06F16/954; browsing optimisation for the web G06F16/957)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Disclosed is a technique that can be performed in a distributed computer network. The technique can include a worker node that receives search instructions defined by a search service based on at least a portion of a search scheme defined by a data intake and query system, to cause the worker node to obtain search results from distributed data storage systems communicatively coupled to the worker node over a network. The distributed data storage systems include an external data storage system and/or an internal data storage system of the data intake and query system. The worker node obtains the search results by searching the distributed data storage systems in accordance with the search instructions, and communicating, over the network to the search service, a combination of search results based on the search results to cause an output by the data intake and query system in accordance with the search scheme.

## Claims

### Claim 1

A method comprising:
receiving, by a worker node, search instructions defined by a search service based on at least a portion of a search scheme defined by a data intake and query system, to cause the worker node to obtain a plurality of search results from a plurality of distributed data storage systems communicatively coupled to the worker node over a network, the plurality of distributed data storage systems including at least one of an external data storage system or an internal data storage system of the data intake and query system;
obtaining, by the worker node, the plurality of search results by searching the plurality of distributed data storage systems in accordance with the search instructions; and
communicating, by the worker node over the network to the search service, a combination of search results based on the plurality of search results to cause an output by the data intake and query system in accordance with the search scheme.

### Claim 2 (depends on 1)

The method of claim 1, wherein the search instructions are based on only a portion of the search scheme defined by the data intake and query system.

### Claim 3 (depends on 1)

The method of claim 1, wherein the plurality of search results is obtained from the external data storage system and the internal data storage system of the data intake and query system.

### Claim 4 (depends on 1)

The method of claim 1, wherein at least some of the plurality of search results are time-ordered events retrieved from the internal data storage system, each time-ordered event including a segment of raw machine data and an associated timestamp.

### Claim 5 (depends on 1)

The method of claim 1, wherein the combination of search results is derived from the plurality of search results obtained from the external data storage system and the internal data storage system of the data intake and query system.

### Claim 6 (depends on 1)

The method of claim 1 further comprising, prior to communicating the combination of search results to the search service:
producing, by the worker node, the combination of search results based on the plurality of search results of the plurality of distributed data storage systems, wherein the combination of search results includes a plurality of time-ordered events.

### Claim 7 (depends on 1)

The method of claim 1 further comprising, prior to communicating the combination of search results to the search service:
producing, by the worker node, the combination of search results by aggregating the plurality of search results of the plurality of distributed data storage systems.

### Claim 8 (depends on 1)

The method of claim 1, wherein the combination of search results includes structured data retrieved from the external data storage system.

### Claim 9 (depends on 1)

The method of claim 1, wherein the combination of search results includes unstructured data retrieved from the internal data storage system.

### Claim 10 (depends on 1)

The method of claim 1, wherein the combination of search results is in a format specified by the search scheme.

### Claim 11 (depends on 1)

The method of claim 1 further comprising, prior to communicating the combination of search results to the search service:
producing, by the worker node, the combination of search results based on structured data retrieved from the external data storage system and unstructured data retrieved from the internal data storage system.

### Claim 12 (depends on 1)

The method of claim 1, wherein the combination of search results includes data retrieved in parallel from peer indexers of the internal data storage system.

### Claim 13 (depends on 1)

The method of claim 1, wherein a device distinct from, and communicatively coupled to, the data intake and query system implements the search service over the network.

### Claim 14 (depends on 1)

The method of claim 1, wherein the data intake and query system implements the search service.

### Claim 15 (depends on 1)

The method of claim 1 further comprising:
causing the combination of search results or data indicative of the combination of search results to be displayed on a display device.

### Claim 16 (depends on 1)

The method of claim 1, further comprising:
causing the output to be rendered on a display device in a timeline visualization.

### Claim 17 (depends on 1)

The method of claim 1, wherein the search instructions are based on user input expressed in a pipelined language.

### Claim 18 (depends on 1)

The method of claim 1, wherein the search instructions are based on user input expressed in a structured language.

### Claim 19 (depends on 1)

The method of claim 1, wherein obtaining the plurality of search results from the plurality of distributed data storage systems comprises:
collecting, by the worker node over the network, at least some of the plurality of search results from the external data storage system; and
collecting, by the worker node over the network, at least some of the plurality of search results from the internal data storage system.

### Claim 20 (depends on 1)

The method of claim 1 further comprising:
producing, by the worker node, a plurality of aggregate search results from a first plurality of search results of the external data storage system and a second plurality of search results of the internal data storage system.

### Claim 21 (depends on 1)

The method of claim 1, wherein at least some of the plurality of search results of the internal data storage system are formatted as a plurality of time-indexed events, each time-indexed event including a segment of raw machine data and an associated timestamp.

### Claim 22 (depends on 1)

The method of claim 1, wherein the plurality of search results includes a first plurality of search results of the internal data storage system in a first format as time-indexed events including raw data and includes a second plurality of search results of the external data storage system in a second format different from the first format, and the combination of search results is in a format specified by the search scheme.

### Claim 23 (depends on 1)

The method of claim 1 further comprising, prior to communicating the combination of search results to the search service:
combining, by the worker node, a first plurality of search results of the external data storage system with a second plurality of search results of the internal data storage system.

### Claim 24 (depends on 1)

The method of claim 1 further comprising, prior to communicating the combination of search results to the search service
combining, by the worker node, a first plurality of search results of the external data storage system with a second plurality of search results of the internal data storage system in an arrangement of time-ordered events.

### Claim 25 (depends on 1)

The method of claim 1 further comprising, prior to communicating the combination of search results to the search service
deriving, by the worker node, the combination of search results by performing an operation on a first plurality of search results of the external data storage system and a second plurality of search results of the internal data storage system.

### Claim 26 (depends on 1)

The method of claim 1, wherein obtaining the plurality of search results further comprises:
obtaining, by the worker node, a second plurality of search results extracted from another external data storage system by another worker node, wherein the combination of search results is based on the first plurality of search results and the second plurality of search results.

### Claim 27 (depends on 1)

The method of claim 1, wherein the worker node is a first worker node, the plurality of search results includes a first plurality of search results of a first external data storage system, and obtaining the plurality of search results further comprises:
obtaining, by the first worker node, a second plurality of search results extracted from a second external data storage system by a second worker node, the second worker node being communicatively coupled over the network to the second external data storage system, wherein the combination of search results is based on the first plurality of search results and the second plurality of search results.

### Claim 28 (depends on 1)

The method of claim 1, wherein the worker node is a first worker node, the plurality of search results includes a first plurality of search results of a first external data storage system and a second plurality of search results of the internal data storage system, and obtaining the plurality of search results further comprises:
collecting, by the first worker node, a third plurality of search results extracted from a second external data storage system by a second worker node, the second worker node being communicatively coupled over the network to the second external data storage system; and
sending, by the first worker node over the network, at least a portion of the first plurality of search results to the second worker node, wherein the combination of search results is based on the first plurality of search results, the second plurality of search results, and the third plurality of search results.

### Claim 29

A worker node of data fabric system, the worker node comprising:
a processor; and
a memory having instructions executable by the processor to cause the worker node to:
receive search instructions defined by a search service based on at least a portion of a search scheme defined by a data intake and query system, to cause the worker node to obtain a plurality of search results from a plurality of distributed data storage systems communicatively coupled to the worker node over a network, the plurality of distributed data storage systems including at least one of an external data storage system or an internal data storage system of the data intake and query system;
obtain the plurality of search results by searching the plurality of distributed data storage systems in accordance with the search instructions; and
communicate, over the network to the search service, a combination of search results based on the plurality of search results to cause an output by the data intake and query system in accordance with the search scheme.

### Claim 30

A non-transitory storage medium storing program instructions, execution of which in a worker node of a data fabric system causes actions comprising:
receiving search instructions defined by a search service based on at least a portion of a search scheme defined by a data intake and query system, to cause the worker node to obtain a plurality of search results from a plurality of distributed data storage systems communicatively coupled to the worker node over a network, the plurality of distributed data storage systems including at least one of an external data storage system or an internal data storage system of the data intake and query system;
obtaining the plurality of search results by searching the plurality of distributed data storage systems in accordance with the search instructions; and
communicating, over the network to the search service, a combination of search results based on the plurality of search results to cause an output by the data intake and query system in accordance with the search scheme.
