# US 2025/0094469 A1 · Query based dynamic partition allocation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0094469 A1
- Document ID: US20250094469A1
- Status: Published application
- Kind: A1
- Application number: 18/942,065
- Filed: 2024-11-08
- Published: 2025-03-20
- Earliest claimed: 2016-09-26
- Assignees: Cisco Technology, Inc.
- Applicants: Cisco Technology, Inc.
- Inventors: Sourav Pal; Arindam Bhattacharjee; Kishore Reddy Ramasayam; Alexander Douglas James
- Web page: https://patentgrep.com/patent/US20250094469A1

## CPC

- G06F 16/335: Filtering based on additional data, e.g. user or group profiles (filtering in web context G06F16/9535, G06F16/9536)
- G06F 16/24535: {of sub-queries or views}
- G06F 16/2465: {Query processing support for facilitating data mining operations in structured databases}
- G06F 16/2471: {Distributed queries}
- G06F 16/26: Visual data mining; Browsing structured data
- G06F 16/328: {Management therefor}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods are disclosed for processing and executing queries against one or more dataset sources, where the queries identify a set of data to be processed and a manner of processing the set of data. To query the dataset sources, a query coordinator generates a query processing scheme that includes a dynamic allocation of multiple layers of partitions. The query is then executed based on the query processing scheme.

## Claims

### Claim 1

(canceled)

### Claim 2

A method comprising:
receiving, by a data intake and query system, a query identifying a set of data to be processed and a manner of processing the set of data;
defining, by the data intake and query system, a query processing scheme, the query processing scheme including:
first instructions to dynamically allocate a first subset of a set of processors to process the set of data based at least in part on the query identifying the manner of processing the set of data, wherein the set of data is associated with a plurality of dataset sources, and
second instructions to dynamically allocate a second subset of the set of processors to output results of processing the set of data; and
executing the query based at least in part on the query processing scheme.

### Claim 3 (depends on 2)

The method of claim 2, wherein the set of data is obtained at least in part by a third subset of the set of processors.

### Claim 4 (depends on 2)

The method of claim 2, wherein the query processing scheme further includes:
third instructions to dynamically allocate a third subset of the set of processors to obtain the set of data from the plurality of dataset sources.

### Claim 5 (depends on 2)

The method of claim 2, wherein the second instructions comprise instructions to dynamically allocate the second subset of the set of processors to output the results of processing the set of data to one or more processors of a dataset destination.

### Claim 6 (depends on 2)

The method of claim 2, wherein the query further identifies a dataset destination for storage of the results of processing the set of data.

### Claim 7 (depends on 2)

The method of claim 2, wherein the second instructions comprise instructions to dynamically allocate the second subset of the set of processors to output the results of processing the set of data to one or more first processors of a first dataset destination, wherein the query processing scheme further includes:
third instructions to dynamically allocate a third subset of the set of processors to output the results of processing the set of data to one or more second processors of a second dataset destination.

### Claim 8 (depends on 2)

The method of claim 2, wherein the second instructions comprise instructions to dynamically allocate at least two processors of the second subset of the set of processors to concurrently communicate a subset of the results of processing the set of data to a single processor associated with a dataset destination.

### Claim 9 (depends on 2)

The method of claim 2, further comprising:
determining one or more of a processing capability or a number of processors associated with a dataset destination, wherein defining the query processing scheme comprises defining the query processing scheme based at least in part on the one or more of the processing capability or the number of processors associated with the dataset destination, wherein the second instructions comprise instructions to dynamically allocate the second subset of the set of processors to output the results of processing the set of data to one or more processors of the dataset destination.

### Claim 10 (depends on 2)

The method of claim 2, wherein the second instructions comprise instructions to dynamically allocate the second subset of the set of processors to output the results of processing the set of data to one or more of an ingested data buffer, an external data source, or a query acceleration data store.

### Claim 11 (depends on 2)

The method of claim 2, wherein the second instructions comprise instructions to dynamically allocate the second subset of the set of processors to output the results of processing the set of data to one or more processors of a dataset destination, the method further comprising:
monitoring the dataset destination.

### Claim 12 (depends on 2)

The method of claim 2, wherein the second instructions comprise instructions to dynamically allocate the second subset of the set of processors to output the results of processing the set of data to one or more processors of a dataset destination, the method further comprising:
monitoring the dataset destination; and
updating the second subset of the set of processors based on monitoring the dataset destination.

### Claim 13 (depends on 2)

The method of claim 2, wherein defining the query processing scheme comprises:
defining the query processing scheme based on query requirements associated with the query, resources of the data intake and query system, and a dataset destination for output of the results of processing the set of data.

### Claim 14 (depends on 2)

The method of claim 2, wherein the set of processors comprises multiple layers of processors.

### Claim 15 (depends on 2)

The method of claim 2, wherein executing the query comprises:
generating instructions for execution by at least a portion of the set of processors based at least in part on the query processing scheme; and
communicating the instructions to the at least a portion of the set of processors.

### Claim 16 (depends on 2)

The method of claim 2, wherein executing the query comprises:
executing a first phase of the query using the first subset of the set of processors based at least in part on the query processing scheme; and
executing a second phase of the query using the second subset of the set of processors based at least in part on the query processing scheme.

### Claim 17 (depends on 2)

The method of claim 2, wherein defining the query processing scheme comprises:
generating directed acyclic graph instructions.

### Claim 18

A computing system, comprising:
one or more processing devices configured to:
receive a query identifying a set of data to be processed and a manner of processing the set of data;
define, a query processing scheme, the query processing scheme including:
first instructions to dynamically allocate a first subset of a set of processors to process the set of data based at least in part on the query identifying the manner of processing the set of data, wherein the set of data is associated with a plurality of dataset sources, and
second instructions to dynamically allocate a second subset of the set of processors to output results of processing the set of data; and
execute the query based at least in part on the query processing scheme.

### Claim 19 (depends on 18)

The computing system of claim 18, wherein the query processing scheme further includes:
third instructions to dynamically allocate a third subset of the set of processors to obtain the set of data from the plurality of dataset sources.

### Claim 20

Non-transitory computer readable media comprising computer-executable instructions that, when executed by a computing system, cause the computing system to:
receive a query identifying a set of data to be processed and a manner of processing the set of data;
define, a query processing scheme, the query processing scheme including:
first instructions to dynamically allocate a first subset of a set of processors to process the set of data based at least in part on the query identifying the manner of processing the set of data, wherein the set of data is associated with a plurality of dataset sources, and
second instructions to dynamically allocate a second subset of the set of processors to output results of processing the set of data; and
execute the query based at least in part on the query processing scheme.

### Claim 21 (depends on 20)

The non-transitory computer readable media of claim 20, wherein the second instructions comprise instructions to dynamically allocate the second subset of the set of processors to output the results of processing the set of data to one or more processors of a dataset destination.
