# US 12,001,855 B1 · Pack framework in an observability pipeline system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,001,855 B1
- Document ID: US12001855B1
- Status: Granted
- Kind: B1
- Application number: 17/746,527
- Filed: 2022-05-17
- Granted: 2024-06-04
- Earliest claimed: 2022-05-17
- Assignees: Cribl, Inc.
- Applicants: Cribl, Inc.
- Inventors: Dritan Bitincka; Ledion Bitincka; Nicholas Robert Romito
- Web page: https://patentgrep.com/patent/US12001855B1

## CPC

- G06F 9/44505: {Configuring for program initiating, e.g. using registry, configuration files}
- G06F 9/3867: {using instruction pipelines}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In a general aspect, an observability pipeline system includes a pack data processing engine. In some aspects, an observability pipeline system includes data processing engines that are configured according to system default configuration settings and system local configuration settings. A pack file received from a remote computer system contains routes, pipelines, and pack default configuration settings. A pack data processing engine includes the routes and pipelines from the pack file. Pack local configuration settings, defined for the pack data processing engine, inherit at least one of the system default configuration settings and at least one of the pack default configuration settings. The pack local configuration settings are isolated from the system local configuration settings. When pipeline data is processed in the observability pipeline system on the computer system, the pack data processing engine is applied to the pipeline data.

## Claims

### Claim 1

A method comprising:
operating an observability pipeline system on a computer system, wherein the observability pipeline system comprises:
a plurality of data processing engines;
system default configuration settings; and
system local configuration settings,
wherein the plurality of data processing engines are configured according to the system default configuration settings and the system local configuration settings;
at the computer system, receiving a pack file from a remote computer system, the pack file comprising routes, pipelines and pack default configuration settings;
importing the pack file in the observability pipeline system on the computer system;
defining a pack data processing engine in the observability pipeline system, the pack data processing engine comprising the routes and pipelines from the pack file;
defining pack local configuration settings for the pack data processing engine, wherein the pack local configuration settings incorporate at least one of the system default configuration settings and at least one of the pack default configuration settings, and the pack local configuration settings are isolated from the system local configuration settings; and
processing pipeline data in the observability pipeline system on the computer system, wherein processing the pipeline data comprises applying the pack data processing engine to the pipeline data.

### Claim 2 (depends on 1)

The method of claim 1, wherein the pack local configuration settings override at least one of the system default configuration settings and at least one of the pack default configuration settings.

### Claim 3 (depends on 1)

The method of claim 1, wherein applying the pack data processing engine to the pipeline data comprises:
routing input data to the respective pipelines according to the routes; and
generating structured output data from the input data by operation of the pipelines.

### Claim 4 (depends on 1)

The method of claim 1, wherein the plurality of data processing engines comprises a first data processing engine comprising a first route, and processing the pipeline data in the observability pipeline system comprises:
routing input data to the pack data processing engine according to the first route; and
applying the pack data processing engine to the input data.

### Claim 5 (depends on 4)

The method of claim 4, wherein the first route specifies a source and a destination, and processing the pipeline data in the observability pipeline system further comprises:
receiving the input data from the source;
generating structured output data by applying the pack data processing engine to the input data; and
applying output schemas to the structured output data to generate observability pipeline output data for the destination.

### Claim 6 (depends on 1)

The method of claim 1, wherein the pack file further comprises knowledge objects and sample data.

### Claim 7 (depends on 1)

The method of claim 1, wherein the pack file is a first pack file, the pack data processing engine is a first pack data processing engine, the pack default configuration settings are first pack default configuration settings, the pack local configuration settings are first pack local configuration settings, and the method comprises:
at the computer system, receiving a second pack file from another remote computer system, the second pack file comprising second pack default configuration settings;
importing the second pack file in the observability pipeline system on the computer system;
defining a second pack data processing engine in the observability pipeline system; and
defining second pack local configuration settings for the second pack data processing engine, wherein the second pack local configuration settings incorporate at least one of the system default configuration settings and at least one of the second pack default configuration settings, and the second pack local configuration settings are isolated from the system local configuration settings and the first pack local configuration settings.

### Claim 8

A computer system:
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
operating an observability pipeline system, wherein the observability pipeline system comprises:
a plurality of data processing engines;
system default configuration settings; and
system local configuration settings,
wherein the plurality of data processing engines are configured according to the system default configuration settings and the system local configuration settings;
receiving a pack file from a remote computer system, the pack file comprising routes, pipelines, and pack default configuration settings;
importing the pack file in the observability pipeline system;
defining a pack data processing engine in the observability pipeline system, the pack data processing engine comprising the routes and pipelines from the pack file;
defining pack local configuration settings for the pack data processing engine, wherein the pack local configuration settings incorporate at least one of the system default configuration settings and at least one of the pack default configuration settings, and the pack local configuration settings are isolated from the system local configuration settings; and
processing pipeline data in the observability pipeline system, wherein processing the pipeline data comprises applying the pack data processing engine to the pipeline data.

### Claim 9 (depends on 8)

The computer system of claim 8, wherein the pack local configuration settings override at least one of the system default configuration settings and at least one of the pack default configuration settings.

### Claim 10 (depends on 8)

The computer system of claim 8, wherein applying the pack data processing engine to the pipeline data comprises:
routing input data to the respective pipelines according to the routes; and
generating structured output data from the input data by operation of the pipelines.

### Claim 11 (depends on 8)

The computer system of claim 8, wherein the plurality of data processing engines comprises a first data processing engine comprising a first route, and processing the pipeline data in the observability pipeline system comprises:
routing input data to the pack data processing engine according to the first route; and
applying the pack data processing engine to the input data.

### Claim 12 (depends on 11)

The computer system of claim 11, wherein the first route specifies a source and a destination, and processing the pipeline data in the observability pipeline system further comprises:
receiving the input data from the source;
generating structured output data by applying the pack data processing engine to the input data; and
applying output schemas to the structured output data to generate observability pipeline output data for the destination.

### Claim 13 (depends on 8)

The computer system of claim 8, wherein the pack file further comprises knowledge objects and sample data.

### Claim 14 (depends on 8)

The computer system of claim 8, wherein the pack file is a first pack file, the pack data processing engine is a first pack data processing engine, the pack default configuration settings are first pack default configuration settings, the pack local configuration settings are first pack local configuration settings, and the operations comprise:
receiving a second pack file from another remote computer system, the second pack file comprising second pack default configuration settings;
importing the second pack file in the observability pipeline system on the computer system;
defining a second pack data processing engine in the observability pipeline system; and
defining second pack local configuration settings for the second pack data processing engine, wherein the second pack local configuration settings incorporate at least one of the system default configuration settings and at least one of the second pack default configuration settings, and the second pack local configuration settings are isolated from the system local configuration settings and the first pack local configuration settings.

### Claim 15

A non-transitory computer-readable medium comprising instructions that are operable when executed by data processing apparatus to perform operations comprising:
operating an observability pipeline system on a computer system, wherein the observability pipeline system comprises:
a plurality of data processing engines;
system default configuration settings; and
system local configuration settings,
wherein the plurality of data processing engines are configured according to the system default configuration settings and the system local configuration settings;
receiving a pack file from a remote computer system, the pack file comprising routes, pipelines, and pack default configuration settings;
importing the pack file in the observability pipeline system on the computer system;
defining a pack data processing engine in the observability pipeline system, the pack data processing engine comprising the routes and pipelines from the pack file;
defining pack local configuration settings for the pack data processing engine, wherein the pack local configuration settings incorporate at least one of the system default configuration settings and at least one of the pack default configuration settings, and the pack local configuration settings are isolated from the system local configuration settings; and
processing pipeline data in the observability pipeline system on the computer system, wherein processing the pipeline data comprises applying the pack data processing engine to the pipeline data.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the pack local configuration settings override at least one of the system default configuration settings and at least one of the pack default configuration settings.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein applying the pack data processing engine to the pipeline data comprises:
routing input data to the respective pipelines according to the routes; and
generating structured output data from the input data by operation of the pipelines.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the plurality of data processing engines comprises a first data processing engine comprising a first route, and processing the pipeline data in the observability pipeline system comprises:
routing input data to the pack data processing engine according to the first route; and
applying the pack data processing engine to the input data.

### Claim 19 (depends on 18)

The non-transitory computer-readable medium of claim 18, wherein the first route specifies a source and a destination, and processing the pipeline data in the observability pipeline system further comprises:
receiving the input data from the source;
generating structured output data by applying the pack data processing engine to the input data; and
applying output schemas to the structured output data to generate observability pipeline output data for the destination.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the pack file further comprises knowledge objects and sample data.

### Claim 21 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the pack file is a first pack file, the pack data processing engine is a first pack data processing engine, the pack default configuration settings are first pack default configuration settings, the pack local configuration settings are first pack local configuration settings, and the operations comprise:
receiving a second pack file from another remote computer system, the second pack file comprising second pack default configuration settings;
importing the second pack file in the observability pipeline system on the computer system;
defining a second pack data processing engine in the observability pipeline system; and
defining second pack local configuration settings for the second pack data processing engine, wherein the second pack local configuration settings incorporate at least one of the system default configuration settings and at least one of the second pack default configuration settings, and the second pack local configuration settings are isolated from the system local configuration settings and the first pack local configuration settings.