# US 2021/0334189 A1 · Progressive error handling

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0334189 A1
- Document ID: US20210334189A1
- Status: Published application
- Kind: A1
- Application number: 16/855,881
- Filed: 2020-04-22
- Published: 2021-10-28
- Earliest claimed: 2020-04-22
- Assignees: StreamSets, Inc.
- Applicants: StreamSets, Inc.
- Inventors: Hari Shreedharan
- Web page: https://patentgrep.com/patent/US20210334189A1

## CPC

- G06F 11/3055: {Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available (error or fault processing without redundancy G06F11/0703; error detection or correction by redundancy in data representation G06F11/08; error detection or correction of the data by redundancy in operations G06F11/14; error detection or correction by redundancy in hardware G06F11/16)}
- G06F 11/327: {Alarm or error message display}
- G06F 9/542: {Event management; Broadcasting; Multicasting; Notifications}
- G06F 9/544: {Buffers; Shared memory; Pipes}
- G06F 11/0709: {in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems}
- G06F 11/0751: {Error or fault detection not based on redundancy (power supply failures G06F1/30; network fault management H04L41/06)}
- G06F 11/0772: {Means for error signaling, e.g. using interrupts, exception flags, dedicated error registers}
- G06F 11/0778: {Dumping, i.e. gathering error/state information after a fault for later diagnosis}
- G06F 11/3006: {where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems (multiprogramming arrangements G06F9/46; allocation of resources G06F9/50)}
- G06F 11/323: {Visualisation of programs or trace data}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods herein describe receiving identification from a data pipeline, accessing first data offset information for a first data origin and second data offset information for a second data origin, bisecting the first data origin using the first data offset information, processing the data pipeline with the bisected first data offset information and the second data offset information, receiving a notification indicating a data pipeline status, and causing presentation of the notification on a graphical user interface of a computing device.

## Claims

### Claim 1

A method comprising:
receiving, using one or more processors, an identification from a data pipeline;
in response to receiving the identification, accessing from the data pipeline, first data offset information for a first data origin and second data offset information for a second data origin;
bisecting the first data origin using the first data offset information, the bisecting including generating bisected first data offset information;
processing the data pipeline with the bisected first data offset information and the second data offset information;
in response to the processing the data pipeline, receiving a notification indicating a data pipeline status; and
based on the data pipeline status, causing presentation of the notification on a graphical user interface of a computing device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the identification of the data pipeline indicates a data pipeline failure.

### Claim 3 (depends on 1)

The method of claim 1, wherein the first data offset information represents data from the first data origin that was most recently processed by the data pipeline, the method further comprising:
storing the first offset information in a permanent storage system.

### Claim 4 (depends on 1)

The method of claim 1, wherein the bisected first data offset information comprises a first set of bisected first data offset information and a second set of bisected first data offset information.

### Claim 5 (depends on 4)

The method of claim 4, wherein the data pipeline status is a partial failure, the method further comprising:
bisecting the first set of bisected first data information, the bisecting including generated updated bisected first data offset information; and
performing a second processing of the data pipeline using the updated bisected first data offset information and the second data offset information.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
in response to the second processing the data pipeline, receiving a second notification indicating the data pipeline status; and
based on the data pipeline status, causing presentation of the second notification on a graphical user interface of a computing device

### Claim 7 (depends on 4)

The method of claim 4, wherein the data pipeline status is a complete failure, the method further comprising:
bisecting the second data origin using the second data offset information, the bisecting including generating bisected second data offset information; and
performing a second processing of the data pipeline using the first data offset information and the bisected second data offset information.

### Claim 8 (depends on 7)

The method of claim 7, further comprising:
in response to the second processing the data pipeline, receiving a second notification indicating the data pipeline status; and
based on the data pipeline status, causing presentation of the second notification on a graphical user interface of a computing device.

### Claim 9 (depends on 1)

The method of claim 1 further comprising:
generating an indication of data from the first data origin that caused the failure; and
causing presentation of the indication on the graphical user interface of the computing device.

### Claim 10

A computing apparatus comprising:
a processor; and
a memory storing instructions that, when executed by the processor, configure the apparatus to perform operations comprising:
receiving, using one or more processors, an identification from a data pipeline;
in response to receiving the identification, accessing from the data pipeline, first data offset information for a first data origin and second data offset information for a second data origin;
bisecting the first data origin using the first data offset information, the bisecting including generating bisected first data offset information;
processing the data pipeline with the bisected first data offset information and the second data offset information;
in response to the processing the data pipeline, receiving a notification indicating a data pipeline status; and
based on the data pipeline status, causing presentation of the notification on a graphical user interface of a computing device.

### Claim 11 (depends on 10)

The computing apparatus of claim 10, wherein the identification of the data pipeline indicates a data pipeline failure.

### Claim 12 (depends on 10)

The computing apparatus of claim 10, wherein the first data offset information represents data from the first data origin that was most recently processed by the data pipeline, the operations further comprising:
storing the first offset information in a permanent storage system.

### Claim 13 (depends on 10)

The computing apparatus of claim 10, wherein the bisected first data offset information comprises a first set of bisected first data offset information and a second set of bisected first data offset information.

### Claim 14 (depends on 13)

The computing apparatus of claim 13, wherein the data pipeline status is a partial failure, the operations further comprising:
bisecting the first set of bisected first data information, the bisecting including generated updated bisected first data offset information; and
performing a second processing of the data pipeline using the updated bisected first data offset information and the second data offset information.

### Claim 15 (depends on 14)

The computing apparatus of claim 14, the operations further comprising:
in response to the second processing the data pipeline, receiving a second notification indicating the data pipeline status; and
based on the data pipeline status, causing presentation of the second notification on a graphical user interface of a computing device

### Claim 16 (depends on 13)

The computing apparatus of claim 13, wherein the data pipeline status is a complete failure, the operations further comprising:
bisecting the second data origin using the second data offset information, the bisecting including generating bisected second data offset information; and
performing a second processing of the data pipeline using the first data offset information and the bisected second data offset information.

### Claim 17 (depends on 16)

The computing apparatus of claim 16, the operations further comprising:
generating an indication of data from the first data origin that caused the failure; and
causing presentation of the indication on the graphical user interface of the computing device.

### Claim 18 (depends on 10)

The computing apparatus of claim 10, wherein the first data origin is a first data source and the second data origin is a second data source.

### Claim 19

A computer-storage medium storing instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
receiving, using one or more processors, an identification from a data pipeline;
in response to receiving the identification, accessing from the data pipeline, first data offset information for a first data origin and second data offset information for a second data origin;
bisecting the first data origin using the first data offset information, the bisecting including generating bisected first data offset information;
processing the data pipeline with the bisected first data offset information and the second data offset information;
in response to the processing the data pipeline, receiving a notification indicating a data pipeline status; and
based on the data pipeline status, causing presentation of the notification on a graphical user interface of a computing device.

### Claim 20 (depends on 19)

The computer storage medium of claim 19, wherein the identification of the data pipeline indicates a data pipeline failure.
