# US 2026/0089057 A1 · Performing detection, mitigation and escalation operations to maintain operational performance of a network connecting endpoint processing units

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0089057 A1
- Document ID: US20260089057A1
- Status: Published application
- Kind: A1
- Application number: 19/227,493
- Filed: 2025-06-04
- Published: 2026-03-26
- Earliest claimed: 2024-09-21
- Assignees: Delos Data Inc.
- Applicants: Delos Data Inc.
- Inventors: Daniel P. Daly; Edward V. E. Doe; Alain J. E. Gravel
- Web page: https://patentgrep.com/patent/US20260089057A1

## CPC

- H04L 45/24: Multipath
- G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues}
- G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals}
- G06F 9/5083: {Techniques for rebalancing the load in a distributed system}
- G06F 9/547: {Remote procedure calls [RPC]; Web services}
- H04L 45/123: {Evaluation of link metrics (techniques for monitoring network metrics H04L43/08)}
- H04L 47/33: using forward notification
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04L 67/1001: for accessing one among a plurality of replicated servers
- H04L 67/60: Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources (admission control or resource allocation H04L47/70)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Some embodiments provide a method of executing a distributed application with multiple endpoint processing units (EPUs) that perform operations necessary for executing the distributed application. The method configures multiple forwarding elements that are part of a network to forward data message flows between the EPUs in order to allow the EPUs to share results of distributed-application operations that the EPUs execute. The method repeatedly collects and analyzes telemetry data from the forwarding elements. Upon detecting, based on the telemetry analysis, performance degradation at a particular forwarding element, the method reconfigures one or more forwarding elements to forward fewer data message flows through the particular forwarding element in order to mitigate the detected performance degradation.

## Claims

### Claim 1

A method of executing a distributed application with a plurality of endpoint processing units (EPUs) that perform operations necessary for executing the distributed application, the method comprising:
configuring a plurality of forwarding elements that are part of a network to forward data message flows between the EPUs in order to allow the EPUs to share results of distributed-application operations that the EPUs execute;
repeatedly collecting and analyzing telemetry data from the forwarding elements; and
upon detecting, based on the telemetry analysis, performance degradation at a particular forwarding element, reconfiguring one or more forwarding elements to forward fewer data message flows through the particular forwarding element in order to mitigate the detected performance degradation.

### Claim 2 (depends on 1)

The method of claim 1, wherein said re-configuring directs all the forwarding elements to stop forwarding data message flows through the particular forwarding element.

### Claim 3 (depends on 1)

The method of claim 1, wherein said re-configuring causes one or more of the forwarding elements to stop forwarding data message flows through the particular forwarding element while allowing one or more other forwarding elements to continue forwarding data message flows through the particular forwarding element.

### Claim 4 (depends on 1)

The method of claim 1, wherein said re-configuring causes one or more forwarding elements to forward fewer data message flows through the particular forwarding element while continuing using the particular forwarding element for at least one data message flow.

### Claim 5 (depends on 1)

The method of claim 1 further comprising after said reconfiguring detecting continued performance degradation of the particular forwarding element based on telemetry data collected after the reconfiguring, and performing an escalation operation to address the continued performance degradation.

### Claim 6 (depends on 1)

The method of claim 1, wherein performing the escalation operation comprises reconfiguring all the forwarding elements to ensure that none of the forwarding elements are using the particular forwarding element to forward data message flow.

### Claim 7 (depends on 1)

The method of claim 1, wherein performing the escalation operation further comprises sending a notification to one or more servers regarding the detected performance degradation for further analysis and for one or more corrective actions to be performed by a network administrator or an automated process.

### Claim 8 (depends on 1)

The method of claim 1 further comprising:
based on the telemetry analysis, detecting performance degradation at a particular EPU; and
performing a mitigation operation to reduce number of operations assigned to the particular EPU.

### Claim 9 (depends on 1)

The method of claim 1, wherein performing the mitigation operation that reduces the number of operations assigned to the particular EPU comprises directing a task schedule not to assign any operations to the particular EPU.

### Claim 10 (depends on 1)

The method of claim 1, wherein performing the mitigation operation that reduces the number of operations assigned to the particular EPU comprises directing a task schedule not reduce the number of operations assigned to the particular EPU while continuing to assign operations to the particular EPU.

### Claim 11 (depends on 1)

The method of claim 1, wherein the forwarding elements comprise (i) managed switches and (ii) endpoint interfaces (EPI) of the EPUs, each EPU having one or more EPIs, and each EPI connecting its EPU to one or more managed switches.

### Claim 12 (depends on 1)

The method of claim 1, wherein the EPUs are graphics processing units (GPUs).

### Claim 13 (depends on 1)

The method of claim 1, wherein the EPUs comprise at least one of graphics processing units (GPUs), tensor processing units (TPUs) and central processing units (CPUs).

### Claim 14

A non-transitory machine readable medium storing a program for managing a network connecting a plurality of graphics processing units (GPUs) that collectively execute a distributed application by performing operations for executing the distributed application, the program comprising sets of instructions for:
configuring a plurality of forwarding elements that are part of a network to forward data message flows between the GPUs in order to allow the GPUs to share results of distributed-application operations that the GPUs execute;
repeatedly collecting and analyzing telemetry data from the forwarding elements; and
upon detecting, based on the telemetry analysis, performance degradation at a particular forwarding element, reconfiguring one or more forwarding elements to forward fewer data message flows through the particular forwarding element in order to mitigate the detected performance degradation.

### Claim 15 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein the set of instructions for re-configuring directs all the forwarding elements to stop forwarding data message flows through the particular forwarding element.

### Claim 16 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein the set of instructions for re-configuring causes one or more of the forwarding elements to stop forwarding data message flows through the particular forwarding element while allowing one or more other forwarding elements to continue forwarding data message flows through the particular forwarding element.

### Claim 17 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein the set of instructions for re-configuring causes one or more forwarding elements to forward fewer data message flows through the particular forwarding element while continuing using the particular forwarding element for at least one data message flow.

### Claim 18 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein the program further comprises sets of instructions for
detecting, after said reconfiguring, continued performance degradation of the particular forwarding element based on telemetry data collected after the reconfiguring, and
performing an escalation operation to address the continued performance degradation.

### Claim 19 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein the set of instructions for performing the escalation operation comprises a set of instructions for reconfiguring all the forwarding elements to ensure that none of the forwarding elements are using the particular forwarding element to forward data message flow.

### Claim 20 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein the set of instructions for performing the escalation operation further comprises a set of instructions for sending a notification to one or more servers regarding the detected performance degradation for further analysis and for one or more corrective actions to be performed by a network administrator or an automated process.
