# US 2026/0089203 A1 · Using state of data-receiving endpoint processing units to manage use of endpoint processing unit fabric

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0089203 A1
- Document ID: US20260089203A1
- Status: Published application
- Kind: A1
- Application number: 19/227,483
- Filed: 2025-06-04
- Published: 2026-03-26
- Earliest claimed: 2024-09-21
- Assignees: Delos Data Inc.
- Applicants: Delos Data Inc.
- Inventors: Daniel P. Daly; Edward V. E. Doe; Alain J. E. Gravel
- Web page: https://patentgrep.com/patent/US20260089203A1

## CPC

- H04L 45/24: Multipath
- G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues}
- G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals}
- G06F 9/5083: {Techniques for rebalancing the load in a distributed system}
- G06F 9/547: {Remote procedure calls [RPC]; Web services}
- H04L 45/123: {Evaluation of link metrics (techniques for monitoring network metrics H04L43/08)}
- H04L 47/33: using forward notification
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04L 67/1001: for accessing one among a plurality of replicated servers
- H04L 67/60: Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources (admission control or resource allocation H04L47/70)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Some embodiments provide a method of managing communication between endpoint processing units (EPUs) through a network having multiple forwarding elements. The EPUs collectively execute a distributed application. For a first operation that a first EPU executes for the distributed application and that depends on a set of two or more operations of the distributed application that are executed earlier by a set of two or more other EPUs, the method waits to receive confirmation that all EPUs in the set of the EPUs have completed their operations and have results that can be forwarded to the first EPU. After receiving the confirmations from all EPUs in the set of EPUs, the method sends a set of one or more instructions that direct the set of EPUs to forward their results to the first EPU.

## Claims

### Claim 1

A method of managing communication between endpoint processing units (EPUs) through a network comprising a plurality of forwarding elements, the EPUs collectively executing a distributed application, the method comprising:
for a first operation that a first EPU executes for the distributed application and that depends on a set of two or more operations of the distributed application that are executed earlier by a set of two or more other EPUs:
waiting to receive confirmation that all EPUs in the set of the EPUs have completed their operations and have results that can be forwarded to the first EPU; and
after receiving said confirmations from all EPUs in the set of EPUs, sending a set of one or more instructions that direct the set of EPUs to forward their results to the first EPU.

### Claim 2 (depends on 1)

The method of claim 1, wherein the EPUs are graphics processing units (GPUs).

### Claim 3 (depends on 1)

The method of claim 1, wherein the EPUs comprise at least one of graphics processing units (GPUs), tensor processing units (TPUs) and central processing units (CPUs).

### Claim 4 (depends on 1)

The method of claim 1 further comprising assigning the set of operations to the set of EPUs before receiving confirmations from the EPUs in the set.

### Claim 5 (depends on 1)

The method of claim 1, wherein sending the instruction set comprises sending the set of one or more instructions to a set of forwarding elements associated with the set of EPUs to enable the forwarding elements to forward the results of the set of EPUs to the first EPU.

### Claim 6 (depends on 5)

The method of claim 5, wherein the set of instructions comprises a set of scheduling parameters used to schedule the EPUs use of the network.

### Claim 7 (depends on 6)

The method of claim 6 further comprising identifying a time for each EPU in the set of EPUs to forward the EPU's result through the network.

### Claim 8 (depends on 7)

The method of claim 7, wherein the set of scheduling parameters for each EPU in the set of EPUs comprises the time computed for that EPU.

### Claim 9 (depends on 6)

The method of claim 6 further comprising identifying a rate for each EPU in the set of EPUs to use to forward the EPU's result through the network.

### Claim 10 (depends on 5)

The method of claim 5, wherein the set of forwarding elements comprises a network interface of each EPU that connects the EPU to one or more other forwarding elements of the network, the EPU network interfaces receiving the generated instructions.

### Claim 11 (depends on 1)

The method of claim 1, wherein said waiting and sending are operations performed by a first forwarding element.

### Claim 12 (depends on 11)

The method of claim 11, wherein the first forwarding element is a first-hop forwarding element that is connected to the first EPU through a physical network link.

### Claim 13 (depends on 12)

The method of claim 12, wherein the first EPU comprises a network interface having a plurality of ports, and the first-hop forwarding element connects to a port of the network interface through the physical network link.

### Claim 14 (depends on 12)

The method of claim 12, wherein the first forwarding element comprises a data plane circuit to forward data messages between the EPUs and a control plane circuit to configure the data plane circuit, said control plane circuit performing the waiting and sending operations.

### Claim 15 (depends on 1)

The method of claim 1, wherein said waiting and sending are operations performed by a control plane proxy server used by a first-hop forwarding element that is connected to the first EPU through a physical network link.

### Claim 16

A non-transitory machine readable medium storing a program for managing communication between graphics processing units (GPUs) through a network comprising a plurality of forwarding elements, the GPUs collectively executing a distributed application, the program comprising sets of instructions for:
for a first operation that a first GPU executes for the distributed application and that depends on a set of two or more operations of the distributed application that are executed earlier by a set of two or more other GPUs:
waiting to receive confirmation that all GPUs in the set of the GPUs have completed their operations and have results that can be forwarded to the first GPU; and
after receiving said confirmations from all GPUs in the set of GPUs, sending a set of one or more instructions that direct the set of GPUs to forward their results to the first GPU.

### Claim 17 (depends on 16)

The non-transitory machine readable medium of claim 16, wherein the program is executed by a control plane processor of first forwarding element that is connected to the first GPU through at least one physical network link.

### Claim 18 (depends on 17)

The non-transitory machine readable medium of claim 17, wherein said first forwarding element serving as a last-hop forwarding element on several paths from the GPUs in the set of other GPUs to the first GPU.

### Claim 19 (depends on 16)

The non-transitory machine readable medium of claim 16, wherein the program is executed by a control plane proxy server that is used by a first forwarding element that is connected to the first GPU through at least one physical network link.

### Claim 20 (depends on 19)

The non-transitory machine readable medium of claim 19, wherein said first forwarding element captures and directs all confirmations to the control plane proxy server, and relays the set of one or more instructions that the control plane proxy server sends to the set of other GPUs.
