# US 2026/0089205 A1 · Configuring network fabric between graphics processing units

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0089205 A1
- Document ID: US20260089205A1
- Status: Published application
- Kind: A1
- Application number: 19/227,455
- Filed: 2025-06-04
- Published: 2026-03-26
- Earliest claimed: 2024-09-21
- Assignees: Delos Data Inc.
- Applicants: Delos Data Inc.
- Inventors: Daniel P. Daly; Edward V. E. Doe; Alain J. E. Gravel
- Web page: https://patentgrep.com/patent/US20260089205A1

## CPC

- H04L 45/24: Multipath
- G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues}
- G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals}
- G06F 9/5083: {Techniques for rebalancing the load in a distributed system}
- G06F 9/547: {Remote procedure calls [RPC]; Web services}
- H04L 45/123: {Evaluation of link metrics (techniques for monitoring network metrics H04L43/08)}
- H04L 47/33: using forward notification
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04L 67/1001: for accessing one among a plurality of replicated servers
- H04L 67/60: Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources (admission control or resource allocation H04L47/70)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Some embodiments provide a method of managing communication between graphics processing units (GPUs) through a network having multiple forwarding elements. The method uses a set of servers to generate instructions for specifying forwarding behaviors for the forwarding elements to forward data messages containing results of computations performed by the GPUs. The GPUs perform the computations in order to collectively execute a distributed application. The method distributes the generated instructions to the forwarding elements to configure the forwarding elements to implement the forwarding behavior.

## Claims

### Claim 1

A method of managing communication between graphics processing units (GPUs) through a network comprising a plurality of forwarding elements, the method comprising:
using a set of servers to generate instructions for specifying forwarding behaviors for the forwarding elements to forward data messages containing results of computations performed by the GPUs, said GPUs performing said computations in order to collectively execute a distributed application; and
distributing the generated instructions to the forwarding elements to configure the forwarding elements to implement the forwarding behavior.

### Claim 2 (depends on 1)

The method of claim 1, wherein distributing the generated instructions comprises:
distributing, for each source GPU, a set of instructions to at least one leader forwarding element that is one hop away from the source GPU in the network; and
configuring the leader forwarding element to configure a network interface of the source GPU to implement the specified forwarding behavior for forwarding results of computations of the source GPU through the network.

### Claim 3 (depends on 2)

The method of claim 2, wherein for a particular result that is destined to a destination GPU, the leader forwarding element configures the network interface of the source GPU to select, for a data message flow carrying the particular result to the destination GPU, a particular egress port of the network interface in order to select a path for the data message flow through the network to the destination GPU.

### Claim 4 (depends on 3)

The method of claim 3, wherein for the particular result that is destined to the destination GPU, said distributing comprises distributing to each of one or more intervening forwarding elements a next-hop forwarding record that identifies an egress port of the intervening forwarding element through which the intervening forwarding element should forward the data message flow.

### Claim 5 (depends on 4)

The method of claim 4, wherein the leader forwarding element is one of the intervening forwarding elements.

### Claim 6 (depends on 4)

The method of claim 4, wherein the leader forwarding element is not one of the intervening forwarding elements.

### Claim 7 (depends on 4)

The method of claim 4, wherein the leader forwarding element's configuration of the network interface configures the network interface to associate the data message flow with a tag generated at the source GPU or by the network interface of the source GPU, and the next-hop forwarding record distributed to each intervening forwarding element maps the generated tag with an egress port of the intervening forwarding element.

### Claim 8 (depends on 2)

The method of claim 2, wherein for a particular result that is destined to a destination GPU, the leader forwarding element configures the network interface of the source GPU with a launch time for a start of the forwarding of a data message flow carrying the result.

### Claim 9 (depends on 2)

The method of claim 2, wherein for a particular result that is destined to a destination GPU, the particular forwarding element configures the network interface of the particular GPU with a transmission rate for transmitting a data message flow carrying the result.

### Claim 10 (depends on 2)

The method of claim 2, wherein the leader forwarding element is one hop away from the source GPU as the leader forwarding element directly connects to the network interface of the GPU through a physical link.

### Claim 11

A non-transitory machine readable medium storing program that when executed by at least one processor configures a network to forward communication between graphics processing units (GPUs), the network comprising a plurality of forwarding elements, the program comprising sets of instructions for:
using a set of servers to generate instructions for specifying forwarding behaviors for the forwarding elements to forward data messages containing results of computations performed by the GPUs, said GPUs performing said computations in order to collectively execute a distributed application; and
distributing the generated instructions to the forwarding elements to configure the forwarding elements to implement the forwarding behavior.

### Claim 12 (depends on 11)

The non-transitory machine readable medium of claim 11, wherein the set of instructions for distributing the generated instructions comprises sets of instructions for:
distributing, for each source GPU, a set of instructions to at least one leader forwarding element that is one hop away from the source GPU in the network; and
configuring the leader forwarding element to configure a network interface of the source GPU to implement the specified forwarding behavior for forwarding results of computations of the source GPU through the network.

### Claim 13 (depends on 12)

The non-transitory machine readable medium of claim 12, wherein for a particular result that is destined to a destination GPU, the leader forwarding element configures the network interface of the source GPU to select, for a data message flow carrying the particular result to the destination GPU, a particular egress port of the network interface in order to select a path for the data message flow through the network to the destination GPU.

### Claim 14 (depends on 13)

The non-transitory machine readable medium of claim 13, wherein for the particular result that is destined to the destination GPU, the set of instructions for distributing comprises a set of instructions for distributing to each of one or more intervening forwarding elements a next-hop forwarding record that identifies an egress port of the intervening forwarding element through which the intervening forwarding element should forward the data message flow.

### Claim 15 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein the leader forwarding element is one of the intervening forwarding elements.

### Claim 16 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein the leader forwarding element is not one of the intervening forwarding elements.

### Claim 17 (depends on 14)

The non-transitory machine readable medium of claim 14, wherein the leader forwarding element's configuration of the network interface configures the network interface to associate the data message flow with a tag generated at the source GPU or by the network interface of the source GPU, and the next-hop forwarding record distributed to each intervening forwarding element maps the generated tag with an egress port of the intervening forwarding element.

### Claim 18 (depends on 12)

The non-transitory machine readable medium of claim 12, wherein for a particular result that is destined to a destination GPU, the leader forwarding element configures the network interface of the source GPU with a launch time for a start of the forwarding of a data message flow carrying the result.

### Claim 19 (depends on 12)

The non-transitory machine readable medium of claim 12, wherein for a particular result that is destined to a destination GPU, the particular forwarding element configures the network interface of the particular GPU with a transmission rate for transmitting a data message flow carrying the result.

### Claim 20 (depends on 12)

The non-transitory machine readable medium of claim 12, wherein the leader forwarding element is one hop away from the source GPU as the leader forwarding element directly connects to the network interface of the GPU through a physical link.
