# US 2026/0093497 A1 · Utilizing top of rack switch caching for executing artificial intelligence workloads

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0093497 A1
- Document ID: US20260093497A1
- Status: Published application
- Kind: A1
- Application number: 18/900,180
- Filed: 2024-09-27
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Assignees: Dell Products L.P.
- Applicants: Dell Products L.P.
- Inventors: Erik P. Smith; Mihai Lazar; Jonathan Peter Streete
- Web page: https://patentgrep.com/patent/US20260093497A1

## CPC

- G06F 9/3854: {Instruction completion, e.g. retiring, committing or graduating}
- G06F 13/4022: {using switching circuits, e.g. switching matrix, connection or expansion network (G06F13/4009 takes precedence)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method for managing check pointing, including obtaining, by a general processing unit (GPU), checkpoint data associated with a workload, transferring, by the GPU, the checkpoint data to a cache in a top of rack (ToR) switch via a data processing unit (DPU), wherein the GPU and the DPU and located on a physical server and the ToR switch is operatively connected to the physical server, and resuming, by the GPU, execution of the workload after the transferring, wherein the ToR switch transmits the checkpoint data to a storage system that is external to the physical server and the ToR switch.

## Claims

### Claim 1

A method for managing checkpointing, comprising:
obtaining, by a general processing unit (GPU), checkpoint data associated with a workload;
transferring, by the GPU, the checkpoint data to a cache in a top of rack (ToR) switch via a data processing unit (DPU), wherein the GPU and the DPU and located on a physical server and the ToR switch is operatively connected to the physical server; and
resuming, by the GPU, execution of the workload after the transferring, wherein the ToR switch transmits the checkpoint data to a storage system that is external to the physical server and the ToR switch.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
obtaining, by a second GPU, second checkpoint data associated with a second workload;
transferring the second checkpoint data to the cache in the ToR switch, wherein the second GPU is located on the physical server; and
resuming executing of the second workload on the second GPU after the transferring, wherein the ToR switch transmits the second checkpoint data to the storage system.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
prior to obtaining the checkpoint data:
mapping the GPU to the ToR switch.

### Claim 4 (depends on 3)

The method of claim 3,
wherein the DPU presents a checkpoint target in the ToR switch to the GPU, and
wherein mapping the GPU to the Tor Switch comprises configuring the GPU to use the checkpoint target to transfer the checkpoint data to the ToR switch via the DPU.

### Claim 5 (depends on 4)

The method of claim 4, wherein the checkpoint target is a storage target.

### Claim 6 (depends on 4)

The method of claim 4, wherein the storage target is located in volatile memory or non-volatile storage in the ToR switch.

### Claim 7 (depends on 3)

The method of claim 3, wherein there is a 1:1 mapping between the GPU and the ToR switch.

### Claim 8 (depends on 1)

The method of claim 1, wherein the GPU and the DPU are connected via a Peripheral Component Interconnect Express (PCIe) fabric in the physical server or via a Compute Express Link (CXL) bus in the physical server.

### Claim 9 (depends on 1)

The method of claim 1, wherein the checkpoint data is transmitted to the storage system via a scale out network.

### Claim 10 (depends on 1)

The method of claim 1, wherein the workload is an artificial intelligence (AI) workload.

### Claim 11 (depends on 1)

The method of claim 1, wherein at least a portion of the checkpoint data is transmitted to the storage system after the GPU has resumed execution of the workload.

### Claim 12 (depends on 1)

The method of claim 1,
wherein, prior to transmitting the checkpoint data to the storage system, the ToR switch performs a modification operation on the checkpoint data, and
wherein the checkpoint data is transferred to the storage system after the ToR switch performs the modification operation.

### Claim 13 (depends on 12)

The method of claim 12, wherein the modification operation is at least one of type conversion, compression, encryption, deduplication, and tagging.

### Claim 14 (depends on 13)

The method of claim 13, wherein the type conversion comprises at least one of:
converting the checkpoint data to a type suitable for storage in an object store,
converting the checkpoint data to a type suitable for storage in a file store,
converting the checkpoint data to a type suitable for storage in a block storage array, and
converting the checkpoint data to a type suitable for storage on a persistent storage sub-system.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
obtaining, by a second GPU, second checkpoint data associated with a second workload;
transferring the second checkpoint data to a second cache in a second ToR switch, wherein the second GPU and the second DPU are located on the physical server; and
resuming executing of the second workload on the second GPU after the transferring, wherein the second ToR switch transmits the second checkpoint data to the storage system.

### Claim 16 (depends on 15)

The method of claim 15, wherein a size of the cache is 50% of a size of a memory in the GPU.

### Claim 17

A physical server, comprising:
a plurality of graphics processing units (GPUs),
a plurality of data processing units (DPUs),
a peripheral connection interface express (PCIe) fabric connecting the plurality of GPUs and the plurality of DPUs,
wherein each of the plurality of GPUs is configured to obtain checkpoint data associated with an artificial intelligence (AI) workload and transmit, via one of the plurality of DPUs, the checkpoint data to a corresponding mapped cache in a Top of Rack (ToR) switch,
wherein the ToR Switch is configured to transmit the checkpoint data via a scale out network to a storage system that is external to the physical server and the ToR Switch.

### Claim 18 (depends on 17)

The physical server of claim 17, wherein there is a 1:1 mapping between each of the plurality of GPUs and each of the plurality of DPUs.

### Claim 19

A system comprising:
a physical server, comprising:
a plurality of graphics processing units (GPUs),
a plurality of data processing units (DPUs),
a peripheral connection interface express (PCIe) fabric connecting the plurality of GPUs and the plurality of DPUs,
wherein each of the plurality of GPUs is configured to obtain checkpoint data associated with an artificial intelligence (AI) workload and transmit, via one of the plurality of DPUs, the checkpoint data to a corresponding mapped cache in a Top of Rack (ToR) switch, and
the ToR Switch is configured to transmit the checkpoint data via a scale out network to a storage system that is external to the physical server and the ToR Switch,
wherein the ToR Switch and the physical server are in a server rack.

### Claim 20 (depends on 19)

The system of claim 19, further comprising:
a second physical server in the server rack;
wherein the ToR Switch is configured to receive second checkpoint data associated with the AI workload from a second GPU, via a second DPU, on the second physical server.
