# US 2026/0093556 A1 · Utilizing data processing unit caches for executing artificial intelligence workload > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2026/0093556 A1 - Document ID: US20260093556A1 - Status: Published application - Kind: A1 - Application number: 18/900,194 - Filed: 2024-09-27 - Published: 2026-04-02 - Earliest claimed: 2024-09-27 - Assignees: Dell Products L.P. - Applicants: Dell Products L.P. - Inventors: Erik P. Smith; Mihai Lazar; Jonathan Peter Streete - Web page: https://patentgrep.com/patent/US20260093556A1 ## CPC - G06F 9/461: {Saving or restoring of program or task context} - G06F 9/5083: {Techniques for rebalancing the load in a distributed system} - G06F 9/485: {Task life-cycle, e.g. stopping, restarting, resuming execution (G06F9/4881 takes precedence)} - G06F 9/5016: {the resource being the memory} - G06F 9/522: {Barrier synchronisation} - G06F 2209/509: Offload - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A method for managing checkpointing. The method including obtaining, by a general processing unit (GPU), checkpoint data associated with a workload. The method further including transferring, by the GPU, the checkpoint data to a cache in a data processing unit (DPU), where the GPU and the DPU and located on a physical server. The further method includes resuming, by the GPU, execution of the workload after the transferring, wherein the DPU transmits the checkpoint data to a storage system that is external to the physical server. ## Claims ### Claim 1 A method for managing checkpointing, comprising: obtaining, by a general processing unit (GPU), checkpoint data associated with a workload; transferring, by the GPU, the checkpoint data to a cache in a data processing unit (DPU), wherein the GPU and the DPU and located on a physical server; and resuming, by the GPU, execution of the workload after the transferring, wherein the DPU transmits the checkpoint data to a storage system that is external to the physical server. ### Claim 2 (depends on 1) The method of claim 1, further comprising: obtaining, by a second GPU, second checkpoint data associated with a second workload; transferring the second checkpoint data to the cache in the DPU, wherein the second GPU is located on the physical server; and resuming executing of the second workload on the second GPU after the transferring, wherein the DPU transmits the second checkpoint data to the storage system that is external to the physical server. ### Claim 3 (depends on 1) The method of claim 1, further comprising: prior to obtaining the checkpoint data: mapping the GPU to the DPU. ### Claim 4 (depends on 3) The method of claim 3, wherein the DPU presents a checkpoint target to the GPU, and wherein mapping the GPU to the DPU comprises configuring the GPU to use the checkpoint target to transfer the checkpoint data to the DPU. ### Claim 5 (depends on 4) The method of claim 4, wherein the checkpoint target is a storage target. ### Claim 6 (depends on 4) The method of claim 4, wherein the checkpoint target is a direct memory access target. ### Claim 7 (depends on 3) The method of claim 3, wherein there is a 1:1 mapping between the GPU and the DPU. ### Claim 8 (depends on 1) The method of claim 1, wherein the GPU and the DPU are connected via a Peripheral Component Interconnect Express (PCIe) fabric in the physical server or via a Compute Express Link (CXL) bus in the physical server. ### Claim 9 (depends on 1) The method of claim 1, wherein the checkpoint data is transmitted to the storage system via a scale out network. ### Claim 10 (depends on 1) The method of claim 1, wherein the checkpoint data is transmitted to the storage system via a storage network. ### Claim 11 (depends on 10) The method of claim 10, wherein the GPU communicates with a second GPU on a second physical server via a scale out network, wherein the scale out network is distinct from the storage network. ### Claim 12 (depends on 1) The method of claim 1, wherein the workload is an artificial intelligence (AI) workload. ### Claim 13 (depends on 1) The method of claim 1, wherein at least a portion of the checkpoint data is transmitted to the storage system after the GPU has resumed execution of the workload. ### Claim 14 (depends on 1) The method of claim 1, wherein, prior to transmitting the checkpoint data to the storage system, the DPU performs a modification operation on the checkpoint data, and wherein the checkpoint data is transferred to the storage system after the DPU performs the modification operation. ### Claim 15 (depends on 14) The method of claim 14, wherein the modification operation is at least one of type conversion, compression, encryption, deduplication, and tagging. ### Claim 16 (depends on 15) The method of claim 15, wherein the type conversion comprises at least one of: converting the checkpoint data to a type suitable for storage in an object store, converting the checkpoint data to a type suitable for storage in a file store, converting the checkpoint data to a type suitable for storage in a block storage array, and converting the checkpoint data to a type suitable for storage on a persistent storage sub-system. ### Claim 17 (depends on 1) The method of claim 1, further comprising: obtaining, by a second GPU, second checkpoint data associated with a second workload; transferring the second checkpoint data to a second cache in a second DPU, wherein the second GPU and the second DPU are located on the physical server; and resuming executing of the second workload on the second GPU after the transferring, wherein the second DPU transmits the second checkpoint data to the storage system that is external to the physical server. ### Claim 18 (depends on 17) The method of claim 17, wherein a size of the cache is 50% of a size of a memory in the GPU. ### Claim 19 A physical server, comprising: a plurality of graphics processing units (GPUs), a plurality of data processing units (DPUs), wherein each of the plurality of DPUs comprises a cache, a peripheral connection interface express (PCIe) fabric connecting the plurality of GPUs and the plurality of DPUs, wherein there is a 1:1 mapping between the plurality of GPUs and the plurality of DPUs, wherein each of the plurality of GPUs is configured to obtain checkpoint data associated with an artificial intelligence (AI) workload and transmit the checkpoint data to a corresponding mapped DPU of the plurality of DPUs, wherein each of the plurality of DPUs is configured to transmit the checkpoint data via a scale out network to a storage system that is external to the physical server. ### Claim 20 A physical server, comprising: a plurality of graphics processing units (GPUs), a plurality of data processing units (DPUs), wherein each of the plurality of DPUs comprises a cache, a peripheral connection interface express (PCIe) fabric connecting the plurality of GPUs and the plurality of DPUs, wherein there is a N:1 mapping between the plurality of GPUs and the plurality of DPUs, wherein each of the plurality of GPUs is configured to obtain checkpoint data associated with an artificial intelligence (AI) workload and transmit the checkpoint data to a corresponding mapped DPU of the plurality of DPUs, wherein each of the plurality of DPUs is configured to transmit the checkpoint data via a storage network to a storage system that is external to the physical server.