Utilizing data processing unit caches for executing artificial intelligence workload
AssigneeDell Products L.P.
InventorsErik P. Smith, Mihai Lazar, Jonathan Peter Streete
Life of this patent
Estimating the term…
Abstract
A method for managing checkpointing. The method including obtaining, by a general processing unit (GPU), checkpoint data associated with a workload. The method further including transferring, by the GPU, the checkpoint data to a cache in a data processing unit (DPU), where the GPU and the DPU and located on a physical server. The further method includes resuming, by the GPU, execution of the workload after the transferring, wherein the DPU transmits the checkpoint data to a storage system that is external to the physical server.
Claims20
A method for managing checkpointing, comprising:
- obtaining, by a general processing unit (GPU), checkpoint data associated with a workload;
- transferring, by the GPU, the checkpoint data to a cache in a data processing unit (DPU), wherein the GPU and the DPU and located on a physical server;
- and
- resuming, by the GPU, execution of the workload after the transferring, wherein the DPU transmits the checkpoint data to a storage system that is external to the physical server.
A physical server, comprising:
- a plurality of graphics processing units (GPUs),
- a plurality of data processing units (DPUs), wherein each of the plurality of DPUs comprises a cache,
- a peripheral connection interface express (PCIe) fabric connecting the plurality of GPUs and the plurality of DPUs,
- wherein there is a 1:1 mapping between the plurality of GPUs and the plurality of DPUs,
- wherein each of the plurality of GPUs is configured to obtain checkpoint data associated with an artificial intelligence (AI) workload and transmit the checkpoint data to a corresponding mapped DPU of the plurality of DPUs,
- wherein each of the plurality of DPUs is configured to transmit the checkpoint data via a scale out network to a storage system that is external to the physical server.
A physical server, comprising:
- a plurality of graphics processing units (GPUs),
- a plurality of data processing units (DPUs), wherein each of the plurality of DPUs comprises a cache,
- a peripheral connection interface express (PCIe) fabric connecting the plurality of GPUs and the plurality of DPUs,
- wherein there is a N:1 mapping between the plurality of GPUs and the plurality of DPUs,
- wherein each of the plurality of GPUs is configured to obtain checkpoint data associated with an artificial intelligence (AI) workload and transmit the checkpoint data to a corresponding mapped DPU of the plurality of DPUs,
- wherein each of the plurality of DPUs is configured to transmit the checkpoint data via a storage network to a storage system that is external to the physical server.
Dependencies are inferred from the claim text.