# US 2026/0093667 A1 · Proactive caching for artificial intelligence workloads using access patterns

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0093667 A1
- Document ID: US20260093667A1
- Status: Published application
- Kind: A1
- Application number: 18/900,185
- Filed: 2024-09-27
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Assignees: Dell Products L.P.
- Applicants: Dell Products L.P.
- Inventors: Erik P. Smith; Mihai Lazar; Jonathan Peter Streete; Keyur B. Desai
- Web page: https://patentgrep.com/patent/US20260093667A1

## CPC

- G06F 16/172: Caching, prefetching or hoarding of files
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method for executing workloads in a physical server, including obtaining data from a storage system using a first access pattern and storing the data in a cache associated with a data processing unit (DPU) executing on the physical server, performing a first analysis of input/output (I/O) statistics associated with the data, wherein the I/O statistics are based on a first set of read requests issued by a graphics processing unit (GPU) executing on the physical server, making, based on performing the first analysis, a first determination that the data is associated with a second access pattern, wherein the second access pattern is not random, and obtaining, in response to the first determination, second data from the storage system using the second access pattern and storing the second data in the cache.

## Claims

### Claim 1

A method for executing workloads in a physical server, comprising:
obtaining a first data from a storage system and storing the first data in a cache associated with a data processing unit (DPU) executing on the physical server;
performing a first analysis of input/output (I/O) statistics associated with the first data to identify an access pattern of the first data as sequential or non-sequential, wherein the I/O statistics are based on a first set of read requests issued by a graphics processing unit (GPU) executing on the physical server;
identifying, in response to performing the first analysis, that the access pattern of the first data is sequential
enabling, in response to identifying that the access pattern of the first data is sequential, a read ahead mode of the DPU;
predicting, in response to enabling the read ahead mode, a second data that will be used in a next epoch by the GPU based on the access pattern of the first data;
obtaining, in response to predicting the second data, the second data from the storage system based on the access pattern of the first data and storing the second data in the cache;
servicing a subsequent file request of the GPU using the second data in the cache; and
flushing, concurrent to servicing the subsequent file request, a checkpoint data from the cache to the storage system.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
performing a second analysis of second I/O statistics associated with the second data to identify an access pattern of the second data as sequential or non-sequential, wherein the second I/O statistics are based on a second set of read requests issued by the GPU;
identifying, in response to performing the second analysis, that the access pattern of the second data is non-sequential is random; and
in response to identifying that the access pattern of the second data is non-sequential, disabling the read ahead mode of the DPU.

### Claim 3 (depends on 1)

The method of claim 1, wherein the checkpoint data is associated with an artificial intelligence (AI) workload from the GPU and was transmitted to the DPU for storage in the cache prior to servicing the subsequent file request.

### Claim 4

(canceled)

### Claim 5 (depends on 2)

The method of claim 2, further comprising:
while the read ahead mode is disabled in the DPU:
performing a third analysis of third I/O statistics associated with a third data to identify an access pattern of the third data as sequential or non-sequential, wherein the third I/O statistics are based on a third set of read requests issued by the GPU;
identifying, in response to performing the third analysis, that the access pattern of the third data is sequential;
re-enabling, in response to identifying that the access pattern of the third data is sequential. the read ahead mode of the DPU; and
obtaining, in response to re-enabling the read ahead mode, the third data from the storage system based on the access pattern of the third data and storing the third data in the cache.

### Claim 6 (depends on 1)

The method of claim 1, wherein the cache is located in the DPU.

### Claim 7 (depends on 1)

The method of claim 1,
wherein the cache is located on a Top of Rack (ToR) switch;
wherein the ToR switch is connected to the physical server; and
wherein the ToR switch is interposed between the storage system and the physical server.

### Claim 8 (depends on 1)

The method of claim 1, wherein each of the I/O statistics specify a number of cache misses that occurred when the DPU attempted to service corresponding read requests using data stored in the cache.

### Claim 9 (depends on 1)

The method of claim 1, wherein the second data is associated with an artificial intelligence (AI) workload executing on the GPU.

### Claim 10 (depends on 7)

The method of claim 7, wherein the checkpoint data is associated with an artificial intelligence (AI) workload from the GPU and was transmitted to the DPU cache is located on the ToR switch for storage prior to servicing the subsequent file request.

### Claim 11

(canceled)

### Claim 12

(canceled)

### Claim 13 (depends on 1)

The method of claim 1, wherein the read ahead mode of the DPU is alternatively enabled via identifying that the access pattern of the first data is pseudo random.

### Claim 14 (depends on 13)

The method of claim 13, wherein the access pattern of the first data pseudo random and wherein the access pattern of the second data is non-sequential.

### Claim 15

A method for executing workloads, comprising:
obtaining a first data from a storage system and storing the first data in a cache in a Top of Rack (ToR) switch connected to a physical server;
performing, by the ToR switch, a first analysis of input/output (I/O) statistics associated with the first data to identify an access pattern of the first data as sequential, pseudo random, or random, wherein the I/O statistics are based on a data processing unit (DPU) servicing a first set of read requests issued by a graphics processing unit (GPU) using the cache, wherein the GPU and DPU are executing on the physical server;
identifying, in response to performing the first analysis, that the access pattern of the first data is either sequential or pseudo random;
enabling, in response to identifying that the access pattern of the first data is either sequential or pseudo random, a read ahead mode of the DPU;
predicting, in response to enabling the read ahead mode, a second data that will be used in a next epoch by the GPU based on the access pattern of the first data;
obtaining, in response to predicting the second data, the second data from the storage system based on the access pattern of the first data and storing the second data in the cache;
servicing a subsequent file request of the GPU using the second data in the cache; and
flushing, concurrent to servicing the subsequent file request, a checkpoint data from the cache to the storage system.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
performing a second analysis of second I/O statistics associated with the second data to identify an access pattern of the second data as sequential, pseudo random, or random, wherein the second I/O statistics are based on a second set of read requests issued by the GPU;
identifying, in response to performing the second analysis, that the access pattern of the second data is random; and
in response to identifying that the access pattern of the second data is non-sequential, disabling the read ahead mode of the ToR switch.

### Claim 17 (depends on 16)

The method of claim 16, wherein the checkpoint data is associated with an artificial intelligence (AI) workload executing on the GPU and was transmitted, via the DPU, to the cache for storage prior to servicing the subsequent file request.

### Claim 18

(canceled)

### Claim 19 (depends on 16)

The method of claim 16, further comprising:
while the read ahead mode is disabled in the ToR switch:
performing a third analysis of third I/O statistics associated with a third data to identify an access pattern of the third data as sequential, pseudo random, or random, wherein the third I/O statistics are based on a third set of read requests issued by the GPU;
identifying, in response to performing the third analysis, that the access pattern of the third data is either sequential or pseudo random;
re-enabling, in response to identifying that the access pattern of the third data is sequential or pseudo random, the read ahead mode of the ToR switch; and
obtaining, in response to re-enabling the read ahead mode, the third data from the storage system based on the access pattern of the third data and storing the third data in the cache.

### Claim 20 (depends on 15)

The method of claim 15, wherein each of the I/O statistics specify a number of cache misses that occurred when the DPU attempted to service the first set of corresponding read requests using data stored in the cache.

### Claim 21 (depends on 3)

The method of claim 3, further comprising:
executing, using the GPU, the AI workload using the first data, wherein the execution of the AI workload is concurrent to obtaining the second data from the storage system;
reaching a synchronization point in the execution of the AI workload using the first data;
pausing, in response to reaching the synchronization point, the execution of the AI workload; and
transmitting, in response to reaching the synchronization point, the checkpoint data from the GPU for storage in the cache.

### Claim 22 (depends on 17)

The method of claim 17, further comprising:
executing, using the GPU, the AI workload using the first data, wherein the execution of the AI workload is concurrent to obtaining the second data from the storage system;
reaching a synchronization point in the execution of the AI workload using the first data;
pausing, in response to reaching the synchronization point, the execution of the AI workload; and
transmitting, in response to reaching the synchronization point, the checkpoint data from the GPU for storage in the cache.
