# US 2026/0064481 A1 · Configurable depth limit for cache prefetching

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0064481 A1
- Document ID: US20260064481A1
- Status: Published application
- Kind: A1
- Application number: 18/818,568
- Filed: 2024-08-28
- Published: 2026-03-05
- Earliest claimed: 2024-08-28
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Jacob ENGELBRECHT; Rafaela FROTA; Andres JARAMILLO; Cameron Alexander MILLER; Hubertus FRANKE; John S. WERNER
- Web page: https://patentgrep.com/patent/US20260064481A1

## CPC

- G06F 9/505: {considering the load}
- G06F 9/30047: {Prefetch instructions; cache control instructions}
- G06F 9/5033: {considering data affinity}
- G06F 9/5094: {where the allocation takes into account power or heat criteria (power management in computers in general G06F1/3203; thermal management in computers in general G06F1/206)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In some implementations, a CPU may determine a measure of importance associated with executing a workload. The CPU may determine a cache prefetching depth limit associated with the measure of importance. The CPU may perform, as part of executing of the workload, cache prefetching up to a depth identified by the cache prefetching depth limit.

## Claims

### Claim 1

A computer-implemented method, comprising:
determining a measure of importance associated with executing a workload;
determining a cache prefetching depth limit associated with the measure of importance; and
performing, as part of executing of the workload, cache prefetching up to a depth identified by the cache prefetching depth limit.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising:
detecting a context switch associated with executing the workload; and
determining the cache prefetching depth limit based on detecting the context switch.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, further comprising:
obtaining sustainability information from a program context block associated with the workload; and
determining the cache prefetching depth limit based on the sustainability information.

### Claim 4 (depends on 2)

The computer-implemented method of claim 2, further comprising:
obtaining sustainability information from a program context block associated with the workload; and
determining the measure of importance based on the sustainability information.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, wherein determining the cache prefetching depth limit comprises:
determining that resources and energy are to be preserved based on the sustainability information; and
determining the cache prefetching depth limit based on determining that the resources and energy are to be preserved.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein determining the measure of importance comprises:
determining a measure of performance to be achieved with respect to executing the workload; and
wherein determining the cache prefetching depth limit comprises:
determining a cache prefetching depth limit associated with the measure of importance.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein performing the cache prefetching comprises:
applying the cache prefetching depth limit to a Markov prefetching algorithm.

### Claim 8

A system comprising:
a processing unit to:
determine that one or more instructions are to be stored in a cache for execution of a workload;
obtain sustainability information regarding cache prefetching associated with the execution of the workload;
determine, based on the sustainability information, whether the cache prefetching is to be limited to a cache prefetching depth limit;
perform the cache prefetching up to the cache prefetching depth limit when the cache prefetching is to be limited to the cache prefetching depth limit; and
perform the cache prefetching independent of the cache prefetching depth limit when the cache prefetching is not to be limited to the cache prefetching depth limit.

### Claim 9 (depends on 8)

The system of claim 8, wherein, to perform the cache prefetching up to the cache prefetching depth limit, the processing unit is to:
applying the cache prefetching depth limit to a Markov prefetching algorithm.

### Claim 10 (depends on 8)

The system of claim 8, wherein, to determine whether the cache prefetching is to be limited to the cache prefetching depth, the processing unit is to:
determine, based on the sustainability information, that resources and energy are to be preserved during the execution of the workload; and
determine the cache prefetching depth limit based on determining that the resources and energy are to be preserved.

### Claim 11 (depends on 8)

The system of claim 8, wherein the processing unit is to:
detect a switch from a first program context block to a second program context block associated with the workload;
determine whether the cache prefetching is to be limited to the cache prefetching depth based on detecting the switch from the first program context block to the second program context block; and
obtain the sustainability information from the second program context block.

### Claim 12 (depends on 11)

The system of claim 11, wherein the processing unit is to:
detect a switch from a first thread to a second thread associated with the workload; and
determine whether the cache prefetching is to be limited to the cache prefetching depth based on detecting the switch from the first thread to the second thread.

### Claim 13 (depends on 8)

The system of claim 8, wherein the processing unit is to:
determine, based on the sustainability information, a measure of importance associated with executing the workload; and
determine, based on the measure of importance, whether the cache prefetching is to be limited to the cache prefetching depth limit.

### Claim 14 (depends on 8)

The system of claim 8, wherein the processing unit is to:
determine, based on the sustainability information, a measure of performance to be achieved with respect to executing the workload; and
determine, based on the sustainability information, the cache prefetching depth limit associated with the measure of importance.

### Claim 15

A computer program product comprising:
one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions comprising:
program instructions to determine that one or more instructions are to be stored in a cache for execution of a workload;
program instructions to obtain sustainability information regarding cache prefetching associated with the execution of the workload; and
program instructions to perform, as part of the execution of the workload, cache prefetching to a cache prefetching depth limit when the sustainability information identifies the cache prefetching depth.

### Claim 16 (depends on 15)

The computer program product of claim 15, wherein the program instructions further comprise:
program instructions to perform the cache prefetching independent of the cache prefetching depth when the sustainability information does not identify the cache prefetching depth.

### Claim 17 (depends on 15)

The computer program product of claim 15, wherein the program instructions further comprise:
program instructions to determine, based on the sustainability information, a measure of importance associated with executing the workload; and
program instructions to determine, based on the measure of importance, whether the cache prefetching is to be limited to the cache prefetching depth limit.

### Claim 18 (depends on 15)

The computer program product of claim 15, wherein the program instructions further comprise:
program instructions to detect a switch from a first program context block to a second program context block associated with the workload; and
program instructions to determine whether the cache prefetching is to be limited to the cache prefetching depth based on detecting the switch from the first program context block to the second program context block.

### Claim 19 (depends on 18)

The computer program product of claim 18, wherein the program instructions further comprise:
program instructions to obtain the sustainability information from the second program context block.

### Claim 20 (depends on 18)

The computer program product of claim 18, wherein the program instructions further comprise:
program instructions to determine, based on the sustainability information, that resources and energy are to be preserved during the execution of the workload; and
program instructions to determine the cache prefetching depth limit based on determining that the resources and energy are to be preserved.
