# US 2017/0255248 A1 · Cache power management

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0255248 A1
- Document ID: US20170255248A1
- Status: Published application
- Kind: A1
- Application number: 15/447,866
- Filed: 2017-03-02
- Published: 2017-09-07
- Earliest claimed: 2016-03-04
- Assignees: Arm Limited
- Applicants: ARM Limited
- Inventors: Ashley John CRAWFORD; Andrew Christopher ROSE; Tessil THOMAS; David GUILLEN FANDOS
- Web page: https://patentgrep.com/patent/US20170255248A1

## CPC

- G06F 1/3275: {Power saving in memory, e.g. RAM, cache}
- G06F 1/3225: of memory devices
- G06F 1/3287: by switching off individual functional units in the computer system
- G06F 1/3296: by lowering the supply or operating voltage
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

A method of operating a cache and corresponding apparatus are provided. The cache is capable of being only partially powered, and a decision to reduce the proportion of the cache which is currently powered is made based on calculating a memory bandwidth equivalent of expending the current active cache leakage power on memory access. The cache hit bandwidth is compared against this memory bandwidth equivalent and when the cache hit bandwidth is less than the memory bandwidth equivalent, the proportion of the cache which is currently powered is reduced. A analogous decision may also be made and based on calculating a cache hit bandwidth equivalent for an increment increase in cache leakage power, and when the cache miss bandwidth exceeds the cache hit bandwidth equivalent, the proportion of the cache which is currently powered is increased.

## Claims

### Claim 1

A method of operating a cache comprising the steps of:
calculating a cache hit bandwidth from monitoring performance of the cache;
calculating an active cache leakage power in dependence on a proportion of the cache which is currently powered;
calculating a memory bandwidth equivalent for expending the active cache leakage power on memory access; and
when the cache hit bandwidth is less than the memory bandwidth equivalent, reducing the proportion of the cache which is currently powered.

### Claim 2 (depends on 1)

The method as claimed in claim 1, wherein the cache comprises multiple banks, wherein at least one bank of the multiple banks is capable of being powered off independently of a remainder of the multiple banks.

### Claim 3 (depends on 2)

The method as claimed in claim 2, wherein each bank of the multiple banks is capable of being individually powered off.

### Claim 4 (depends on 2)

The method as claimed in claim 2, wherein reducing the proportion of the cache which is currently powered comprises powering off at least one bank of the multiple banks.

### Claim 5 (depends on 2)

The method as claimed in claim 2, wherein the proportion of the cache which is currently powered is given by a number of the multiple banks which are currently powered.

### Claim 6 (depends on 1)

The method as claimed in claim 1, wherein the active cache leakage power is calculated in dependence on a power-down threshold factor, wherein the power-down threshold factor reduces a value of the proportion of the cache which is currently powered when the value is used in calculating the active cache leakage power.

### Claim 7 (depends on 6)

The method as claimed in claim 6, wherein the power-down threshold factor can be set in a range such that the value of the proportion of the cache which is currently powered used in calculating the active cache leakage power ranges between:
the proportion of the cache which is currently powered for a first power-down threshold factor value; and
the proportion of the cache which is currently powered less an increment proportion of the cache which is capable of being powered down for a second power-down threshold factor value.

### Claim 8 (depends on 7)

The method as claimed in claim 7, wherein the power-down threshold factor is set to a value nearer to the second power-down threshold factor value than the first power-down threshold factor value.

### Claim 9 (depends on 1)

The method as claimed in claim 1, comprising the further steps, taken when the proportion of the cache which is currently powered is less than all of the cache, of:
calculating a cache miss bandwidth from monitoring performance of the cache;
calculating an increment cache leakage power in dependence on an increment proportion of the cache which is currently not powered;
calculating a cache hit bandwidth equivalent for incurring the increment cache leakage power; and
when the cache miss bandwidth exceeds the cache hit bandwidth equivalent, increasing the proportion of the cache which is currently powered by the increment proportion.

### Claim 10 (depends on 9)

The method as claimed in claim 9, wherein the cache comprises multiple banks, wherein at least one bank of the multiple banks is capable of being powered off independently of a remainder of the multiple banks, wherein the increment proportion of the cache is a bank of the multiple banks.

### Claim 11 (depends on 9)

The method as claimed in claim 9, wherein the increment cache leakage power is calculated in dependence on a power-up threshold factor, wherein the power-up threshold factor reduces a value of the increment proportion of the cache which is currently not powered when the value is used in calculating the increment cache leakage power.

### Claim 12 (depends on 11)

The method as claimed in claim 11, wherein the power-up threshold factor can be set in a range such that the value of the increment proportion of the cache which is currently not powered used in calculating the increment cache leakage power ranges between:
the increment proportion of the cache which is currently not powered for a first power-up threshold factor value; and
zero for a second power-up threshold factor value.

### Claim 13 (depends on 12)

The method as claimed in claim 12, wherein the power-up threshold factor is set to a value nearer to the first power-up threshold factor value than the second power-up threshold factor value.

### Claim 14 (depends on 1)

The method as claimed in claim 1, comprising the further steps, after reducing the proportion of the cache which is currently powered, of:
monitoring a cache miss rate; and
when the cache miss rate exceeds a predetermined cache miss rate threshold for a predetermined period, increasing the proportion of the cache which is currently powered.

### Claim 15 (depends on 14)

The method as claimed in claim 14, comprising at least one of the further steps of:
delaying a calculation of whether the memory bandwidth equivalent exceeds the cache hit bandwidth; and
delaying any subsequent reduction in the proportion of the cache which is currently powered.

### Claim 16 (depends on 1)

The method as claimed in claim 1, wherein monitoring performance of the cache comprises monitoring a global cache performance.

### Claim 17 (depends on 2)

The method as claimed in claim 2, wherein monitoring performance of the cache comprises monitoring per-bank cache performances.

### Claim 18 (depends on 1)

A computing device readable storage medium in which instructions are stored in a non-transient fashion which when executed by the computing device cause the computing device to carry out the method of claim 1.

### Claim 19

Apparatus for operating a cache comprising:
cache monitoring circuitry to monitor performance of the cache;
cache performance calculation circuitry to receive performance data from the cache monitoring circuitry and to:
calculate a cache hit bandwidth from the performance data,
calculate an active cache leakage power in dependence on a proportion of the cache which is currently powered, and
calculate a memory bandwidth equivalent for expending the active cache leakage power on memory access; and
cache power control circuitry to reduce the proportion of the cache which is currently powered when the cache hit bandwidth is less than the memory bandwidth equivalent.
