# US 2020/0348746 A1 · Power-Conserving Cache Memory Usage

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0348746 A1
- Document ID: US20200348746A1
- Status: Published application
- Kind: A1
- Application number: 16/921,197
- Filed: 2020-07-06
- Published: 2020-11-05
- Earliest claimed: 2017-11-28
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Christopher J. Phoenix
- Web page: https://patentgrep.com/patent/US20200348746A1

## CPC

- G06F 1/3275: {Power saving in memory, e.g. RAM, cache}
- G06F 1/3225: of memory devices
- G06F 12/0804: with main memory updating (G06F12/0806 takes precedence)
- G06F 12/0811: with multilevel cache hierarchies
- G06F 12/0835: {for main memory peripheral accesses (e.g. I/O or DMA)}
- G06F 12/0888: using selective caching, e.g. bypass
- G06F 2212/1028: Power efficiency
- G06F 2212/502: using adaptive policy
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

Techniques and apparatuses are described that enable power-conserving cache memory usage. Main memory constructed using, e.g., DRAM can be placed in a low-power mode, such as a self-refresh mode, for longer time periods using the described techniques and apparatuses. A hierarchical memory system includes a supplemental cache memory operatively coupled between a higher-level cache memory and the main memory. The main memory can be placed in the self-refresh mode responsive to the supplemental cache memory being selectively activated. The supplemental cache memory can be implemented with a highly- or fully-associative cache memory that is smaller than the higher-level cache memory. Thus, the supplemental cache memory can handle those cache misses by the higher-level cache memory that arise because too many memory blocks are mapped to a single cache line. In this manner, a DRAM implementation of the main memory can be kept in the self-refresh mode for longer time periods.

## Claims

### Claim 1

(canceled)

### Claim 2

An electronic device comprising:
a first cache memory at a first hierarchical level;
a supplemental cache memory at a second hierarchical level, the supplemental cache memory communicatively coupled to the first cache memory, the second hierarchical level lower than the first hierarchical level, the supplemental cache memory configured to store less information than the first cache memory;
a main memory at a third hierarchical level, the main memory communicatively coupled to the first cache memory and the supplemental cache memory, the third hierarchical level lower than the second hierarchical level; and
control circuitry coupled to the supplemental cache memory and configured to cause the supplemental cache memory to transition between two or more operational modes.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein:
the two or more operational modes comprise an inactive operational mode and an active operational mode;
the supplemental cache memory is configured to be unavailable to operate as a lower-level cache memory resource for the first cache memory in the inactive operational mode; and
the supplemental cache memory is configured to be available to operate as a lower-level cache memory resource for the first cache memory in the active operational mode.

### Claim 4 (depends on 2)

The electronic device of claim 2, wherein:
the two or more operational modes comprise an inactive operational mode and an active operational mode;
the supplemental cache memory is configured to be powered down in the inactive operational mode; and
the supplemental cache memory is configured to handle at least some cache misses of the first cache memory in the active operational mode.

### Claim 5 (depends on 4)

The electronic device of claim 4, wherein:
the control circuitry is coupled to the main memory and configured to cause the main memory to transition between two or more power modes including a regular power mode and a low-power mode;
the main memory is configured to preserve and make accessible information in the regular power mode; and
the main memory is configured to preserve but make inaccessible information in the low-power mode until the main memory is awakened.

### Claim 6 (depends on 5)

The electronic device of claim 5, wherein:
the inactive operational mode corresponds to the supplemental cache memory being bypassed for memory requests that miss in the first cache memory; and
the active operational mode corresponds to the supplemental cache memory storing information and attempting to handle the memory requests that miss in the first cache memory.

### Claim 7 (depends on 2)

The electronic device of claim 2, wherein the first cache memory comprises a set associative cache memory, and the supplemental cache memory comprises a fully associative cache memory.

### Claim 8 (depends on 2)

The electronic device of claim 2, wherein the supplemental cache memory comprises at least one computer-readable storage medium that is physically separate from the first cache memory.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the electronic device comprises an integrated circuit chip, the integrated circuit chip including:
the at least one computer-readable storage medium comprising the supplemental cache memory; and
another at least one computer-readable storage medium comprising the first cache memory.

### Claim 10 (depends on 2)

The electronic device of claim 2, wherein:
the two or more operational modes comprise an inactive operational mode and an active operational mode;
the control circuitry is coupled to the main memory and configured to cause the main memory to transition between two or more power modes including a regular power mode and a low-power mode; and
the control circuitry is configured to establish two or more functional memory states comprising:
a first functional memory state corresponding to the inactive operational mode for the supplemental cache memory and the regular power mode for the main memory; and
a second functional memory state corresponding to the active operational mode for the supplemental cache memory and the low-power mode for the main memory.

### Claim 11 (depends on 10)

The electronic device of claim 10, wherein:
the inactive operational mode corresponds to the supplemental cache memory being bypassed for memory requests that miss in the first cache memory;
the active operational mode corresponds to the supplemental cache memory storing information to handle at least a portion of the memory requests that miss in the first cache memory;
the regular power mode corresponds to information in the main memory being preserved and accessible to handle the memory requests that miss in the first cache memory; and
the low-power mode corresponds to information in the main memory being preserved but inaccessible until the main memory is awakened.

### Claim 12 (depends on 11)

The electronic device of claim 11, wherein:
the two or more functional memory states further comprise a third functional memory state in which the supplemental cache memory is in a monitor operational mode and the main memory is in the regular power mode; and
the supplemental cache memory is configured to cache information for the first cache memory in the monitor operational mode to prepare for a transition from the first functional memory state to the second functional memory state.

### Claim 13 (depends on 12)

The electronic device of claim 12, wherein:
the two or more functional memory states further comprise a fourth functional memory state in which the supplemental cache memory is in a scrub operational mode and the main memory is in the regular power mode; and
the supplemental cache memory is configured to write back dirty information to the main memory in the scrub operational mode in preparation for a transition from the second functional memory state to the first functional memory state via the fourth functional memory state.

### Claim 14 (depends on 10)

The electronic device of claim 10, further comprising:
a register that is configured to be accessible by software, the register configured to hold a settable value to enable the second functional memory state.

### Claim 15 (depends on 10)

The electronic device of claim 10, wherein the control circuitry is configured to initiate a transition between the two or more functional memory states based on an impact of activity of the main memory.

### Claim 16

A method comprising:
operating a memory system that includes a first cache memory, a supplemental cache memory, and a main memory, the supplemental cache memory configured to selectively handle cache misses or cache overflows of the first cache memory responsive to an operational mode of the supplemental cache memory, the supplemental cache memory configured to store less information than the first cache memory;
responsive to the supplemental cache memory being in an inactive operational mode,
bypassing the supplemental cache memory for a memory request associated with a cache miss or a cache overflow of the first cache memory; and
routing the memory request to the main memory; and
responsive to the supplemental cache memory being in an active operational mode,
determining that information targeted by the memory request is stored in the supplemental cache memory; and
providing, from the supplemental cache memory, the information responsive to the determining that the information targeted by the memory request is stored in the supplemental cache memory.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
determining that the information targeted by the memory request is not stored in the supplemental cache memory; and
responsive to the determining that the information targeted by the memory request is not stored in the supplemental cache memory,
awakening the main memory from a low-power mode; and
providing, from the main memory, the information targeted by the memory request.

### Claim 18 (depends on 16)

The method of claim 16, further comprising:
estimating an impact of activity of the main memory; and
transitioning the operational mode of the supplemental cache memory based on the estimated impact of activity of the main memory.

### Claim 19 (depends on 18)

The method of claim 18, wherein the estimating comprises at least one of:
tracking cache misses or cache overflows of the first cache memory or of the supplemental cache memory;
monitoring memory requests that are routed to the main memory; or
analyzing execution properties of code.

### Claim 20

An electronic device comprising:
a first cache memory at a first hierarchical level;
a supplemental cache memory at a second hierarchical level, the supplemental cache memory communicatively coupled to the first cache memory, the second hierarchical level lower than the first hierarchical level, the first cache memory configured to store more information than the supplemental cache memory;
a main memory at a third hierarchical level, the main memory communicatively coupled to the first cache memory and the supplemental cache memory, the third hierarchical level lower than the second hierarchical level; and
control means for transitioning the supplemental cache memory between two or more operational modes.

### Claim 21 (depends on 20)

The electronic device of claim 20, further comprising:
control means for transitioning the main memory between two or more power modes.
