# US 2024/0202116 A1 · Method and Apparatus for Increasing Memory Level Parallelism by Reducing Miss Status Holding Register Allocation in Caches

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202116 A1
- Document ID: US20240202116A1
- Status: Published application
- Kind: A1
- Application number: 18/068,930
- Filed: 2022-12-20
- Published: 2024-06-20
- Earliest claimed: 2022-12-20
- Assignees: Advanced Micro Devices, Inc.
- Applicants: Advanced Micro Devices, Inc.
- Inventors: Jagadish B. Kotra; John Kalamatianos; Paul James Moyer; Nicholas Dean Lance; Sriram Srinivasan; Patrick James Shyvers; William Louie Walker
- Web page: https://patentgrep.com/patent/US20240202116A1

## CPC

- G06F 12/0802: Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F 12/0811: with multilevel cache hierarchies
- G06F 12/0897: with two or more cache hierarchy levels (with multilevel cache hierarchies G06F12/0811)
- G06F 2212/1016: Performance improvement
- G06F 2212/1028: Power efficiency
- G06F 2212/1044: Space efficiency improvement
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An entry of a last level cache shadow tag array to track pending last level cache misses to private data in a previous level cache (e.g., an L2 cache), that also are misses to an exclusive last level cache (e.g., an L3 cache) and to the last level cache shadow tag array. Accordingly, last level cache miss status holding registers need not be expended to track cache misses to private data that are already being tracked by a previous level cache miss status holding register. Additionally or alternatively, up to a threshold number of last level cache pending misses to the same shared data from different processor cores are tracked in the last level cache shadow tag array, and any additional last level cache pending misses are tracked in a last level cache miss status holding register.

## Claims

### Claim 1

A method comprising:
receiving, at a current level cache, a physical address corresponding to a cache miss at an immediately preceding level cache; and
in response to a cache miss at the current level cache and a shadow tag array miss at the current level cache:
recording the cache miss at the current level cache in the shadow tag array; and
sending, to a memory system, a request for data stored at the physical address.

### Claim 2 (depends on 1)

The method of claim 1, the recording the cache miss at the current level cache in the shadow tag array including recording the cache miss at the current level cache in the shadow tag array without reserving a current level cache miss status holding register.

### Claim 3 (depends on 1)

The method of claim 1, wherein recording the cache miss includes setting a current level cache pending miss indicator in an entry of the shadow tag array.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
receiving, from the memory system, the data stored at the physical address;
marking, in an entry of the shadow tag array corresponding to the cache miss at the current level cache, that the cache miss at the current level cache is no longer pending; and
returning the data to a first processor core requesting the data.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
returning the data to a second processor core indicated in the entry of the shadow tag array.

### Claim 6 (depends on 1)

The method of claim 1, further comprising, in response to the cache miss at the current level cache and a shadow tag array hit at the current level cache:
recording the cache miss at the current level cache in an existing entry in the shadow tag array without sending the request to the memory system.

### Claim 7 (depends on 1)

The method of claim 1, wherein the current level cache comprises a level 3 cache and the immediately preceding level cache comprises a level 2 cache.

### Claim 8

A method comprising:
receiving, at a current level cache, a physical address corresponding to a cache miss at an immediately preceding level cache for a first processor core; and
in response to a cache miss at the current level cache and a shadow tag array hit at the current level cache:
recording the cache miss at the current level cache for the first processor core in an entry of the shadow tag array, the entry of the shadow tag array already recording a cache miss at the current level cache for a second processor core.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
recording, in response to available space being present in the entry of the shadow tag array, the cache miss at the current level cache for the first processor core in the entry of the shadow tag array; and
tracking, in response to available space not being present in the entry of the shadow tag array, the cache miss at the current level cache for the first processor core in a shared data miss queue miss status holding register at the current cache level.

### Claim 10 (depends on 8)

The method of claim 8, further comprising recording the cache miss at the current level cache for the first processor core without sending a request for data stored at the physical address to a memory system.

### Claim 11 (depends on 8)

The method of claim 8, further comprising:
receiving, from a memory system, data stored at the physical address;
marking, in the entry of the shadow tag array corresponding to the cache miss at the current level cache, that the cache miss at the current level cache is no longer pending for the second processor core; and
returning the data to the second processor core requesting the data.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
marking, in the entry of the shadow tag array corresponding to the cache miss at the current level cache, that the cache miss at the current level cache is no longer pending for the first processor core; and
returning the data to the first processor core requesting the data.

### Claim 13 (depends on 8)

The method of claim 8, wherein the current level cache comprises a level 3 cache and the immediately preceding level cache comprises a level 2 cache.

### Claim 14

A device, comprising:
a current level cache to receive a physical address corresponding to a cache miss at an immediately preceding level cache and send, to a memory system, a request for data stored at the physical address; and
a shadow tag array to record, in response to a cache miss at the current level cache and a shadow tag array miss at the current level cache, the cache miss at the current level cache in an entry of the shadow tag array.

### Claim 15 (depends on 14)

The device of claim 14, wherein to record the cache miss at the current level cache in the shadow tag array includes recording the cache miss at the current level cache in the entry of the shadow tag array without reserving a current level cache miss status holding register.

### Claim 16 (depends on 14)

The device of claim 14, wherein to record the cache miss includes setting a current level cache pending miss indicator in the entry of the shadow tag array.

### Claim 17 (depends on 14)

The device of claim 14, wherein the current level cache is further to receive, from the memory system, the data stored at the physical address and return the data to a first processor core requesting the data, and the shadow tag array is to mark, in the entry of the shadow tag array, that the cache miss at the current level cache is no longer pending.

### Claim 18 (depends on 17)

The device of claim 17, wherein the current level cache is further to return the data to a second processor core indicated in the entry of the shadow tag array.

### Claim 19 (depends on 14)

The device of claim 14, wherein the shadow tag array is further to, in response to the cache miss at the current level cache and a shadow tag array hit at the current level cache, record the cache miss at the current level cache in an existing entry in the shadow tag array without sending the request to the memory system.

### Claim 20 (depends on 14)

The device of claim 14, wherein the current level cache comprises a level 3 cache and the immediately preceding level cache comprises a level 2 cache.
