# US 2024/0202121 A1 · Programmable Data Storage Memory Hierarchy

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202121 A1
- Document ID: US20240202121A1
- Status: Published application
- Kind: A1
- Application number: 18/068,670
- Filed: 2022-12-20
- Published: 2024-06-20
- Earliest claimed: 2022-12-20
- Assignees: Advanced Micro Devices, Inc.
- Applicants: Advanced Micro Devices, Inc.
- Inventors: Shaizeen Dilawarhusen Aga; Johnathan Robert Alsop; Nuwan S Jayasena
- Web page: https://patentgrep.com/patent/US20240202121A1

## CPC

- G06F 12/0811: with multilevel cache hierarchies
- G06F 12/0868: Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
- G06F 3/0656: {Data buffering arrangements}
- G06F 12/08: in hierarchically structured memory systems, e.g. virtual memory systems
- G06F 12/0891: using clearing, invalidating or resetting means
- G06F 12/0815: Cache consistency protocols
- G06F 2212/1008: Correctness of operation, e.g. memory ordering
- G06F 2212/1024: Latency reduction
- G06F 2212/1048: Scalability
- G06F 2212/502: using adaptive policy
- G06F 2212/601: Reconfiguration of cache memory
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Programmable data storage memory hierarchy techniques are described. In one example, a data storage system includes a memory hierarchy and a data movement controller. The memory hierarchy includes a hierarchical arrangement of a plurality of memory buffers. The data movement controller is configured to receive a data movement command and control data movement between the plurality of memory buffers based on the data movement command.

## Claims

### Claim 1

A data storage system comprising:
a memory hierarchy having a hierarchical arrangement of a plurality of memory buffers; and
a data movement controller configured to receive a data movement command and control movement of data between the plurality of memory buffers based on the data movement command.

### Claim 2 (depends on 1)

The data storage system of claim 1, wherein the data movement command is a push that specifies a location in the plurality of memory buffers, to which, the data is to be transmitted.

### Claim 3 (depends on 2)

The data storage system of claim 2, wherein the data movement command identifies the location as an address range, to which, the data is to be transmitted or a memory buffer of the plurality of memory buffers, to which, the data is to be transmitted.

### Claim 4 (depends on 1)

The data storage system of claim 1, wherein the data movement command is a cache eviction that includes an indication of a location in the plurality of memory buffers, to which, the data is to be evicted.

### Claim 5 (depends on 1)

The data storage system of claim 1, wherein the data movement command is a fetch that includes an indication of a location in the plurality of memory buffers, from which, the data is to be obtained.

### Claim 6 (depends on 1)

The data storage system of claim 1, wherein the data movement command specifies a path identifying one or more memory buffers of the plurality of memory buffers, through which, the data is to be transmitted.

### Claim 7 (depends on 1)

The data storage system of claim 1, wherein:
the memory hierarchy is configured as a cache system included in hardware as part of a processing device;
the plurality of memory buffers is configured as a plurality of cache levels of the cache system included as part of the processing device; and
the data movement command is generated through software executed by an execution unit included in the hardware of the processing device.

### Claim 8 (depends on 7)

The data storage system of claim 7, wherein the data movement controller is one of a plurality of data movement controllers associated, respectively, with the plurality of cache levels.

### Claim 9 (depends on 1)

The data storage system of claim 1, wherein the data movement controller includes a peer map that is programmable as providing a mapping between the plurality of memory buffers.

### Claim 10 (depends on 1)

The data storage system of claim 1, wherein the data movement controller includes a command queue that is configured to queue and order execution of one or more data movement commands

### Claim 11 (depends on 1)

The data storage system of claim 1, wherein the data movement controller is configured to provide an ordering primitive indicating completion of the data movement command at a specific memory buffer of the plurality of memory buffers.

### Claim 12 (depends on 1)

The data storage system of claim 1, wherein the data movement controller is configured to delay or drop data movement based on an inference that the data movement command hinders performance.

### Claim 13 (depends on 1)

The data storage system of claim 1, the data movement controller is configured to cancel the data movement command based on receipt of a cancel command.

### Claim 14 (depends on 1)

The data storage system of claim 1, wherein the data movement controller is configured to block external access to the data that is a subject of the data movement command until receipt of a completion acknowledgement.

### Claim 15

A device comprising:
an execution unit implemented in hardware of an integrated circuit and configured to generate data movement commands; and
a data storage system implemented in the hardware of the integrated circuit, the data storage system including a plurality of data movement controllers disposed, respectively, in a plurality of cache levels, the plurality of data movement controllers configured to control data movement between the plurality of cache levels through execution of the data movement commands.

### Claim 16 (depends on 15)

The device of claim 15, wherein the data movement commands include a push command that is configured to transmit data to a respective cache level of the plurality of cache levels.

### Claim 17 (depends on 15)

The device of claim 15, wherein the data movement commands include a fetch command that is configured to cause data to be transmitted from a respective cache level of the plurality of cache levels.

### Claim 18 (depends on 15)

The device of claim 15, wherein the plurality of data movement controllers includes, respectively, a plurality of finite state machines configured to process the data movement commands.

### Claim 19

A method comprising:
receiving a data movement command from an execution unit at a data movement controller of a data storage system; and
transmitting data between a first memory buffer specified by the data movement command and a second memory buffer specified by the data movement command by executing the data movement command by the data movement controller, the first memory buffer and the second memory buffer arranged to form a subset of a memory hierarchy.

### Claim 20 (depends on 19)

The method of claim 19, wherein the data movement command is received through execution of an operating system or application by the execution unit.
