# US 2022/0019533 A1 · Managing processing of memory commands in a memory subsystem with a high latency backing store

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0019533 A1
- Document ID: US20220019533A1
- Status: Published application
- Kind: A1
- Application number: 16/928,999
- Filed: 2020-07-14
- Published: 2022-01-20
- Earliest claimed: 2020-07-14
- Assignees: Micron Technology, Inc.
- Applicants: Micron Technology, Inc.
- Inventors: Patrick A. La Fratta; Cagdas Dirik, II; Laurent Isenegger; Robert M. Walker
- Web page: https://patentgrep.com/patent/US20220019533A1

## CPC

- G06F 12/0806: Multiuser, multiprocessor or multiprocessing cache systems
- G06F 12/0895: of parts of caches, e.g. directory or tag array
- G06F 13/1642: {with request queuing}
- G06F 13/18: based on priority control (G06F13/1605 takes precedence)
- G06F 12/126: with special data handling, e.g. priority of data or instructions, handling errors or pinning
- G06F 2212/1024: Latency reduction
- G06F 2212/502: using adaptive policy
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method is described for managing the issuance and fulfillment of memory commands. The method includes receiving, by a cache controller of a memory subsystem, a first memory command corresponding to a set of memory devices. In response, the cache controller adds the first memory command to a cache controller command queue such that the cache controller command queue stores a first set of memory commands and sets a priority of the first memory command to either a high or low priority based on (1) whether the first memory command is of a first or second type and (2) an origin of the first memory command.

## Claims

### Claim 1

A method comprising:
receiving, by a cache controller of a memory subsystem, a first memory command corresponding to a set of memory devices of the memory subsystem;
adding, by the cache controller, the first memory command to a cache controller command queue such that the cache controller command queue stores a first set of memory commands, including the first memory command; and
setting, by the cache controller, a priority of the first memory command in the cache controller command queue to either a high priority or a low priority based on (1) whether the first memory command is of a first type or a second type and (2) an origin of the first memory command.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining, by the cache controller, a dependency of the first memory command to one or more memory commands in the first set of memory commands stored in the cache controller command queue; and
adjusting, by the cache controller, a priority of the one or more memory commands based on the determined dependency with the first memory command.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
selecting, by the cache controller, a second memory command from the first set of memory commands to issue to a low latency memory controller of a low latency memory for the memory subsystem, wherein a latency of the low latency memory for processing memory commands is less than a latency of the set of memory devices for processing memory commands, and
wherein when a previous memory command issued to the low latency memory controller is a low priority memory command, the second memory command is a high priority memory command.

### Claim 4 (depends on 3)

The method of claim 3, wherein when the previous memory command issued to the low latency memory controller is a high priority memory command, selecting the second memory command includes determining whether a number of low priority memory commands stored in a low latency controller command queue of the low latency memory controller satisfies a threshold,
wherein when the number of low priority memory commands stored in the low latency controller command queue fails to satisfy the threshold, the second memory command is selected because it is of a high priority memory command, and
wherein when the number of low priority memory commands stored in the low latency controller command queue satisfies the threshold, the second memory command is selected because it is of a low priority memory command.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
issuing, by the cache controller, the second memory command to the low latency memory controller;
adding, by the low latency memory controller, the second memory command and a priority associated with the second memory command to the low latency controller command queue such that the low latency controller command queue stores a second set of memory commands, including the second memory command; and
fulfilling, by the low latency memory controller, a third memory command from the second set of memory commands based on a priority associated with each of the memory commands in the second set of memory commands such that high priority memory commands are prioritized for fulfillment over low priority memory commands in the second set of memory commands.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining the dependency between the first memory command and the one or more memory commands includes determining that the first memory command and the one or more memory commands are associated with a same region of a cache store or a same region of the set of memory devices.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first type is read memory command and the second type is a write memory command, and
wherein the origin of the first memory command is either a host system or the memory subsystem.

### Claim 8

A non-transitory computer-readable storage medium comprising instructions that, when executed by a processing device, cause the processing device to:
receive a first memory command corresponding to a set of memory devices of a memory subsystem;
add the first memory command to a cache controller command queue such that the cache controller command queue stores a first set of memory commands, including the first memory command; and
set a priority of the first memory command in the cache controller command queue to either a high priority or a low priority based on (1) whether the first memory command is of a first type or a second type and (2) an origin of the first memory command.

### Claim 9 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the processing device is further to:
determine a dependency of the first memory command to one or more memory commands in the first set of memory commands stored in the cache controller command queue; and adjust a priority of the one or more memory commands based on the determined dependency with the first memory command.

### Claim 10 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the processing device is further to:
select a second memory command from the first set of memory commands to issue to a low latency memory controller of a low latency memory for the memory subsystem, wherein a latency of the low latency memory for processing memory commands is less than a latency of the set of memory devices for processing memory commands, and
wherein when a previous memory command issued to the low latency memory controller is of a low priority memory command, the second memory command is of a high priority memory command.

### Claim 11 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein when the previous memory command issued to the low latency memory controller is a high priority memory command, selecting the second memory command includes determining whether a number of low priority memory commands stored in a low latency controller command queue of the DRAM controller satisfies a threshold,
wherein when the number of low priority memory commands stored in the low latency controller command queue fails to satisfy the threshold, the second memory command is selected because it is of a high priority memory command, and
wherein when the number of low priority memory commands stored in the low latency controller command queue satisfies the threshold, the second memory command is selected because it is of a low priority memory command.

### Claim 12 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the processing device is further to:
issue the second memory command to the low latency memory controller;
add the second memory command and a priority associated with the second memory command to the low latency controller command queue such that the low latency controller command queue stores a second set of memory commands, including the second memory command; and
fulfill a third memory command from the second set of memory commands based on a priority associated with each of the memory commands in the second set of memory commands such that high priority memory commands are prioritized for fulfillment over low priority memory commands in the second set of memory commands.

### Claim 13 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein determining the dependency between the first memory command and the one or more memory commands includes determining that the first memory command and the one or more memory commands are associated with a same region of a cache store or a same region of the set of memory devices.

### Claim 14 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the first type is read memory command and the second type is a write memory command, and
wherein the origin of the first memory command is either a host system or the memory subsystem.

### Claim 15

A system comprising:
a memory device; and
a processing device, operatively coupled with the memory device, to:
receive a first memory command corresponding to the memory device;
add the first memory command to a cache controller command queue such that the cache controller command queue stores a first set of memory commands, including the first memory command;
set a priority of the first memory command in the cache controller command queue to either a high priority or a low priority based on one or more of (1) whether the first memory command is of a first type or a second type and (2) an origin of the first memory command;
determine a dependency of the first memory command to one or more memory commands in the first set of memory commands stored in the cache controller command queue; and
adjust a priority of the one or more memory commands based on the determined dependency with the first memory command,
wherein adjusting a priority of the one or more memory commands based on the determined dependency includes setting a priority of each memory command in the one or more memory commands to a high priority when the first memory command has a high priority.

### Claim 16 (depends on 15)

The system of claim 15, wherein the processing device is further to:
select a second memory command from the first set of memory commands to issue to a low latency memory controller of a low latency memory, wherein a latency of the low latency memory for processing memory commands is less than a latency of the memory device for processing memory commands, and
wherein when a previous memory command issued to the low latency memory controller is of the first type, the second memory command is of the second type.

### Claim 17 (depends on 16)

The system of claim 16, wherein when the previous memory command issued to the low latency memory controller is a high priority memory command, selecting the second memory command includes determining whether a number of low priority memory commands stored in a low latency controller command queue of the low latency memory controller satisfies a threshold,
wherein when the number of low priority memory commands stored in the low latency controller command queue fails to satisfy the threshold, the second memory command is selected because it is of a high priority memory command, and
wherein when the number of low priority memory commands stored in the low latency controller command queue satisfies the threshold, the second memory command is selected because it is of a low priority memory command.

### Claim 18 (depends on 17)

The system of claim 17, wherein the processing device is further to:
issue the second memory command to the low latency memory controller;
add the second memory command and a priority associated with the second memory command to the low latency controller command queue such that the low latency controller command queue stores a second set of memory commands, including the second memory command; and
fulfill a third memory command from the second set of memory commands based on a priority associated with each of the memory commands in the second set of memory commands such that high priority memory commands are prioritized for fulfillment over low priority memory commands in the second set of memory commands.

### Claim 19 (depends on 15)

The system of claim 15, wherein determining the dependency between the first memory command and the one or more memory commands includes determining that the first memory command and the one or more memory commands are associated with a same region of a cache store or a same region of the memory device.

### Claim 20 (depends on 15)

The system of claim 15, wherein the first type is read memory command and the second type is a write memory command, and
wherein the origin of the first memory command is either a host system or the memory subsystem.
