# US 2026/0086957 A1 · Mechanisms for Processing Memory Requests Based on Criticality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0086957 A1
- Document ID: US20260086957A1
- Status: Published application
- Kind: A1
- Application number: 18/978,516
- Filed: 2024-12-12
- Published: 2026-03-26
- Earliest claimed: 2024-09-20
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Qiong Cai; Tyler J. Huberty; Anwar Q. Rohillah; Gregory S. Mathews; Wolfgang H. Klingauf; Rohit K. Gupta
- Web page: https://patentgrep.com/patent/US20260086957A1

## CPC

- G06F 13/1626: {by reordering requests}
- G06F 12/1045: associated with a data cache
- G06F 13/1642: {with request queuing}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In an embodiment, a computer system includes a memory system configured to couple to one or more memory devices and processor circuitry configured to issue read and write requests to the memory system. The memory system is configured to receive, during a write turn in which a plurality of write requests are processed, a read request and an indication of a criticality of the read request assigned by the processor circuitry. The memory system is further configured to, based on the indication identifying that the read request is a critical read request and a detection that a set of activation criteria is satisfied, transition, to process the critical read request, from the write turn to a read turn without completing the write turn. The memory system is configured to perform the read turn in which a plurality of read requests are processed including the critical read request.

## Claims

### Claim 1

An apparatus, comprising:
a memory system configured to couple to one or more memory devices;
processor circuitry configured to issue read and write requests to the memory system; and
wherein the memory system is configured to:
receive, during a write turn in which a plurality of write requests are processed, a read request and an indication of a criticality of the read request assigned by the processor circuitry; and
based on the indication identifying that the read request is a critical read request and a detection that a set of activation criteria is satisfied, transition, to process the critical read request, from the write turn to a read turn without completing the write turn.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the memory system includes a set of write queues configured to store write requests, and wherein the set of activation criteria includes a criterion that a fill level of the set of write queues is less than a write heavy threshold.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the memory system includes a set of write queues configured to store write requests, and wherein the set of activation criteria includes a criterion that there is at least a threshold number of available entries in the set of write queues to store write requests having a particular prioritization level.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the set of activation criteria includes a criterion that read traffic having a particular prioritization level is not in an escalated state.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the memory system is configured to, based on a detection that the set of activation criteria is not satisfied, complete the write turn before transitioning to the read turn to process the critical read request.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the memory system is configured to complete the write turn even in the case that the set of activation criteria is subsequently satisfied after the detection that the set of activation criteria is not satisfied.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the memory system includes a set of read queues configured to store read requests, and wherein the memory system is configured to prioritize the critical read request over other read requests in the set of read queues so that the critical read request is processed before the other read requests.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the processor circuitry includes cache circuitry configured to assign one of a plurality of criticality values to the read request as the indication of the criticality of the read request, wherein the plurality of criticality values includes a non-critical value and a critical value.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the cache circuitry is configured to assign the critical value to the read request based on a detection that the read request corresponds to an oldest load instruction represented in a load queue of the processor circuitry.

### Claim 10

A method, comprising:
performing, by a memory system of a computer system, a write turn in which a plurality of write requests to write data to one or more memory devices are processed;
receiving, by the memory system during the write turn, a read request from processor circuitry of the computer system, wherein the read request is identified as critical by the processor circuitry;
determining, by the memory system, whether transitioning to a read turn from the write turn without completing the write turn is permitted according to a set of activation criteria;
in response to determining that the set of activation criteria is satisfied, the memory system transitioning to the read turn from the write turn without completing the write turn; and
processing, by the memory system, the read request during the read turn.

### Claim 11 (depends on 10)

The method of claim 10, wherein the memory system includes a set of write queues configured to store write requests, and wherein the method further comprises:
tracking, by the memory system over a set of previous turns, a number of instances of a fill level of the set of write queues satisfying a write heavy threshold, wherein the set of activation criteria includes a criterion that the number of instances does not satisfy a threshold number of instances.

### Claim 12 (depends on 10)

The method of claim 10, wherein the set of activation criteria includes a criterion that traffic having a particular prioritization level is not in an escalated state.

### Claim 13 (depends on 10)

The method of claim 10, wherein the set of activation criteria includes a criterion that there is at least a threshold number of available entries in a set of write queues of the memory system.

### Claim 14 (depends on 10)

The method of claim 10, further comprising:
identifying, by the processor circuitry, the read request as critical based on a detection that the read request corresponds to an oldest instruction in an instruction cache miss queue of the processor circuitry.

### Claim 15

A system, comprising:
cache circuitry configured to issue memory requests and assign one of a plurality of criticality values to a given one of the memory requests; and
a memory system configured to couple to one or more memory devices and to receive ones of the memory requests, wherein the memory system is configured to:
perform a first turn in which a plurality of memory requests of a first request type are processed;
receive, during the first turn, a memory request of a second request type;
based on a criticality value of the memory request, transition, to process the memory request, from the first turn to a second turn without completing the first turn; and
perform the second turn in which a plurality of memory requests of the second request type are processed.

### Claim 16 (depends on 15)

The system of claim 15, wherein the memory system includes a set of queues configured to store memory requests of the first request type, wherein the memory system is configured to manage the set of queues based on a pool of credits, and wherein the memory system is configured to transition from the first turn to the second turn without completing the first turn based on the criticality value and a detection that a set of activation criteria is satisfied, wherein the set of activation criteria includes a criterion that there is at least a threshold number of credits available in the pool of credits.

### Claim 17 (depends on 15)

The system of claim 15, further comprising:
processor circuitry that includes the cache circuitry, wherein the memory system is configured to, upon the reception of the memory request, issue a request to the processor circuitry to provide the criticality value of the memory request.

### Claim 18 (depends on 15)

The system of claim 15, wherein the plurality of critical values includes a critical value and at least one non-critical value, and wherein the system further comprises:
processor circuitry that includes the cache circuitry and memory management circuitry that is configured to translate virtual memory addresses to physical memory addresses, wherein the cache circuitry is configured to assign the critical value to the memory request based on a detection that the memory request corresponds to a transaction of the memory management circuitry.

### Claim 19 (depends on 15)

The system of claim 15, wherein the memory system includes a set of queues configured to store memory requests of the second request type, and wherein the memory system is configured to, during the second turn, process the memory requests in the set of queues in an order in which the memory requests of the second request type are stored.

### Claim 20 (depends on 15)

The system of claim 15, wherein the plurality of memory requests of the first request type are write requests and the plurality of memory requests of the second request type are read requests.
