# US 2026/0093645 A1 · Apparatuses and methods for managing memory access

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0093645 A1
- Document ID: US20260093645A1
- Status: Published application
- Kind: A1
- Application number: 19/330,052
- Filed: 2025-09-16
- Published: 2026-04-02
- Earliest claimed: 2024-09-30
- Assignees: Micron Technology, Inc.
- Applicants: Micron Technology, Inc.
- Inventors: Leon Zlotnik
- Web page: https://patentgrep.com/patent/US20260093645A1

## CPC

- G06F 13/1689: {Synchronisation and timing concerns (synchronisation on a memory bus G06F13/4234)}
- G06F 13/1626: {by reordering requests}
- G06F 13/1663: {Access to shared memory}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Various memory access management schemes are described. Access requests received from multiple processing units in a particular order can be responded to by either providing the instructions requested by the access requests or by providing alternative instructions (or any combination thereof) that cause the processing units to re-access at a later point. The alternative instructions can be provided when the timing requirements associated with the access requests are not expected to be met, ensuring a continuous flow of access requests, which may be disrupted if the timing requirements are eventually met.

## Claims

### Claim 1

A method, comprising:
sequentially receiving, respectively from a plurality of processing units, a number of access requests respectively including a number of addresses of a memory to access a number of first instructions from the number of addresses;
retrieving the number of first instructions from locations of the memory corresponding to the number of addresses; and
providing, to one or more respective processing units of the plurality in an order in which the number of access requests were received, the number of first instructions or a number of second instructions instead of the number of first instructions, or any combination thereof, based on a determination of whether a respective timing requirement associated with each one of the number of first instructions is expected to be met;
wherein each second instruction, when executed by the respective processing unit, causes the respective processing unit to access a respective address of the number of addresses.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
providing, to the respective processing units, a respective first instruction responsive to determining that the timing requirement associated with the respective first instruction is expected to be met.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
providing, to the respective processing units, a respective second instruction in replacement of a respective first instruction responsive to determining that the timing requirement associated with the respective first instruction is not expected to be met.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
providing, to the respective processing units, the respective second instruction responsive to determining that the respective first instruction is not available when the respective first instruction is required to be sent to meet the timing requirement associated with the respective first instruction.

### Claim 5 (depends on 3)

The method of claim 3, further comprising:
providing, to the respective processing units, the respective second instruction responsive to determining that at least one of a plurality of portions of the first instruction is not available when the respective first instruction is required to be sent to meet the timing requirement associated with the respective first instruction.

### Claim 6 (depends on 3)

The method of claim 3, further comprising:
generating, instead of retrieving from the memory and to provide to the respective processing units, the respective second instruction responsive to determining that the timing requirement associated with the respective first instruction is not expected to be met.

### Claim 7 (depends on 3)

The method of claim 3, further comprising, subsequent to providing the number of first instructions or the number of second instructions, or any combination thereof:
providing, to the respective processing units, the respective first instruction for which the respective second instruction was previously provided as a replacement, responsive to determining that the timing requirement associated with the respective first instruction is now expected to be met.

### Claim 8

An apparatus, comprising:
a controller, the controller comprising a plurality of caches;
wherein the controller is further configured to:
receive, respectively from a plurality of processing units and in a particular order, a number of addresses corresponding to respective locations of a memory shared by the plurality of processing units;
fetch a number of first instructions from the respective locations of the memory; and
provide, at each position of the particular order and to one or more respective processing units, a respective first instruction of the number of first instructions, or a respective second instruction of a number of second instructions based on a determination of whether a timing requirement of each processing unit is expected to be met.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein:
the controller is configured to provide the respective second instruction in replacement of the respective first instruction; and
the respective second instruction, when executed by the respective processing unit, causes the respective processing unit to subsequently issue, to the controller, a respective address of the number of addresses corresponding to the respective first instruction.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the controller is configured to:
provide the respective first instruction in response to a determination that the respective first instruction is available at a respective cache of the plurality of caches when the respective first instruction is required to be sent to meet the timing requirement associated with the respective first instruction.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein the controller is configured to:
provide the respective second instruction in replacement of the respective first instruction in response to a determination that the respective first instruction is not available at a respective cache of the plurality of caches when the respective first instruction is required to be sent to meet the timing requirement associated with the respective first instruction.

### Claim 12 (depends on 9)

The apparatus of claim 9, wherein the controller is configured to:
provide, despite the first instruction being available in a respective cache of the plurality of caches, the respective second instruction in replacement of the respective first instruction in response to a determination that a respective second instruction was provided at a previous position of the particular order.

### Claim 13

A system, comprising:
a plurality of processing units;
a memory shared by the plurality of processing units and configured to store instructions; and
a controller configured to:
sequentially receive a number of addresses respectively from the plurality of processing units, each address corresponding to a respective instruction of a number of instructions;
fetch the number of instructions from the memory;
to respond to each processing unit of the plurality in an order in which the number of addresses were received at the controller from the plurality of processing units:
provide, to a respective processing unit, a respective instruction of the number of instructions in response to a determination that a timing requirement associated with provision of the respective instruction is expected to be met; and
provide, to the respective processing unit, a respective alternative instruction in replacement of the respective instruction in response to a determination that a timing requirement associated with the respective instruction is not expected to be met, wherein the respective alternative instruction, when executed by the respective processing unit, causes the respective processing unit to access an address corresponding to the respective instruction.

### Claim 14 (depends on 13)

The system of claim 13, wherein the controller is configured to:
sequentially receive a first address and a second address of the number of addresses; and
fetch, in response to receipt of the first address and the second address, a first instruction and a second instruction of the number of instructions respectively corresponding to the first address and the second address.

### Claim 15 (depends on 14)

The system of claim 14, wherein the controller is configured to:
provide a first alternative instruction in replacement of the first instruction in response to a determination that the timing requirement associated with the first instruction is not expected to be met.

### Claim 16 (depends on 15)

The system of claim 15, wherein the first alternative instruction is provided in replacement of the first instruction in response to a determination that:
the first instruction is a portion of a particular instruction; and
at least a remaining portion of the particular instruction is not available to be provided to the respective processing unit when the first instruction is required to be provided to the respective processing unit to meet the timing requirement.

### Claim 17 (depends on 15)

The system of claim 15, wherein the controller is configured to:
provide a second alternative instruction in replacement of the second instruction in response to a determination that the first instruction was not previously provided to the respective processing unit.

### Claim 18 (depends on 17)

The system of claim 17, wherein:
the first alternative instruction, when executed by the respective processing unit, causes the respective processing unit to access a location of the memory corresponding to the first address; and
the second alternative instruction, when executed by the respective processing unit, causes the respective processing unit to access a location of the memory corresponding to the second address.

### Claim 19 (depends on 17)

The system of claim 17, wherein the first instruction, the second instruction, or both correspond to a JUMP instruction.

### Claim 20 (depends on 17)

The system of claim 17, wherein the memory is a tightly coupled memory (TCM).
