# US 2020/0401321 A1 · Speculative hint-triggered activation of pages in memory

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401321 A1
- Document ID: US20200401321A1
- Status: Published application
- Kind: A1
- Application number: 16/841,514
- Filed: 2020-04-06
- Published: 2020-12-24
- Earliest claimed: 2017-11-20
- Assignees: Advanced Micro Devices, Inc.
- Applicants: Advanced Micro Devices, Inc.
- Inventors: Ravindra N. Bhargava; Philip S. Park; Vydhyanathan Kalyanasundharam; James Raymond Magro
- Web page: https://patentgrep.com/patent/US20200401321A1

## CPC

- G06F 3/0611: {in relation to response time}
- G06F 3/0656: {Data buffering arrangements}
- G06F 3/0689: {Disk arrays, e.g. RAID, JBOD}
- G06F 9/528: {by using speculative mechanisms}
- G06F 13/161: {with latency improvement}
- G06F 13/1636: {using refresh}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems, apparatuses, and methods for performing efficient memory accesses for a computing system are disclosed. In various embodiments, a computing system includes a computing resource and a memory controller coupled to a memory device. The computing resource selectively generates a hint that includes a target address of a memory request generated by the processor. The hint is sent outside the primary communication fabric to the memory controller. The hint conditionally triggers a data access in the memory device. When no page in a bank targeted by the hint is open, the memory controller processes the hint by opening a target page of the hint without retrieving data. The memory controller drops the hint if there are other pending requests that target the same page or the target page is already open.

## Claims

### Claim 1

A computing system comprising:
a communication fabric;
a processor configured to generate memory requests; and
a memory controller coupled to receive the memory requests from the processor via the communication fabric;
wherein the processor is further configured to:
identify a first memory request;
generate a second memory request responsive to determining the first memory request is hint qualified, wherein a memory request targeting a page that is hint qualified causes generation of an additional memory request targeting the page;
send the second memory request to the memory controller via an alternate path that is different from the communication fabric; and
send the first memory request to the memory controller via the communication fabric.

### Claim 2 (depends on 1)

The computing system as recited in claim 1, wherein the second memory request is an activate-only request configured to open a given page targeted by the first memory request without retrieving data targeted by the first memory request.

### Claim 3 (depends on 2)

The computing system as recited in claim 2, wherein the memory controller is configured to open the given page in further response to determining other received memory requests do not also target the target page.

### Claim 4 (depends on 2)

The computing system as recited in claim 2, wherein in response to determining a different page other than the given page in a memory array bank is open, the memory controller is configured to:
drop the second memory request responsive to determining the different page is not closed within a threshold amount of time; and
open the given page responsive to determining the different page is closed within the threshold amount of time.

### Claim 5 (depends on 2)

The computing system as recited in claim 2, wherein in response to determining one or more other received memory requests target at least one of the given page or a same bank that includes the given page, the memory controller is configured to drop the second memory request.

### Claim 6 (depends on 2)

The computing system as recited in claim 2, wherein the communication fabric is configured to support one or more protocols not supported by the alternate path.

### Claim 7 (depends on 1)

The computing system as recited in claim 1, wherein to determine that the first memory request is hint qualified, the processor is configured to:
determine that a number of memory requests generated by a given thread is greater than a first threshold; and
determine that a number of memory requests generated by a processor executing the thread is greater than a second threshold.

### Claim 8 (depends on 1)

The computing system as recited in claim 1, wherein to determine that the first memory request is hint qualified, the processor is configured to determine that the first memory request has a priority greater than a given threshold.

### Claim 9

A method for use by a processor coupled to a memory device via a communication fabric, the method comprising:
generating memory requests for data stored in a memory device;
identifying a first memory request;
generating a second memory request responsive to determining that the first memory request is hint qualified, wherein a memory request targeting a page that is hint qualified causes generation of an additional memory request targeting the page;
sending the second memory request from the processor to the memory controller via an alternate path that is different from the communication fabric; and
sending the first memory request to the memory controller via the communication fabric.

### Claim 10 (depends on 9)

The method as recited in claim 9, wherein the second memory request is an activate-only request configured to open a given page targeted by the first memory request without retrieving data targeted by the first memory request.

### Claim 11 (depends on 10)

The method as recited in claim 10, further comprising the memory controller opening the given page in further response to determining other received memory requests do not also target the target page.

### Claim 12 (depends on 10)

The method as recited in claim 10, wherein in response to determining a different page other than the given page in a memory array bank is open, the method comprises the memory controller:
dropping the second memory request responsive to determining the different page is not closed within a threshold amount of time; and
opening the given page responsive to determining the different page is closed within the threshold amount of time.

### Claim 13 (depends on 10)

The method as recited in claim 10, wherein in response to determining one or more other received memory requests target at least one of the given page or a same bank that includes the given page, the method comprises the memory controller dropping the second memory request.

### Claim 14 (depends on 10)

The method as recited in claim 10, wherein the communication fabric is configured to support one or more protocols not supported by the alternate path.

### Claim 15 (depends on 9)

The method as recited in claim 9, wherein to determine that the first memory request is hint qualified, the method comprises:
determining that a number of memory requests generated by a given thread is greater than a first threshold; and
determining that a number of memory requests generated by a processor executing the thread is greater than a second threshold.

### Claim 16 (depends on 9)

The method as recited in claim 9, wherein to determine that the first memory request is hint qualified, the method comprises determining that the first memory request has a priority greater than a given threshold.

### Claim 17

A memory controller comprising:
a first interface for receiving memory requests via a communication fabric;
a second interface for receiving memory requests via an alternate path different from the communication fabric;
a third interface for sending memory requests to a memory device; and
control logic configured to generate an activate only request to the memory device to open a given page targeted by a given received memory request based, responsive to detecting a given condition.

### Claim 18 (depends on 17)

The memory controller as recited in claim 17, wherein the activate-only request is configured to open the given page without retrieving data targeted by the given received memory request.

### Claim 19 (depends on 17)

The memory controller as recited in claim 17, wherein the given condition comprises determining other received memory requests do not also target the target page.

### Claim 20 (depends on 17)

The memory controller as recited in claim 17, wherein in response to determining a different page other than the given page in a memory array bank is open, the memory controller is configured to:
drop the second memory request responsive to determining the different page is not closed within a threshold amount of time; and
open the given page responsive to determining the different page is closed within the threshold amount of time.
