# US 2024/0202144 A1 · Coherent block read fulfillment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202144 A1
- Document ID: US20240202144A1
- Status: Published application
- Kind: A1
- Application number: 18/410,554
- Filed: 2024-01-11
- Published: 2024-06-20
- Earliest claimed: 2021-12-21
- Assignees: Advanced Micro Devices, Inc.
- Applicants: Advanced Micro Devices, Inc.
- Inventors: Vydhyanathan Kalyanasundharam; Amit P. Apte; Eric Christopher Morton; Ganesh Balakrishnan; Ann M. Ling
- Web page: https://patentgrep.com/patent/US20240202144A1

## CPC

- G06F 13/1673: {using buffers}
- G06F 3/061: {Improving I/O performance}
- G06F 3/0656: {Data buffering arrangements}
- G06F 3/0658: {Controller construction arrangements}
- G06F 3/0659: {Command handling arrangements, e.g. command buffers, queues, command scheduling}
- G06F 3/067: {Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]}
- G06F 3/0679: {Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]}
- G06F 3/0688: {Non-volatile semiconductor memory arrays}
- G06F 12/0831: using a bus scheme, e.g. with bus monitoring or watching means
- G06F 12/0833: {in combination with broadcast means (e.g. for invalidation or updating)}
- G06F 2212/1016: Performance improvement
- G06F 2212/1024: Latency reduction
- G06F 2213/0038: System on Chip
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A coherent memory fabric includes a plurality of coherent master controllers and a coherent slave controller. The plurality of coherent master controllers each include a response data buffer. The coherent slave controller is coupled to the plurality of coherent master controllers. The coherent slave controller, responsive to determining a selected coherent block read command is guaranteed to have only one data response, sends a target request globally ordered message to the selected coherent master controller and transmits responsive data. The selected coherent master controller, responsive to receiving the target request globally ordered message, blocks any coherent probes to an address associated with the selected coherent block read command until receipt of the responsive data is acknowledged by a requesting client.

## Claims

### Claim 1

A coherent memory fabric comprising:
a plurality of coherent master controllers each including a response data buffer; and
a coherent slave controller coupled to the plurality of coherent master controllers, the coherent slave controller operable to send a message to a selected one of the coherent master controllers indicating that a selected coherent block read command from the selected coherent master controller has only one data response, and transmit responsive data.

### Claim 2 (depends on 1)

The coherent memory fabric of claim 1, wherein the selected coherent master controller, responsive to the message, updates an allocation in the response data buffer such that only one response data buffer entry is reserved for the selected coherent block read command.

### Claim 3 (depends on 2)

The coherent memory fabric of claim 2, wherein the selected coherent master controller is operable to, responsive to receiving the message, block any coherent probes to an address associated with the selected coherent block read command until receipt of the responsive data is acknowledged by a requesting client.

### Claim 4 (depends on 2)

The coherent memory fabric of claim 2, wherein the selected coherent master controller, after updating the allocation, immediately transmits a subsequent memory access command to the coherent slave controller.

### Claim 5 (depends on 1)

The coherent memory fabric of claim 1, wherein:
the coherent slave controller further comprises a coherent slave data buffer; and
the coherent slave controller, responsive to determining a selected coherent block read command from a selected coherent master controller is guaranteed to have only one data response, de-allocates an entry of the coherent slave data buffer previously allocated for the responsive data immediately following transmitting the responsive data without requiring a source done message from the selected coherent master controller.

### Claim 6 (depends on 5)

The coherent memory fabric of claim 5, wherein:
the coherent slave controller, responsive to determining a second selected coherent block read command is not guaranteed to have only one data response, transmits a target done message to the selected coherent master controller, transmits response data to the selected coherent master controller, and de-allocates a coherent slave data buffer entry for the responsive data only after receiving a source done message from the selected coherent master controller indicating that the responsive data has been received.

### Claim 7 (depends on 1)

The coherent memory fabric of claim 1, wherein the coherent slave controller determines that the selected coherent block read command is guaranteed to have only one data response by performing a probe filter lookup in a probe filter associated with the plurality of coherent master controllers.

### Claim 8

A method, comprising:
from a coherent master controller, transmitting a coherent block read command to a coherent slave controller over a coherent data fabric;
at the coherent slave controller, sending a message to the coherent master controller indicating that the coherent block read command has only one data response and transmitting responsive data.

### Claim 9 (depends on 8)

The method of claim 8, wherein the coherent master controller, responsive to the message, updates an allocation in a response data buffer such that only one response data buffer entry is reserved for the coherent block read command.

### Claim 10 (depends on 9)

The method of claim 9, further comprising, at the coherent master controller, responsive to receiving the message, blocking any coherent probes to an address associated with the coherent block read command until the responsive data is received.

### Claim 11 (depends on 9)

The method of claim 9, wherein the coherent master controller, after updating the allocation, immediately transmits a subsequent memory access command to the coherent slave controller.

### Claim 12 (depends on 8)

The method of claim 8, wherein the coherent slave controller, responsive to determining the coherent block read command from a selected coherent master controller is guaranteed to have only one data response, de-allocates an entry of a coherent slave data buffer previously allocated for the responsive data immediately following transmitting the responsive data without requiring a source done message from the selected coherent master controller.

### Claim 13 (depends on 8)

The method of claim 8, wherein the coherent slave controller, responsive to determining that a second coherent block read command is not guaranteed to have only one data response, transmits a target done message to the coherent master controller, transmits second response data to the coherent master controller, and de-allocates a data buffer entry for the responsive data only after receiving a source done message from the coherent master controller indicating that the second response data has been received; and

### Claim 14 (depends on 8)

The method of claim 8, wherein the coherent slave controller begins transmitting the responsive data in parallel with sending the message, or immediately after sending the message.

### Claim 15 (depends on 8)

The method of claim 8, wherein the coherent slave controller determines that the coherent block read command is guaranteed to have only one data response by performing a probe filter lookup in a probe filter associated with a plurality of coherent master controllers.

### Claim 16

A data processing system comprising:
a plurality of data processors;
a volatile memory; and
a coherent memory fabric including:
a plurality of coherent master controllers coupled to respective ones of the data processors and each including a response data buffer; and
a coherent slave controller coupled to the volatile memory over a bus, and coupled to the plurality of coherent master controllers, the coherent slave controller operable to, send a message to a selected one of the coherent master controllers indicating that a selected coherent block read command from the selected coherent master controller has only one data response, and transmit responsive data.

### Claim 17 (depends on 16)

The data processing system of claim 16, wherein the selected coherent master controller, responsive to the message, updates an allocation in the response data buffer such that only one response data buffer entry is reserved for the selected coherent block read command.

### Claim 18 (depends on 17)

The data processing system of claim 17, wherein the selected coherent master controller is operable to, responsive to receiving the message, block any coherent probes to an address associated with the selected coherent block read command until the responsive data is received.

### Claim 19 (depends on 16)

The data processing system of claim 16, wherein:
the coherent slave controller further comprises a coherent slave data buffer; and
the coherent slave controller, responsive to determining a selected coherent block read command from a selected coherent master controller is guaranteed to have only one data response, de-allocates an entry of the coherent slave data buffer previously allocated for the responsive data immediately following transmitting the responsive data without requiring a source done message from the selected coherent master controller.

### Claim 20 (depends on 19)

The data processing system of claim 19, wherein:
the coherent slave controller, responsive to determining a second selected coherent block read command is not guaranteed to have only one data response, transmits a target done message to the selected coherent master controller, transmits response data to the selected coherent master controller, and de-allocates a coherent slave data buffer entry for the responsive data only after receiving a source done message from the selected coherent master controller indicating that the response data has been received.
