Memory access response merging in a memory hierarchy

A method comprising:

• storing, in a queue by control logic, a plurality of memory access responses;
• marking, by the control logic, a first memory access response as not being a candidate for issue from the queue, in response to determining a corresponding first memory access request accesses data stored in a cache at a same level of a memory hierarchy as the cache controller;
• and
• merging information, into the first memory access response by the control logic, corresponding to one or more memory access requests, in response to determining:
• the one or more memory access requests target a same cache line as the first memory access request;
• and
• a period of time elapsed since the first memory access response was marked is less than a threshold.

A computing system comprising:

• a plurality of compute units configured to generate memory access requests;
• a communication fabric;
• a cache controller coupled to the plurality of compute units via the communication fabric;
• wherein the cache controller is configured to:
• store, in a queue, a plurality of memory access responses;
• mark a first memory access response as not being a candidate for issue from the queue based at least in part on a determination that a corresponding first memory access request accesses data stored in a cache at a same level of a memory hierarchy as the cache controller;
• and
• merge information, into the first memory access response, corresponding to one or more memory access requests based at least in part on a determination that:
• the one or more memory access requests target a same cache line as the first memory access request;
• and
• a period of time elapsed since the first memory access response was marked is less than a threshold.