Systems and methods for exploiting queues and transitional storage for improved low-latency high-bandwidth on-die data retrieval

A method comprising:

• causing, by logic associated with processing circuitry of a computing device, a request associated with a processing resource to be transferred to a queue or transitional buffer for temporary storage instead of transferring the request to off-chip memory when the queue or transitional buffer has a predetermined amount of storage capacity, wherein the request is transferred to the queue or transitional buffer without being processed instead of being transferred to the off- chip memory when the queue or the transitional buffer has the predetermined amount of storage capacity that is greater than a threshold level;
• transferring the request to one or more of a different queue, a different transitional buffer, or a next level of memory when the queue or transitional buffer lacks the predetermined amount of storage capacity;
• and
• determining whether the queue or transitional buffer has the predetermined amount of storage capacity including greater than a threshold level of storage capacity.

At least one non-transitory computer-readable medium having stored thereon instructions which, when executed, cause a computing device to perform operations comprising:

• causing, by logic associated with processing circuitry of the computing device, a request associated with a processing resource to be transferred to a queue or transitional buffer for temporary storage instead of transferring the request to off-chip memory when the queue or transitional buffer has a predetermined amount of storage capacity, wherein the request is transferred to the queue or transitional buffer without being processed instead of being transferred to the off- chip memory when the queue or the transitional buffer has the predetermined amount of storage capacity that is greater than a threshold level;
• transferring the request to one or more of a different queue, a different transitional buffer, or a next level of memory when the queue or transitional buffer lacks the predetermined amount of storage capacity;
• and
• determining whether the queue or transitional buffer has the predetermined amount of storage capacity including greater than a threshold level of storage capacity.