Dynamic allocation of cache based on instantaneous bandwidth consumption at computing devices

An apparatus comprising:

• one or more processors including a graphics processor;
• a memory for storage of data;
• a graphics cache associated with the graphics processor, wherein the one or more processors are to:
• monitor incoming ingress throughput demand for threads of a plurality of threads accessing the graphics cache, the graphics cache to support a plurality of ways;
• measure an average throughput for one or more thread of the plurality of threads over a plurality of intervals, each interval being a certain number of clocks in duration;
• determine an instantaneous cache bandwidth being consumed from the graphics cache by the one or more threads of the plurality of threads based at least in part upon the measured average throughput measurement for the one or more threads;
• and
• dynamically allocate one or more portions of the plurality of ways of the graphics cache to the one or more threads of the plurality of threads in accordance with the determined instantaneous cache bandwidth consumption.

A method comprising:

• monitoring incoming ingress throughput demand for threads of a plurality of threads accessing a graphics cache associated with a graphics processor, the graphics cache to support a plurality of ways;
• measuring an average throughput for one or more thread of the plurality of threads over a plurality of intervals, each interval being a certain number of clocks in duration;
• determining an instantaneous cache bandwidth being consumed from the graphics cache by the one or more threads of the plurality of threads based at least in part upon the measured average throughput measurement for the one or more threads;
• and
• dynamically allocating one or more portions of the plurality of ways of the graphics cache to the one or more threads of the plurality of threads in accordance with the determined instantaneous cache bandwidth consumption.

At least one non-transitory machine-readable medium comprising instructions that when executed by a computing device, cause the computing device to perform operations comprising:

• monitoring incoming ingress throughput demand for threads of a plurality of threads accessing a graphics cache associated with a graphics processor, the graphics cache to support a plurality of ways;
• measuring an average throughput for one or more thread of the plurality of threads over a plurality of intervals, each interval being a certain number of clocks in duration;
• determining an instantaneous cache bandwidth being consumed from the graphics cache by the one or more threads of the plurality of threads based at least in part upon the measured average throughput measurement for the one or more threads;
• and
• dynamically allocating one or more portions of the plurality of ways of the graphics cache to the one or more threads of the plurality of threads in accordance with the determined instantaneous cache bandwidth consumption.