Dynamic allocation of cache based on instantaneous bandwidth consumption at computing devices
AssigneeIntel Corporation
InventorsKiran C. Veernapu, Mohammed Tameem, Altug Koker, Abhishek R. Appu
Life of this patent
Estimating the term…
Abstract
A mechanism is described for facilitating dynamic cache allocation in computing devices in computing devices. A method of embodiments, as described herein, includes facilitating monitoring one or more bandwidth consumptions of one or more clients accessing a cache associated with a processor; computing one or more bandwidth requirements of the one or more clients based on the one or more bandwidth consumptions; and allocating one or more portions of the cache to the one or more clients in accordance with the one or more bandwidth requirements.
Claims22
1-20. (canceled)
An apparatus comprising:
- one or more processors including a graphics processor to:
- detect a plurality of threads for one or more clients, the threads accessing a graphics cache associated with the graphics processor;
- monitor incoming ingress throughput demand for each of the plurality of threads accessing the graphics cache;
- measure an average throughput for each of the plurality of threads over a plurality of windows in a sliding window measurement;
- determine an instantaneous cache bandwidth being consumed from the graphics cache by each of the plurality of threads based at least in part upon the average throughput measurement for each of the plurality of threads;
- and
- dynamically allocate one or more portions of the graphics cache to one or more of the plurality of threads in accordance with the determined instantaneous cache bandwidth consumption.
A method comprising:
- detecting a plurality of threads for one or more clients, the threads accessing a graphics cache associated with a graphics processor of one or more processors of an apparatus;
- monitoring incoming ingress throughput demand for each of the plurality of threads accessing the graphics cache;
- measuring an average throughput for each of the plurality of threads over a plurality of windows in a sliding window measurement;
- determining an instantaneous cache bandwidth being consumed from the thread by each of the plurality of threads based at least in part upon the average throughput measurement for each of the plurality of threads;
- and
- dynamically allocating one or more portions of the graphics cache to one or more of the plurality of threads in accordance with the determined instantaneous cache bandwidth consumption.
At least one non-transitory machine-readable medium comprising instructions that when executed by a computing device, cause the computing device to perform operations comprising:
- detecting a plurality of threads for one or more clients, the threads accessing a graphics cache associated with a graphics processor of one or more processors of the computing device;
- monitoring incoming ingress throughput demand for each of the plurality of threads accessing the graphics cache;
- measuring an average throughput for each of the plurality of threads over a plurality of windows in a sliding window measurement;
- determining an instantaneous cache bandwidth being consumed from the graphics cache by each of the plurality of threads based at least in part upon the average throughput measurement for each of the plurality of threads;
- and
- dynamically allocating one or more portions of the graphics cache to one or more of the plurality of threads in accordance with the determined instantaneous cache bandwidth consumption.
Dependencies are inferred from the claim text.