Cache structure and utilization

One or more non-transitory computer-readable storage mediums having stored thereon executable computer program instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

• monitoring operation of a cache in a computing system, the computing system including one or more processors including a graphics processing unit (GPU), wherein the cache includes least recently used (LRU) information and wherein monitoring operation of the cache includes monitoring the LRU information of the cache and monitoring cache lines for potential pre-eviction;
• detecting a low activity period in operation of the cache;
• identifying one or more cache lines of the cache as dirty based at least in part on the monitoring, and scrubbing the identified one or more cache lines during the low activity period prior to allocation of the one or more cache lines for fetched data, wherein scrubbing the identified one or more cache lines includes writing data from the one or more cache lines back to a source;
• and
• identifying one or more cache lines for pre-eviction based at least in part on the monitoring, and evicting data from the one or more cache lines prior to allocation of the one or more cache lines for fetched data.

A method comprising:

• monitoring operation of a cache in a computing system, the computing system including one or more processors including a graphics processing unit (GPU), wherein the cache includes least recently used (LRU) information and wherein monitoring operation of the cache includes monitoring the LRU information of the cache and monitoring cache lines for potential pre-eviction;
• detecting a low activity period in operation of the cache;
• identifying one or more cache lines of the cache as dirty based at least in part on the monitoring, and scrubbing the identified one or more cache lines during the low activity period prior to allocation of the one or more cache lines for fetched data, wherein scrubbing the identified one or more cache lines includes writing data from the one or more cache lines back to a source;
• and
• identifying one or more cache lines for pre-eviction based at least in part on the monitoring, and evicting data from the one or more cache lines prior to allocation of the one or more cache lines for fetched data.