Dynamic inclusive policy in a hybrid cache hierarchy using hit rate

A computer program product comprising a non-transitory computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a computing device, causes the computing device to:

• monitor a first cache hit rate in a first subset of N sets of a lower level cache, wherein the first subset is utilizing a first allocation policy;
• monitor a second cache hit rate in a second subset of the N sets of the lower level cache, wherein the second subset is utilizing a second allocation policy different from the first allocation policy;
• periodically compare the first cache hit rate to the second cache hit rate to identify a third allocation policy for a third subset of the N-sets of the lower level cache, wherein the third allocation policy is at least one of the first allocation policy or the second allocation policy;
• and
• periodically adjust the third allocation policy for the third subset of the N-sets of the lower level cache based on the comparison of the first cache hit rate to the second cache hit rate.

An apparatus, comprising:

• a processor;
• and
• a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to:
• monitor a first cache hit rate in a first subset of N sets of a lower level cache, wherein the first subset is utilizing a first allocation policy;
• monitor a second cache hit rate in a second subset of the N sets of the lower level cache, wherein the second subset is utilizing a second allocation policy different from the first allocation policy;
• periodically compare the first cache hit rate to the second cache hit rate to identify a third allocation policy for a third subset of the N-sets of the lower level cache, wherein the third allocation policy is at least one of the first allocation policy or the second allocation policy;
• and
• periodically adjust the third allocation policy for the third subset of the N-sets of the lower level cache based on the comparison of the first cache hit rate to the second cache hit rate.