# US 2015/0178207 A1 · System and method for cache monitoring in storage systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0178207 A1
- Document ID: US20150178207A1
- Status: Published application
- Kind: A1
- Application number: 14/136,670
- Filed: 2013-12-20
- Published: 2015-06-25
- Earliest claimed: 2013-12-20
- Assignees: NetApp, Inc.
- Applicants: Netapp, Inc.
- Inventors: Sai Rama Krishna Susarla; Girish Kumar B K
- Web page: https://patentgrep.com/patent/US20150178207A1

## CPC

- G06F 12/123: with age lists, e.g. queue, most recently used [MRU] list or least recently used [LRU] list
- G06F 11/3037: {where the computing system component is a memory, e.g. virtual memory, cache (accessing, addressing or allocating within memory systems or architectures G06F12/00; checking stores for correct operation G11C29/00)}
- G06F 11/3055: {Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available (error or fault processing without redundancy G06F11/0703; error detection or correction by redundancy in data representation G06F11/08; error detection or correction of the data by redundancy in operations G06F11/14; error detection or correction by redundancy in hardware G06F11/16)}
- G06F 11/3466: {Performance evaluation by tracing or monitoring}
- G06F 12/0862: with prefetch
- G06F 12/0871: Allocation or management of cache space
- G06F 12/0891: using clearing, invalidating or resetting means
- G06F 12/121: using replacement algorithms
- G06F 2212/1021: Hit rate improvement
- G06F 2212/602: Details relating to cache prefetching
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A system and method of cache monitoring in storage systems includes storing storage blocks in a cache memory. Each of the storage blocks is associated with status indicators. As requests are received at the cache memory, the requests are processed and the status indicators associated with the storage blocks are updated in response to the processing of the requests. One or more storage blocks are selected for eviction when a storage block limit is reached. As ones of the selected one or more storage blocks are evicted from the cache memory, the block counters are updated based on the status indicators associated with the evicted storage blocks. Each of the block counters is associated with a corresponding combination of the status indicators. Caching statistics are periodically updated based on the block counters.

## Claims

### Claim 1

A method of caching, the method comprising:
storing storage blocks in a cache memory, each of the storage blocks being associated with status indicators;
as requests are received at the cache memory:
processing the requests; and
updating the status indicators associated with the storage blocks in response to the processing of the requests;
selecting one or more storage blocks for eviction when a storage block limit is reached;
as the selected one or more storage blocks are evicted from the cache memory, updating block counters based on the status indicators associated with the evicted storage blocks, each of the block counters being associated with a corresponding combination of the status indicators; and
periodically updating caching statistics based on the block counters.

### Claim 2 (depends on 1)

The method of claim 1 wherein:
each of the storage blocks is associated with a tenant identifier; and
the method further comprises updating the block counters further based on the tenant identifier associated with the evicted storage blocks.

### Claim 3 (depends on 1)

The method of claim 1 wherein:
the status indicators include a written status indicator; and
the method further comprises updating the written status indicator associated with the storage blocks that are accessed by a write request.

### Claim 4 (depends on 3)

The method of claim 3 wherein:
the written status indicator is a written counter; and
updating the written status indicator comprises incrementing the written counter.

### Claim 5 (depends on 1)

The method of claim 1 wherein:
the status indicators include a hit status indicator; and
the method further comprises updating the hit status indicator associated with the storage blocks that are accessed by a read request that results in a cache hit.

### Claim 6 (depends on 5)

The method of claim 5 wherein:
the hit status indicator is a read counter; and
updating the hit status indicator comprises incrementing the read counter.

### Claim 7 (depends on 1)

The method of claim 1 wherein:
the status indicators associated with each of the evicted storage blocks determine a respective eviction state for each of the evicted storage blocks; and
updating the block counters comprises updating a selected one of the block counters based on the respective eviction state of each of the evicted storage blocks.

### Claim 8 (depends on 7)

The method of claim 7 wherein:
each of the storage blocks is associated with tenant information; and
selecting the selected one of the block counters is further based on the respective tenant information associated with each of the evicted storage blocks.

### Claim 9 (depends on 1)

The method of claim 1 wherein:
each of the storage blocks is associated with tenant information; and
the tenant information is a client identifier or a storage unit identifier.

### Claim 10 (depends on 1)

The method of claim 1 wherein updating the caching statistics comprises determining a cache space utilization based on a ratio of a number of the storage blocks that are associated with each tenant stored in the cache memory and a number of the storage blocks stored in the cache memory.

### Claim 11 (depends on 1)

The method of claim 1 wherein updating the caching statistics comprises determining a back end input output bandwidth based on a total of the block counters.

### Claim 12 (depends on 1)

The method of claim 1 wherein:
the status indicators include a prefetch status indicator; and
processing the requests comprises:
fetching prefetched storage blocks based on the requests; and
updating the prefetch status indicator associated with the prefetched storage blocks.

### Claim 13

A caching system comprising:
a cache controller; and
a memory coupled to the cache controller for storing cache blocks, each of the cache blocks being associated with status values including a written status value, a prefetched status value, and a hit status value;
wherein the cache controller is configured to:
as storage requests are received, update the status values associated with the cache blocks accessed by the storage requests in response to processing the storage requests;
select one or more cache blocks for eviction when a cache block limit is reached;
as the selected one or more cache blocks are evicted from the memory, update eviction counters based on the status values of the evicted cache blocks; and
periodically update caching system metrics based on the eviction counters.

### Claim 14 (depends on 13)

The caching system of claim 13 wherein:
each of the cache blocks is associated with tenant information; and
the cache controller is further configured to update the eviction counters based on the tenant information associated with the evicted cache blocks.

### Claim 15 (depends on 13)

The caching system of claim 13, wherein the cache controller is further configured to:
determine a cache effectiveness metric based on comparisons of one more combinations of the eviction counters; and
determine a prefetch effectiveness metric based on one or more of the eviction counters associated with the prefetch status value.

### Claim 16

A method of updating a caching system storing blocks of data associated with tenants, the method comprising:
processing a plurality of storage requests received by the caching system;
generating one or more caching metrics over a period of time based on state variables that are tracked during processing of the storage requests and when blocks of data are evicted from the caching system, the state variables including a written state variable, a prefetch state variable, and a hit state variable; and
adjusting one or more characteristics of the caching system based on the caching metrics.

### Claim 17 (depends on 16)

The method of claim 16, further comprising aggregating the caching metrics over multiple periods of time.

### Claim 18 (depends on 16)

The method of claim 16 wherein:
generating the caching metrics comprises determining a cache effectiveness metric based on comparisons of one or more combinations of counters associated with combinations of the state variables; and
adjusting the one or more characteristics of the caching system comprises shifting caching system resources to tenants with a higher cache effectiveness metric.

### Claim 19 (depends on 16)

The method of claim 16 wherein:
generating the caching metrics comprises determining a prefetch effectiveness metric based on one or more of the counters associated with the prefetch state variable; and
adjusting the one or more characteristics of the caching system comprises adjusting a number of blocks speculatively fetched in response to a read request based on the prefetch effectiveness metric.

### Claim 20 (depends on 16)

The method of claim 16 wherein:
generating the caching metrics comprises determining a cache space utilization metric based on a ratio of a number of blocks of data stored in the caching system that are associated with each tenant of the caching system and a number of blocks of data stored in the caching system; and
adjusting the one or more characteristics of the caching system comprises limiting a number of blocks of data that the caching system may be allowed to store for each tenant of the caching system when the cache space utilization metric shows an imbalance in cache system use among tenants of the caching system.
