# US 2009/0276572 A1 · Memory Management Among Levels of Cache in a Memory Hierarchy

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2009/0276572 A1
- Document ID: US20090276572A1
- Status: Published application
- Kind: A1
- Application number: 12/113,286
- Filed: 2008-05-01
- Published: 2009-11-05
- Earliest claimed: 2008-05-01
- Assignees: International Business Machines Corporation
- Inventors: Timothy H. Heil; Robert A. Shearer
- Web page: https://patentgrep.com/patent/US20090276572A1

## CPC

- G06F 12/122: of the least frequently used [LFU] type, e.g. with individual count value
- G06F 12/128: adapted to multidimensional cache systems, e.g. set-associative, multicache, multiset or multilevel
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods, apparatus, and product for memory management among levels of cache in a memory hierarchy in a computer with a processor operatively coupled through two or more levels of cache to a main random access memory, caches closer to the processor in the hierarchy characterized as higher in the hierarchy, including: identifying a line in a first cache that is preferably retained in the first cache, the first cache backed up by at least one cache lower in the memory hierarchy, the lower cache implementing an LRU-type cache line replacement policy; and updating LRU information for the lower cache to indicate that the line has been recently accessed.

## Claims

### Claim 1

A method of memory management among levels of cache in a memory hierarchy in a computer with a processor operatively coupled through two or more levels of cache to a main random access memory, caches closer to the processor in the hierarchy characterized as higher in the hierarchy, the method comprising:
identifying a line in a first cache that is preferably retained in the first cache, the first cache backed up by at least one cache lower in the memory hierarchy, the lower cache implementing a least recently used type (‘LRU-type’) cache line replacement policy; and
updating LRU information for the lower cache to indicate that the line has been recently accessed.

### Claim 2 (depends on 1)

The method of claim 1 wherein identifying a line preferably retained further comprises identifying the line as preferably retained on every access in the cache.

### Claim 3 (depends on 1)

The method of claim 1 wherein identifying a line preferably retained further comprises:
identifying the line as preferably retained when the line is accessed, not on every access, but only upon a randomly-selected subset of accesses.

### Claim 4 (depends on 1)

The method of claim 1 wherein identifying line further comprises:
identifying the line as preferably retained when the line is accessed, not on every access, but only periodically according to a predetermined interval of time.

### Claim 5 (depends on 1)

The method of claim 1 wherein identifying line further comprises:
identifying the line as preferably retained when the line is accessed, not on every access, but only periodically according to a predetermined number of accesses.

### Claim 6 (depends on 1)

The method of claim 1 wherein the method is implemented on a network on chip (‘NOC’), the NOC comprising integrated processor (‘IP’) blocks, routers, memory communications controllers, and network interface controller, each IP block adapted to a router through a memory communications controller and a network interface controller, each memory communications controller controlling communication between an IP block and memory, and each network interface controller controlling inter-IP block communications through routers.

### Claim 7

An apparatus for memory management among levels of cache in a memory hierarchy in a computer with a processor operatively coupled through two or more levels of cache to a main random access memory, caches closer to the processor in the hierarchy characterized as higher in the hierarchy, the apparatus comprising a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions capable of:
identifying a line in a first cache that is preferably retained in the first cache, the first cache backed up by at least one cache lower in the memory hierarchy, the lower cache implementing a least recently used type (‘LRU-type’) cache line replacement policy; and
updating LRU information for the lower cache to indicate that the line has been recently accessed.

### Claim 8 (depends on 7)

The apparatus of claim 7 wherein identifying a line preferably retained further comprises identifying the line as preferably retained on every access in the cache.

### Claim 9 (depends on 7)

The apparatus of claim 7 wherein identifying a line in a first cache that is preferably retained in the first cache further comprises:
identifying the line as preferably retained when the line is accessed, not on every access, but only upon a randomly-selected subset of accesses.

### Claim 10 (depends on 7)

The apparatus of claim 7 wherein identifying a line in a first cache that is preferably retained in the first cache further comprises:
identifying the line as preferably retained when the line is accessed, not on every access, but only periodically according to a predetermined interval of time.

### Claim 11 (depends on 7)

The apparatus of claim 7 wherein identifying a line in a first cache that is preferably retained in the first cache further comprises:
identifying the line as preferably retained when the line is accessed, not on every access, but only periodically according to a predetermined number of accesses.

### Claim 12 (depends on 7)

The apparatus of claim 7 further comprising a network on chip (‘NOC’), the NOC comprising integrated processor (‘IP’) blocks, routers, memory communications controllers, and network interface controller, each IP block adapted to a router through a memory communications controller and a network interface controller, each memory communications controller controlling communication between an IP block and memory, and each network interface controller controlling inter-IP block communications through routers.

### Claim 13

A computer program product for memory management among levels of cache in a memory hierarchy in a computer with a processor operatively coupled through two or more levels of cache to a main random access memory, caches closer to the processor in the hierarchy characterized as higher in the hierarchy, the computer program product disposed in a computer readable, signal bearing medium, the computer program product comprising computer program instructions capable of:
identifying a line in a first cache that is preferably retained in the first cache, the first cache backed up by at least one cache lower in the memory hierarchy, the lower cache implementing a least recently used type (‘LRU-type’) cache line replacement policy; and
updating LRU information for the lower cache to indicate that the line has been recently accessed.

### Claim 14 (depends on 13)

The computer program product of claim 13 wherein identifying a line preferably retained further comprises identifying the line as preferably retained on every access in the cache.

### Claim 15 (depends on 13)

The computer program product of claim 13 wherein identifying a line preferably retained further comprises:
identifying the line as preferably retained when the line is accessed, not on every access, but only upon a randomly-selected subset of accesses.

### Claim 16 (depends on 13)

The computer program product of claim 13 wherein identifying line further comprises:
identifying the line as preferably retained when the line is accessed, not on every access, but only periodically according to a predetermined interval of time.

### Claim 17 (depends on 13)

The computer program product of claim 13 wherein identifying line further comprises:
identifying the line as preferably retained when the line is accessed, not on every access, but only periodically according to a predetermined number of accesses.

### Claim 18 (depends on 13)

The computer program product of claim 13 wherein the computer program instructions are capable of execution upon a network on chip (‘NOC’), the NOC comprising integrated processor (‘IP’) blocks, routers, memory communications controllers, and network interface controller, each IP block adapted to a router through a memory communications controller and a network interface controller, each memory communications controller controlling communication between an IP block and memory, and each network interface controller controlling inter-IP block communications through routers.

### Claim 19 (depends on 13)

The computer program product of claim 13 wherein the signal bearing medium comprises a recordable medium.

### Claim 20 (depends on 13)

The computer program product of claim 13 wherein the signal bearing medium comprises a transmission medium.
