# US 2008/0307169 A1 · Method, Apparatus, System and Program Product Supporting Improved Access Latency for a Sectored Directory

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0307169 A1
- Document ID: US20080307169A1
- Status: Published application
- Kind: A1
- Application number: 11/758,851
- Filed: 2007-06-06
- Published: 2008-12-11
- Earliest claimed: 2007-06-06
- Inventors: Duane Arlyn Averill; Jonathon C. Skarphol; Brian T. Vanderpool
- Web page: https://patentgrep.com/patent/US20080307169A1

## CPC

- G06F 12/0817: using directory methods
- G06F 2212/1016: Performance improvement
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A data processing system includes a coherence directory having a prefetch sector cache and a memory directory array containing a plurality of sectored entries. According to one method, in response to receiving a first directory lookup request specifying a first target address, an entry associated with the target address is accessed in the memory directory array. In response to the access, the coherence directory returns, as a result of the first directory lookup request, contents of a first sector that is identified by the target address as a requested sector. The coherence directory also caches contents of a second sector of the multiple sectors that is a non-requested sector for the first directory lookup request in a prefetch sector cache. In response to receiving a subsequent second directory lookup request specifying a second target address that identifies the second sector as a requested sector, the coherence directory accesses the contents of the second sector in the sector prefetch cache and returns the contents of the second sector as a result of the second directory lookup request.

## Claims

### Claim 1

A method of servicing directory lookup requests in a data processing system including a coherence directory having a prefetch sector cache and having a memory directory array containing a plurality of entries, wherein each entry includes multiple sectors, said method comprising:
in response to receiving a first directory lookup request specifying a first target address, the coherence directory:
accessing an entry associated with the first target address in the memory directory array;
returning, as a result of the first directory lookup request, contents of a first sector that is identified by the first target address as a requested sector; and
caching contents of a second sector of the multiple sectors that is a non-requested sector for the first directory lookup request in a prefetch sector cache; and
in response to receiving a subsequent second directory lookup request specifying a second target address that identifies the second sector as a requested sector, the coherence directory accessing the contents of the second sector in the sector prefetch cache and returning the contents of the second sector as a result of the second directory lookup request.

### Claim 2 (depends on 1)

The method of claim 1, and further comprising:
said coherence directory servicing said second directory lookup request without accessing the memory directory array.

### Claim 3 (depends on 2)

The method of claim 2, wherein:
said coherence directory includes a multi-cycle directory pipeline supporting access to the memory directory array; and
returning the contents of the second sector as a result of the second directory lookup request includes bypassing the directory pipeline with the contents of the second sector.

### Claim 4 (depends on 1)

The method of claim 1, wherein:
the memory directory array includes a plurality of banks; and
said method further comprises the coherence directory selecting a particular one of said plurality of banks that contains said entry as a bank to be accessed based upon said first target address.

### Claim 5 (depends on 1)

The method of claim 1, and further comprising:
invalidating the contents of the second sector in the prefetch sector cache in response to a directory update request.

### Claim 6 (depends on 1)

The method of claim 1, and further comprising buffering contents of recently requested sectors in a buffer within the coherence directory.

### Claim 7 (depends on 1)

The method of claim 1, wherein:
the coherence directory includes a directory queue; and
the method further comprises determining if said second directory lookup request hit in said sector prefetch cache concurrently with enqueuing the second directory lookup request in said directory queue.

### Claim 8 (depends on 1)

The method of claim 1, and further comprising replacing contents of the prefetch sector cache utilizing a First-In, First-Out replacement policy.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
said entry associated with the first target address includes at least a third sector that is a non-requested sector for the first directory lookup request; and
said method further comprises caching contents of the third sector in the prefetch sector cache in response to the first directory lookup request.

### Claim 10

A memory controller for a memory in a data processing system, said memory controller comprising:
a processor interface;
a memory interface coupled to the memory;
a coherence directory including:
a memory directory array including a plurality of sectored entries that store cache states of memory blocks in the memory, where each of said plurality of entries includes a first sector and a second sector; and
a prefetch sector cache that, responsive to receipt by the coherence directory of a first directory lookup request that identifies the first sector of a particular entry as a requested sector, receives and caches the second sector of the particular entry that is non-requested by the first directory lookup request, and thereafter, in response to receipt by the coherence directory of a second directory lookup request that identifies the second sector as a requested sector, outputs the contents of the second sector to service the second directory lookup request.

### Claim 11 (depends on 10)

The memory controller of claim 10, wherein the coherence directory services the second directory lookup request without accessing the memory directory array.

### Claim 12 (depends on 11)

The memory controller of claim 11, wherein:
said coherence directory includes a multi-cycle directory pipeline supporting access to the memory directory array; and
the prefetch sector cache outputs the contents of the second sector as a result of the second directory lookup request while bypassing the directory pipeline.

### Claim 13 (depends on 10)

The memory controller of claim 10, wherein:
the memory directory array includes a plurality of banks; and
the coherence directory includes address control logic that selects a particular one of said plurality of banks that contains said entry as a bank to be accessed based upon said first target address.

### Claim 14 (depends on 10)

The memory controller of claim 10, wherein the coherence directory invalidates the contents of the second sector in the prefetch sector cache in response to a directory update request.

### Claim 15 (depends on 10)

The memory controller of claim 10, said coherence directory further comprising a buffer that buffers contents of recently requested sectors.

### Claim 16 (depends on 10)

The memory controller of claim 10, wherein:
the coherence directory includes a directory queue; and
the coherence directory determines if said second directory lookup request hit in said sector prefetch cache concurrently with enqueuing the second directory lookup request in said directory queue.

### Claim 17 (depends on 10)

The memory controller of claim 10, wherein said sector prefetch cache is formed of latches.

### Claim 18 (depends on 10)

The memory controller of claim 10, wherein said prefetch sector cache implements a First-In, First-Out replacement policy.

### Claim 19 (depends on 10)

The memory controller of claim 10, wherein:
said entry associated with the first target address includes at least a third sector that is a non-requested sector for the first directory lookup request; and
the prefetch sector cache caches the third sector in response to the first directory lookup request.

### Claim 20

A multiprocessor data processing system, comprising:
multiple processors;
a memory subsystem; and
a memory controller coupled to the multiple processors and the memory subsystem, said memory controller including a central coherence directory that records cache states of the multiple processors with respect to memory blocks of the memory subsystem, wherein said coherence directory includes:
a memory directory array including a plurality of sectored entries that store cache states of memory blocks in the memory, where each of said plurality of entries includes a first sector and a second sector; and
a prefetch sector cache that, responsive to receipt by the coherence directory of a first directory lookup request that identifies the first sector of a particular entry as a requested sector, receives and caches the second sector of the particular entry that is non-requested by the first directory lookup request, and thereafter, in response to receipt by the coherence directory of a second directory lookup request that identifies the second sector as a requested sector, outputs the contents of the second sector to service the second directory lookup request.

### Claim 21 (depends on 20)

The data processing system of claim 20, wherein the coherence directory services the second directory lookup request without accessing the memory directory array.

### Claim 22 (depends on 21)

The memory controller of claim 21, wherein:
said coherence directory includes a multi-cycle directory pipeline supporting access to the memory directory array; and
the prefetch sector cache outputs the contents of the second sector as a result of the second directory lookup request while bypassing the directory pipeline.

### Claim 23 (depends on 20)

The data processing system of claim 20, wherein:
the memory directory array includes a plurality of banks; and
the coherence directory includes address control logic that selects a particular one of said plurality of banks that contains said entry as a bank to be accessed based upon said first target address.

### Claim 24 (depends on 20)

The data processing system of claim 20, wherein the coherence directory invalidates the contents of the second sector in the prefetch sector cache in response to a directory update request.

### Claim 25 (depends on 20)

The data processing system of claim 20, said coherence directory further comprising a buffer that buffers contents of recently requested sectors.

### Claim 26 (depends on 20)

The data processing system of claim 20, wherein:
the coherence directory includes a directory queue; and
the coherence directory determines if said second directory lookup request hit in said sector prefetch cache concurrently with enqueuing the second directory lookup request in said directory queue.

### Claim 27 (depends on 20)

The data processing system of claim 20, wherein said sector prefetch cache is formed of latches.

### Claim 28 (depends on 20)

The data processing system of claim 20, wherein:
said entry associated with the first target address includes at least a third sector that is a non-requested sector for the first directory lookup request; and
the prefetch sector cache caches the third sector in response to the first directory lookup request.
