# US 2003/0070044 A1 · Embedded DRAM cache memory and method having reduced latency

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2003/0070044 A1
- Document ID: US20030070044A1
- Status: Published application
- Kind: A1
- Application number: 09/971,841
- Filed: 2001-10-04
- Published: 2003-04-10
- Earliest claimed: 2001-10-04
- Assignees: Micron Technology, Inc.
- Inventors: Joseph Jeddeloh
- Web page: https://patentgrep.com/patent/US20030070044A1

## CPC

- G06F 12/0893: Caches characterised by their organisation or structure
- G06F 12/0897: with two or more cache hierarchy levels (with multilevel cache hierarchies G06F12/0811)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A computer system includes a processor, a system memory, and an integrated circuit system controller coupled to the processor and the system memory. The system controller includes a system memory controller coupled to the system memory, a processor interface coupled to the processor and an embedded cache memory integrated with the memory controller and the processor interface. The cache memory includes at least one DRAM array, at least one tag memory, and at least one cache memory controller. The cache memory controller initiates an access to either or both the DRAM array and the tag memory, as well as the system memory, before the cache memory controller has determined if the access will result in a cache hit or a cache miss. If the cache memory controller determines that the access will result in a cache hit, data are coupled from the DRAM array to the processor. If the cache memory controller determines that the access will result in a cache miss, data are coupled from the system memory to the processor.

## Claims

### Claim 1

An integrated circuit for use with a processor based system having a processor and a system memory, the integrated circuit comprising:
a system memory controller structured to control the system memory of the processor based system;
a processor interface coupled to the system memory controller, the processor interface structured to transmit information between the processor and the system memory; and
a cache memory integrated with the memory controller and the processor interface and coupled to the system memory controller and the processor interface, the cache memory comprising:
a dynamic random access memory (“DRAM”) array;
a tag memory; and
a cache memory controller coupled to the DRAM array, the tag memory, the processor interface and the system memory controller, the cache memory controller being operable to receive a request for access to the cache memory, and, in response thereto, to initiate an access to the tag memory and to initiate an access to the DRAM array, the cache memory controller initiating the access to the DRAM array before receiving a tag from the tag array, the cache memory controller further being operable to determine based on the tag whether the access to the cache memory will result in a cache hit and, in response to determining that the access will result in a cache hit, to couple data from the DRAM array to the processor.

### Claim 2 (depends on 1)

The integrated circuit of claim 1 wherein the cache memory controller is further operable to apply to the system memory controller a request for access to the system memory responsive to receiving the request for access to the cache memory and before the cache memory controller receives a tag from the tag array, the cache memory controller being further operable to couple data accessed from the system memory to the processor responsive to the cache memory controller determining that the access to the cache memory will not result in a cache hit.

### Claim 3 (depends on 1)

The integrated circuit of claim 1 wherein the cache memory controller is further operable in response to determining that the access will not result in a cache hit, to apply a request to the system memory controller for access to the system memory.

### Claim 4 (depends on 3)

The integrated circuit of claim 3 wherein the cache memory controller is further operable to receive data from the system memory responsive to the request for access to the system memory and to write the data received from the system memory to the DRAM array and to update a tag in the tag memory.

### Claim 5

An integrated circuit for use with a processor based system having a processor and a system memory, the integrated circuit comprising:
a system memory controller structured to control the system memory of the processor based system;
a processor interface coupled to the system memory controller, the processor interface structured to transmit information between the processor and the system memory; and
a cache memory integrated with the memory controller and the processor interface and coupled to the system memory controller and the processor interface, the cache memory comprising:
a dynamic random access memory (“DRAM”) array;
a tag memory; and
a cache memory controller coupled to the DRAM array, the tag memory, the processor interface and the system memory controller, the cache memory controller being operable to receive a request for access to the cache memory, and, in response thereto to initiate an access the tag memory, to initiate an access to the DRAM array, and to initiate an access to the system memory, the cache memory controller being operable to initiate the access to the system memory before the cache memory controller receives a tag from the tag array, the cache memory controller being further operable to couple data accessed from the system array to the processor responsive to the cache memory controller determining that the access to the cache memory will not result in a cache hit.

### Claim 6 (depends on 5)

The integrated circuit of claim 5 wherein the cache memory controller is operable to initiate an access to the DRAM array before the cache memory controller receives the tag from the tag array.

### Claim 7 (depends on 6)

The integrated circuit of claim 6 wherein the cache memory controller is further operable to couple data from the DRAM array to the processor in response to determining that the access will result in a cache hit.

### Claim 8 (depends on 5)

The integrated circuit of claim 5 wherein, in response to determining that the access will not result in a cache hit, the cache memory controller is operable to receive data from the system memory responsive to the request for access to the system memory and to write the data received from the system memory to the DRAM array, and to update a tag in the tag memory.

### Claim 9

An integrated circuit for use with a processor based system having a memory requestor and a system memory, the integrated circuit comprising:
a system memory controller structured to control the system memory of the processor based system; and
a master scheduler integrated with the memory controller and coupled to receive a data access request from the memory requester, the master scheduler being operable to generate a request for a cache memory access in response to receiving the data access request;
a plurality of cache memories integrated with the memory controller and the master scheduler, the cache memories being coupled to the master scheduler, each of the cache memories comprising:
a dynamic random access memory (“DRAM”) array;
a tag memory; and
a cache memory controller coupled to the master scheduler, the DRAM array, and the tag memory, the cache memory controller being operable to receive the request for cache memory access, and, in response thereto, to initiate an access to the tag memory and to initiate an access to the DRAM array, the cache memory controller initiating the access to the DRAM array before receiving a tag from the tag array, the cache memory controller further being operable to determine based on the tag whether the access to the cache memory will result in a cache hit or a cache miss and, in response to determining that the access will result in a cache hit, to couple data from the DRAM array for coupling to the memory requester.

### Claim 10 (depends on 9)

The integrated circuit of claim 9 wherein the cache memory controller is further operable to apply to the master scheduler a cache miss indication in response to determining that the access to the cache memory will result in a cache miss, and wherein the master scheduler is operable to apply to the system memory controller a request for access to the system memory responsive to receiving the cache miss indication from the cache memory controller.

### Claim 11 (depends on 10)

The integrated circuit of claim 10 wherein the master scheduler is operable to apply the request for access to the system memory to the system memory controller before receiving a cache miss indication from the cache memory controller for one of the cache memories.

### Claim 12 (depends on 11)

The integrated circuit of claim 11 wherein the master scheduler is further operable responsive to receiving the cache miss indication from the cache memory controller to couple data from system memory to the memory requester.

### Claim 13 (depends on 12)

The integrated circuit of claim 12 wherein the master scheduler is further operable to receive data from the system memory responsive to the request for access to the system memory and to couple the data received from the system memory to one of the cache memories, and wherein the cache memory controller for the one of the cache memories is operable to write the data coupled from the master scheduler to the DRAM array for the cache memory and to update a tag in the tag memory for the cache memory.

### Claim 14 (depends on 11)

The integrated circuit of claim 11 wherein the cache memory controller is further operable to apply to the master scheduler a cache hit indication in response to determining that the access to the cache memory will result in a cache hit, and wherein the master scheduler is operable responsive to receiving the cache hit indication from the cache memory controller to couple data from the DRAM array for one of the cache memories to the memory requester.

### Claim 15 (depends on 11)

The integrated circuit of claim 11 wherein the memory requestor comprises a processor.

### Claim 16 (depends on 15)

The integrated circuit of claim 15 wherein the processor comprises a level 1 cache memory.

### Claim 17

An integrated circuit for use with a processor based system having a memory requester and a system memory, the integrated circuit comprising:
a system memory controller structured to control the system memory of the processor based system; and
a master scheduler integrated with the memory controller and coupled to receive a data access request from the memory requester, the master scheduler being operable in response to receiving the data access request to generate a request for a cache memory access and to initiate an access to the system memory, the master scheduler initiating the access to the system memory before receiving a cache miss indication;
a plurality of cache memories integrated with the memory controller and the master scheduler, the cache memories being coupled to the master scheduler, each of the cache memories comprising:
a dynamic random access memory (“DRAM”) array;
a tag memory; and
a cache memory controller coupled to the master scheduler, the DRAM array, and the tag memory, the cache memory controller being operable to receive the request for cache memory access, and, in response thereto, to initiate an access to the tag memory and to initiate an access to the DRAM array, the cache memory controller further being operable to determine based on the tag whether the access to the cache memory will result in a cache hit or a cache miss and, in response to determining that the access will result in a cache miss, to apply to the master scheduler the cache miss indication.

### Claim 18 (depends on 17)

The integrated circuit of claim 17 wherein the cache memory controller is operable to initiate the access to the DRAM array before receiving a tag from the tag array.

### Claim 19 (depends on 17)

The integrated circuit of claim 17 wherein the cache memory controller is further operable to couple data from the DRAM array to the master scheduler in response to determining that the access will result in a cache hit, and wherein the master scheduler is operable to couple data received from the cache memory controller to the memory requester.

### Claim 20 (depends on 17)

The integrated circuit of claim 17 wherein the cache memory controller is further operable to couple data from the system memory to the memory requester responsive to receiving a cache miss indication from the cache memory controller for one of the cache memories.

### Claim 21 (depends on 20)

The integrated circuit of claim 20 wherein the master scheduler is operable responsive to receiving the cache miss indication from the cache memory controller to couple data from system memory to one of the cache memories, and wherein the memory controller for the one of the cache memories is operable to write the data coupled from the master scheduler to the DRAM array for the cache memory and to update a tag in the tag memory for the cache memory.

### Claim 22 (depends on 17)

The integrated circuit of claim 17 wherein the memory requester comprises a processor.

### Claim 23 (depends on 22)

The integrated circuit of claim 22 wherein the processor comprises a level 1 cache memory.

### Claim 24

A computer system comprising:
a processor;
a system memory;
an integrated circuit system controller coupled to the processor and to the system memory, the system controller comprising:
a system memory controller coupled to the system memory, the system memory controller being structured to control the system memory;
a processor interface coupled to the processor, the processor interface structured to transmit information between the processor and the system controller; and
a cache memory coupled to the system memory controller and the processor interface, the cache memory comprising:
a dynamic random access memory (“DRAM”) array;
a tag memory; and
a cache memory controller coupled to the DRAM array, the tag memory, the processor interface and the system memory controller, the cache memory controller being operable to receive a request for access to the cache memory, and, in response thereto, to initiate an access to the tag memory and to initiate an access to the DRAM array, the cache memory controller initiating the access to the DRAM array before receiving a tag from the tag array, the cache memory controller further being operable to determine based on the tag whether the access to the cache memory will result in a cache hit and, in response to determining that the access will result in a cache hit, to couple data from the DRAM array to the processor.

### Claim 25 (depends on 24)

The computer system of claim 24 wherein the cache memory controller is further operable apply to the system memory controller a request for access to the system memory responsive to receiving the request for access to the cache memory and before the cache memory controller receives a tag from the tag array, the cache memory controller being further operable to couple data accessed from the system memory to the processor responsive to the cache memory controller determining that the access to the cache memory will not result in a cache hit.

### Claim 26 (depends on 24)

The computer system of claim 24 wherein the cache memory controller is further operable in response to determining that the access will not result in a cache hit, to apply a request to the system memory controller for access to the system memory.

### Claim 27 (depends on 26)

The computer system of claim 26 wherein the cache memory controller is further operable to receive data from the system memory responsive to the request for access to the system memory and to write the data received from the system memory to the DRAM array and to update a tag in the tag memory.

### Claim 28 (depends on 24)

The computer system of claim 24 wherein the processor further comprises a level 1 cache memory.

### Claim 29 (depends on 28)

The computer system of claim 28 further comprising a level 2 cache memory coupled to the processor.

### Claim 30 (depends on 24)

The computer system of claim 24, wherein the system controller further comprises a bus interface, and wherein the computer system further comprises an expansion bus coupled to the bus interface.

### Claim 31 (depends on 30)

The computer system of claim 30, further comprising a bus bridge coupled between the bus interface of the system controller and a second expansion bus.

### Claim 32 (depends on 30)

The computer system of claim 30 wherein the expansion bus comprises a PCI bus.

### Claim 33 (depends on 30)

The computer system of claim 30 wherein system controller further comprise a graphics interface, and wherein the computer system further comprises a graphics processor coupled to the graphics interface.

### Claim 34

A computer system comprising:
a processor;
a system memory;
an integrated circuit system controller coupled to the processor and to the system memory, the system controller comprising:
a system memory controller coupled to the system memory, the system memory controller being structured to control the system memory;
a processor interface coupled to the processor, the processor interface structured to transmit information between the processor and the system memory; and
a cache memory integrated with the memory controller and the processor interface and coupled to the system memory controller and the processor interface, the cache memory comprising:
a dynamic random access memory (“DRAM”) array;
a tag memory; and
a cache memory controller coupled to the DRAM array, the tag memory, the processor interface and the system memory controller, the cache memory controller being operable to receive a request for access to the cache memory, and, in response thereto to initiate an access the tag memory, to initiate an access to the DRAM array, and to initiate an access to the system memory, the cache memory controller being operable to initiate the access to the system memory before the cache memory controller receives a tag from the tag array, the cache memory controller being further operable to couple data accessed from the system array to the processor responsive to the cache memory controller determining that the access to the cache memory will not result in a cache hit.

### Claim 35 (depends on 34)

The computer system of claim 34 wherein the cache memory controller is operable to initiate an access to the DRAM array before the cache memory controller receives the tag from the tag array.

### Claim 36 (depends on 35)

The computer system of claim 35 wherein the cache memory controller is further operable to couple data from the DRAM array to the processor in response to determining that the access will result in a cache hit.

### Claim 37 (depends on 34)

The computer system of claim 34 wherein, in response to determining that the access will not result in a cache hit, the cache memory controller is operable to receive data from the system memory responsive to the request for access to the system memory and to write the data received from the system memory to the DRAM array, and to update a tag in the tag memory.

### Claim 38 (depends on 34)

The computer system of claim 34 wherein the processor further comprises a level 1 cache memory.

### Claim 39 (depends on 38)

The computer system of claim 38 further comprising a level 2 cache memory coupled to the processor.

### Claim 40 (depends on 34)

The computer system of claim 34, wherein the system controller further comprises a bus interface, and wherein the computer system further comprises an expansion bus coupled to the bus interface.

### Claim 41 (depends on 40)

The computer system of claim 40, further comprising a bus bridge coupled between the bus interface of the system controller and a second expansion bus.

### Claim 42 (depends on 40)

The computer system of claim 40 wherein the expansion bus comprises a PCI bus.

### Claim 43 (depends on 40)

The computer system of claim 40 wherein system controller further comprise a graphics interface, and wherein the computer system further comprises a graphics processor coupled to the graphics interface.

### Claim 44

In a computer system having a memory requester, a system controller coupled to the memory requester, and a system memory, the system controller comprising a system memory controller coupled to the system memory, and a cache memory coupled to the system memory controller and to the memory requester, the cache memory having a DRAM array, the system memory controller and the cache memory being fabricated as a common integrated circuit, a method of accessing data or instructions stored in the system memory and possibly also in the DRAM array of the cache memory, the method comprising:
generating at the memory requester a request for access to the data or instructions;
receiving at the cache memory the request for access to the data or instructions; and
initiating an access to the DRAM array before determining whether the access to the DRAM array will result in a cache hit or a cache miss.

### Claim 45 (depends on 44)

The method of claim 44, further comprising coupling data or instructions from the DRAM array to the memory requester in response to determining that the access to the DRAM array will result in a cache hit.

### Claim 46 (depends on 44)

The method of claim 44, further comprising coupling data or instructions from the system memory to the memory requestor in response to determining that the access to the DRAM array will result in a cache miss.

### Claim 47 (depends on 46)

The method of claim 46, further comprising writing the data or instructions received from the system memory to the DRAM array.

### Claim 48 (depends on 44)

The method of claim 44, further comprising applying to the system memory controller a request for access to the system memory responsive to receiving the request for access to the data or instructions

### Claim 49 (depends on 48)

The method of claim 48 wherein the act of applying a request for access to the system memory to the system memory controller comprises applying the request for access to the system memory to the system memory controller before determining whether the access to the DRAM array will result in a cache hit or a cache miss.

### Claim 50

In a computer system having a memory requester, a system controller coupled to the memory requester, and a system memory, the system controller comprising a system memory controller coupled to the system memory, and a cache memory coupled to the system memory controller and to the memory requester, the cache memory having a DRAM array, the system memory controller and the cache memory being fabricated as a common integrated circuit, a method of accessing data or instructions stored in the system memory and possibly also in the DRAM array of the cache memory, the method comprising:
generating at the memory requester a request for access to the data or instructions;
receiving at the cache memory the request for access to the data or instructions;
initiating an access to the DRAM array responsive to receiving the request for access to the data or instructions; and
applying to the system memory controller a request for access to the system memory responsive to receiving the request for access to the data or instructions, the request for access to the system memory being applied to the system memory controller before determining whether the access to the DRAM array will result in a cache hit or a cache miss.

### Claim 51 (depends on 50)

The method of claim 50, further comprising coupling data or instructions from the DRAM array to the memory requestor in response to determining that the access to the DRAM array will result in a cache hit.

### Claim 52 (depends on 50)

The method of claim 50, further comprising coupling data or instructions from the system memory to the memory requester in response to determining that the access to the DRAM array will result in a cache miss.

### Claim 53 (depends on 52)

The method of claim 52, further comprising writing the data or instructions received from the system memory to the DRAM array.

### Claim 54 (depends on 50)

The method of claim 50 wherein the act of initiating an access to the DRAM array responsive to receiving the request for access to the data or instructions comprises initiating the access to the DRAM array before determining whether the access to the DRAM array will result in a cache hit or a cache miss.
