US 6,154,826 A · Method and device for maximizing memory system bandwidth by accessing data in a dynamically determined order

Abstract

A data processing system is disclosed which comprises a data processor and memory control device for controlling the access of information from the memory. The memory control device includes temporary storage and decision ability for determining what order to execute the memory accesses. The compiler detects the requirements of the data processor and selects the data to stream to the memory control device which determines a memory access order. The order in which to access said information is selected based on the location of information stored in the memory. The information is repeatedly accessed from memory and stored in the temporary storage until all streamed information is accessed. The information is stored until required by the data processor. The selection of the order in which to access information maximizes bandwidth and decreases the retrieval time.

Claims7

Dependent claims

A memory controller for accessing memory, said memory controller comprising:

at least one stream buffer, said at least one stream buffer being a FIFO and buffering data,
control registers, said control registers receiving stream parameters from a data processor,
a memory scheduling unit for decoupling memory access requests from a processor to enable access of data elements in an order that increases effective bandwidth over a program's natural order and that reduces average memory latency for data patterns,
wherein a data processor sends said stream parameters to said control registers identifying data streams to be accessed and said memory scheduling unit generates memory addresses of the data elements based on said stream parameters and accesses the data elements in a dynamically determined order.

1 more element

A method of accessing data comprising:

a data processor,
memory for storing data for use by said processor,
a memory controller, said memory controller having
stream buffers, said stream buffers buffering data,
control registers, said control registers receiving stream parameters from said processor,
a memory scheduling unit for dynamically decoupling, reordering and issuing
accesses of data elements within patterns of memory accesses from said memory,
a compiler, said compiler identifying said patterns of memory accesses, based on a user program, and generating instructions to transmit said memory access patterns to said memory controller,
comprising the steps of:
1. compiling user program code, consisting in part of:
a. recognizing stream memory access patterns,
b. generating machine instructions to cause said data processor to dynamically determine stream parameters based on said stream access patterns,
c. generating machine instructions to transmit said stream parameters to said memory controller,
2. initiating execution of a compiled user program by:
a. executing machine instructions causing said data processor to calculate said parameters,
b. executing said machine instructions in accordance with step 1(c) causing transmission of said stream parameters to said memory controller,
c. receiving said stream parameters at said control registers,
d. reading stream data elements by:
accessing said data elements within said memory in an order dynamically determined by said memory scheduling unit,
placing said data elements in said buffer,
holding said data elements until said data elements are requested by said processor in said program's natural order,
transmitting said data elements to said processor upon request for said data elements by said processor,
e. writing data elements by:
receiving said data elements in said buffer from said processor in said program's natural order,
holding said data elements in said buffer,
transmitting said data elements to said memory in an order dynamically determined by said memory controller,
wherein data elements are accessed in said memory in an order determined by said memory scheduling unit.

24 more elements

Dependencies are inferred from the claim text.

Method and device for maximizing memory system bandwidth by accessing data in a dynamically determined order

Life of this patent

Method and device for maximizing memory system bandwidth by accessing data in a dynamically determined order

Life of this patent

Abstract

Claims7