# US 6,732,247 B2 · Multi-ported memory having pipelined data banks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 6,732,247 B2
- Document ID: US6732247B2
- Status: Granted
- Kind: B2
- Application number: 09/764,250
- Filed: 2001-01-17
- Published: 2002-07-18
- Granted: 2004-05-04
- Earliest claimed: 2001-01-17
- Assignees: University of Washington
- Inventors: Stefan G. Berg; Donglok Kim; Yongmin Kim
- Web page: https://patentgrep.com/patent/US6732247B2

## CPC

- G06F 9/3012: {Organisation of register space, e.g. banked or distributed register file}
- G06F 9/30098: {Register arrangements}
- G06F 9/3824: {Operand accessing}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Multi-ported pipelined memory is located on a processor die serving as an addressable on-chip memory for efficiently processing streaming data. The memory sustains multiple wide memory accesses per cycle, clocks synchronously with the rest of the processor, and stores a significant portion of an image. Such memory bypasses the register file directly providing data to the processor's functional units. The memory includes multiple memory banks which permit multiple memory accesses per cycle. The memory banks are connected in pipelined fashion to pipeline registers placed at regular intervals on a global bus. The memory sustains multiple transactions per cycle, at a larger memory density than that of a multi-ported static memory, such as a register file.

## Claims

### Claim 1

A processor comprising:
a plurality of functional processing units;
a multi-ported memory having a plurality of ports and a plurality of memory banks, the plurality of memory banks connected in pipelined fashion to achieve pipelined address lines and pipelined data lines; and
a bus which couples the multi-ported memory to the plurality of functional processing units, the bus being coupled to the plurality of ports of the multi-port memory to allow parallel access to multiple memory banks of the multi-ported memory during a first clock cycle, wherein the plurality of functional processing units, the multi-ported memory and the bus are packaged within a processor chip set, the processor chip set including at least one die; wherein during a second clock cycle a given port of the plurality of ports carries a plurality of data, each one of said plurality of data having an address corresponding to a unique one of said plurality of memory banks.

### Claim 2 (depends on 1)

The processor of claim 1, further comprising
a register file physically distinct from the multi-ported memory, wherein the bus couples the register file to the plurality of functional processing units.

### Claim 3 (depends on 1)

The processor of claim 1, wherein a first port of the plurality of ports is a read write port and the plurality of memory banks are arranged in a pipeline for moving data relative to the read write port, wherein data from both a read access and a write access are capable of residing in the pipeline at the same time.

### Claim 4 (depends on 1)

The processor of claim 1, in which each one of the plurality of ports is capable of handling a memory transaction either one of concurrently or overlapping with a memory transaction on each of the other ports of the plurality of ports.

### Claim 5 (depends on 4)

The processor of claim 4, wherein the plurality of ports comprises four ports, wherein two ports are dedicated to handling a read access, a third port is dedicated to handling a write access, and a fourth port is able to handle in any given cycle either one of a write access or a read access.

### Claim 6 (depends on 1)

The processor of claim 1, wherein the multi-ported memory comprises the plurality of memory banks, a memory controller, and a plurality of pipeline registers, wherein the memory bank pipeline has multiple stages, one stage comprising a first memory bank of the plurality of memory banks, another stage formed by a second memory bank of the plurality of memory banks, yet another stage formed by a pipeline register of the plurality of pipeline registers.

### Claim 7 (depends on 6)

The processor of claim 6, wherein each one of the plurality of memory banks is coupled to a corresponding one of the plurality of pipelined registers.

### Claim 8 (depends on 6)

The processor of claim 6, wherein for each one of the pipelined registers there is one of the plurality of memory banks coupled to said one of the plurality of pipelined registers.

### Claim 9 (depends on 8)

The processor of claim 8, wherein there are less memory banks among the plurality of memory banks than pipelined registers among the plurality of pipelined registers.

### Claim 10 (depends on 6)

The processor of claim 6, wherein the memory bank pipeline is a first memory bank pipeline, and wherein the plurality of memory banks are connected into a plurality of memory bank pipelines.

### Claim 11 (depends on 6)

The processor of claim 6, in which the memory controller is for detecting potential memory bank conflicts and for ensuring that the pipeline does not carry a transaction that results in a memory bank conflict involving any of the plurality of memory banks.

### Claim 12 (depends on 1)

The processor of claim 1, wherein the plurality of functional processing units, the multi-ported memory and the bus reside on a common die.

### Claim 13

A processor comprising:
a plurality of functional processing units;
a register file accessible by the plurality of functional processing units;
a multi-ported memory distinct from the register file, the multi-ported memory including a plurality of ports, a plurality of memory banks connected into a plurality of pipelines of memory banks to achieve pipelined address lines and pipelined data lines, the multi-ported memory further including a plurality of access ports and a plurality of pipeline registers coupled to the plurality of pipelines, each pipeline being accessible through at least one of the plurality of access ports, each pipeline including a plurality of memory banks and at least one pipeline register;
a memory controller for controlling access to the multi-ported memory; and
a bus which couples the multi-ported memory to the plurality of functional processing units, the bus being coupled to the plurality of ports of the multi-port memory to allow parallel access to multiple memory banks of the multi-ported memory during a first clock cycle, wherein the plurality of functional processing units, the multi-ported memory and the bus are packaged within a processor chip set, the processor chip set including at least one die; wherein during a second clock cycle a given port of the plurality of ports carries a plurality of data, each one of said plurality of data having an address corresponding to a unique one of said plurality of memory banks.

### Claim 14 (depends on 13)

The processor of claim 13, wherein a first port of the plurality of access ports is a read write port, wherein data from both a read access and a write access are capable of residing at the same time in a first pipeline coupled to the read write port, the first pipeline being one pipeline among the plurality of pipelines.

### Claim 15 (depends on 13)

The processor of claim 13, in which each one of the plurality of access ports is capable of handling a memory transaction either one of concurrently or overlapping with a memory transaction on each of the other ports of the plurality of ports.

### Claim 16 (depends on 15)

The processor of claim 15, wherein the plurality of access ports comprises a first port dedicated to handling a read access, a second port is dedicated to handling a write access, and a third port able to accept in any given cycle either one of a write access or a read access.

### Claim 17 (depends on 13)

The processor of claim 13, wherein for each one of the pipeline registers there is one of the plurality of memory banks coupled to said one of the plurality of pipelined registers.

### Claim 18 (depends on 17)

The processor of claim 17, wherein there are less memory banks among the plurality of memory banks than pipelined registers among the plurality of pipelined registers.

### Claim 19 (depends on 13)

The processor of claim 13, in which the memory controller is for detecting potential memory bank conflicts and for ensuring that the pipelines do not carry a transaction that results in a memory bank conflict involving any of the plurality of memory banks.

### Claim 20 (depends on 13)

The processor of claim 13, wherein the plurality of functional processing units, the multi-ported memory and the bus reside on a common die.

### Claim 21

A method for accessing an addressable on-chip memory located in a processor chip set with a plurality of functional processing units, a register file, and a bus, the processor chip set including at least one die, the addressable on-chip memory being distinct from the register file, the method comprising the steps of:
streaming data from an off-chip memory into the addressable on-chip memory;
responding to a first addressed memory access request from a first unit of the plurality of functional processing units by moving data among said first unit and said addressable on-chip memory via a first port of the addressable on-chip memory, said data moving in pipelined fashion among a plurality of addressable memory banks of said addressable on-chip memory, said on-chip memory having pipelined address lines and pipelined data lines for said plurality of addressable memory banks;
responding to a second addressed memory access request from a second unit of the plurality of functional processing units by moving data among said second unit and said addressable on-chip memory via a second port of the addressable on-chip memory, wherein parallel access to said first port and said second port occur during a first clock cycle wherein the first addressed memory access request and the second addressed memory request are either one of overlapping or concurrent; and
carrying a plurality of data at a given port of the plurality of ports during a second clock cycle, wherein each one of said plurality of data have an address corresponding to a unique one of said plurality of memory banks.

### Claim 22 (depends on 21)

The method of claim 21, wherein the step of responding to the first addressed memory access request comprises moving data in a pipelined fashion among a plurality of addressable memory banks of said addressable on-chip memory via a plurality of pipeline registers.

### Claim 23 (depends on 22)

The method of claim 22, wherein a memory controller is packaged within the processor chip set, the method further comprising the step of:
scheduling access to the bus by the memory controller to avoid potential memory bank conflicts and ensure that the bus does not carry a transaction that results in a memory bank conflict involving any of the plurality of memory banks.

### Claim 24 (depends on 21)

The method of claim 21, and wherein said data moved among said first unit and said addressable on-chip memory is moved without intermediate storage in the register file.

### Claim 25 (depends on 21)

The method of claim 21, wherein the first port and the second port are the same port and wherein the first addressed memory access request is a read request and the second addressed memory request is a write request.

### Claim 26 (depends on 21)

The method of claim 21, wherein the first addressed memory access request is a read request, and further comprising the step of responding to a third addressed memory access request from a third unit of the plurality of functional processing units by moving data among said third unit and said addressable on-chip memory via said first port of the addressable on-chip memory, wherein the third addressed memory access request is a write request and wherein the first addressed memory access request and the third addressed memory access request either one of overlapping or concurrent.
