# US 2026/0300219 A1 · 3d processor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0300219 A1
- Document ID: US20260300219A1
- Status: Published application
- Kind: A1
- Application number: 19/479,866
- Filed: 2024-03-12
- Published: 2026-10-01
- Earliest claimed: 2023-05-12
- Assignees: Massachusetts Institute of Technology
- Applicants: Massachusetts Institute of Technology
- Inventors: William S. Song
- Web page: https://patentgrep.com/patent/US20260300219A1

## CPC

- G06F 15/8046: {Systolic arrays}
- G06F 15/7821: {Tightly coupled to memory, e.g. computational memory, smart memory, processor in memory}
- H10B 80/00: Assemblies of multiple devices comprising at least one memory device covered by this subclass
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H10B: ELECTRONIC MEMORY DEVICES

## Abstract

Described is a device having three-dimensional (3D) integration of a DRAM die and processor ASIC. Such an integrated device achieves much higher memory bandwidth and low memory access power consumption than prior art devices while still retaining the high capacity and low cost of DRAMs. The devices and techniques described herein can result in much higher computational throughput, higher power efficiency, and lower cost per throughput than conventional processors while still providing the high memory capacity necessary to be able to work on large problems.

## Claims

### Claim 1

A processor comprising:
a memory die having a plurality of memory banks;
a processor die disposed over the memory die and having a plurality of processor cores connected as a systolic array; and
a plurality of signal paths configured to couple the memory die to the processor die,
wherein each of the processor cores is disposed over at least one of the plurality of memory banks and connected thereto by at least one of the plurality of signal paths.

### Claim 2 (depends on 1)

The processor of claim 1 wherein the memory banks are disposed on a horizontal surface of the memory die, the processor cores are disposed on a horizontal surface of the processor die, and the signal paths extend vertically between the memory die and the processor die.

### Claim 3 (depends on 2)

The processor of claim 2 wherein each of the processor cores have a first area on the horizontal surface of the memory die, each of the memory banks have a second area on the horizontal surface of the memory die, and the first and second areas are substantially equal.

### Claim 4 (depends on 1)

The processor of claim 1 wherein the plurality of processor cores comprises a plurality of application-specific integrated circuits (ASICs).

### Claim 5 (depends on 4)

The processor of claim 4 wherein each of the plurality of ASICs is configured to perform the same arithmetic operations.

### Claim 6 (depends on 4)

The processor of claim 4 wherein at least two different ones of the plurality of ASICs are configured to perform at least two different arithmetic operations.

### Claim 7 (depends on 1)

The processor of claim 1 wherein the plurality of processor cores are configured to read and write data to the plurality of memory banks using individual memory interfaces.

### Claim 8 (depends on 1)

The processor of claim 1 wherein the plurality of processor cores are connected as a one-dimensional (1D) systolic array.

### Claim 9 (depends on 1)

The processor of claim 1 wherein the plurality of processor cores are connected as a two-dimensional (2D) systolic array.

### Claim 10 (depends on 1)

The processor of claim 1 wherein the plurality of processor cores are connected as a toroidal systolic array.

### Claim 11

A processing network comprising:
a plurality of processing nodes each having:
a memory die having a plurality of memory banks;
a processor die disposed over the memory die and having a plurality of processor cores connected as a systolic array; and
a plurality of signal paths configured to couple the memory die to the processor die.
wherein each of the processor cores is disposed over at least one of the plurality of memory banks and connected thereto by at least one of the plurality of signal paths,
wherein the plurality of processing nodes are connected as a systolic array.

### Claim 12 (depends on 11)

The processing network of claim 11 wherein the plurality of processing nodes are connected as a 1D systolic array.

### Claim 13 (depends on 11)

The processing network of claim 11 wherein the plurality of processing nodes are connected as a 2D systolic array.

### Claim 14

A system comprising:
a control & I/O processor; and
a processor die having a plurality of processor nodes connected as a systolic array and each connected to the control & I/O processor via one or more buses,
wherein each of the plurality of processor nodes has a routing module a processor core connected to a memory bank via an individual memory interface.

### Claim 15 (depends on 14)

The system of claim 14 wherein the routing modules are configured to receive data from the control & I/O processor via at least one of the one or more buses.

### Claim 16 (depends on 14)

The system of claim 14 wherein the one or more buses include a broadcast bus connecting the control & I/O processor to each of the processor nodes.

### Claim 17 (depends on 16)

The system of claim 16 wherein the memory banks are configured to store neural network weights, the control & I/O processor is configured to broadcast input vector elements to the plurality of processor nodes via the broadcast bus, and the plurality of processor nodes are configured to read the neural network weights from the memory banks and to multiply the input vector elements by the neural network weights to produce output vector elements.

### Claim 18 (depends on 17)

The system of claim 17 wherein the processor nodes are configured to shift out the output vector elements to the control & I/O processor via the systolic array.

### Claim 19 (depends on 17)

The system of claim 17 wherein the one or more buses include a control bus configured to program the neural network weights stored on the memory banks.

### Claim 20 (depends on 18)

The system of claim 18 wherein the processor die is a first processor die, wherein the system further comprises:
a second processor die having a plurality of processor nodes connected as a systolic array and each connected,
wherein the control bus is arranged to connect the first and second processor dies.
