# US 2026/0065080 A1 · Integrated memory and compute system for optimized neural network computation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065080 A1
- Document ID: US20260065080A1
- Status: Published application
- Kind: A1
- Application number: 19/381,224
- Filed: 2025-11-06
- Published: 2026-03-05
- Earliest claimed: 2025-02-06
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Yaron Klein; Yuval Vered; Yoni Elron; Ashley Munch; John Crouter; Carleton L. Molnar; Urmi Pandya; Avi Salmon; Stanislav Borisover; Tatyana Druz
- Web page: https://patentgrep.com/patent/US20260065080A1

## CPC

- G06N 3/10: Interfaces, programming languages or software development kits, e.g. for simulating neural networks
- G06N 3/048: Activation functions
- G06N 3/063: using electronic means
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An integrated circuit (IC) device may implement a deep neural network (DNN). The IC device may be a three-dimensional (3D) integrated system that includes a memory die and logic die. The memory die may include memory blocks, such as sequential random-access memory blocks or a sequential read-only memory blocks. The logic die may include an interface unit, a vector operation unit, compute units (e.g., multiply-accumulate units), and an interconnect fabric with adders. The interface unit may receive the input of the DNN and transfer the input to the vector operation unit. The vector operation unit may perform one or more vector operations of the DNN based on the input. The compute units and adders may perform matrix multiplication operations of the DNN based on the vector operation unit's output. Each memory block may be coupled with a compute unit through a via.

## Claims

### Claim 1

An integrated circuit (IC) device, comprising:
a vector operation unit, the vector operation unit to perform one or more vector operations of a neural network model based on an input of the neural network model;
a plurality of compute units, the plurality of compute units to perform one or more matrix multiplication operations of the neural network model based on an output of the vector operation unit;
a plurality of memory blocks, a memory block coupled with a compute unit through a via; and
an interconnect fabric coupled with the vector operation unit and the plurality of compute units.

### Claim 2 (depends on 1)

The IC device of claim 1, further comprising:
an interface unit, the interface unit to receive the input of the neural network model and to transfer the input of the neural network model to the vector operation unit.

### Claim 3 (depends on 1)

The IC device of claim 1, wherein the vector operation unit comprises one or more vector registers and one or more scalar registers, wherein data is transferred between the memory block and the one or more vector registers or the one or more scalar registers through the interconnect fabric.

### Claim 4 (depends on 1)

The IC device of claim 1, wherein the one or more vector operations comprises an embedding operation, a rotary operation, an activation function, a root mean square normalization, or an inverse operation.

### Claim 5 (depends on 1)

The IC device of claim 1, wherein the compute unit is a multiply-add unit, wherein data is transferred between the multiply-add unit and the memory block through the via.

### Claim 6 (depends on 1)

The IC device of claim 1, wherein the memory block is at least part of a sequential random-access memory or a sequential read-only memory.

### Claim 7 (depends on 1)

The IC device of claim 1, further comprising:
a sequence of adders on the interconnect fabric, wherein data computed by a first adder in the sequence of adders is transferred to a second adder in the sequence of adders through the interconnect fabric.

### Claim 8 (depends on 1)

The IC device of claim 1, wherein the one or more vector operations comprise one or more activation functions of the neural network model, wherein the vector operation unit comprises one or more look-up tables, the one or more look-up tables to store precomputed values of the one or more activation functions.

### Claim 9 (depends on 1)

The IC device of claim 1, wherein the vector operation unit, the plurality of compute units, and the interconnect fabric are in a first die, wherein the plurality of memory blocks are in a second die that is over the first die, wherein the via extends between the first die and the second die.

### Claim 10 (depends on 1)

The IC device of claim 1, further comprising:
a flow control unit, the flow control unit to orchestrate the one or more vector operations and the one or more matrix multiplication operations based on a timing sequence of the neural network model.

### Claim 11

One or more non-transitory computer-readable media storing instructions executable to perform operations for executing a neural network model, the operations comprising:
receiving, by an interface unit, an input of the neural network model;
performing, by a vector operation unit, one or more vector operations in the neural network model on the input;
transmitting, through an interconnect fabric, an output of the vector operation unit to a plurality of multiply-add units;
performing, by the plurality of multiply-add units and a plurality of adders on the interconnect fabric, one or more matrix multiplication operations in the neural network model based on the output of the vector operation unit; and
orchestrating, by a flow control unit, the one or more vector operations and the one or more matrix multiplication operations based on a timing sequence of the neural network model.

### Claim 12 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein the operations further comprise:
storing input data or output data of the plurality of multiply-add units in a plurality of memory blocks,
wherein each multiply-add unit of the plurality of multiply-add units is coupled with a different memory block of the plurality of memory blocks.

### Claim 13 (depends on 12)

The one or more non-transitory computer-readable media of claim 12, wherein the plurality of memory blocks includes a sequential random-access memory or a sequential read-only memory.

### Claim 14 (depends on 12)

The one or more non-transitory computer-readable media of claim 12, wherein the operations further comprise:
transferring data between a memory block and a corresponding multiply-add unit through a via,
wherein the plurality of multiply-add units are arranged in a logic die, the plurality of memory blocks are arranged in a memory die, and the via extends between the logic die and the memory die.

### Claim 15 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein performing the one or more matrix multiplication operations comprises:
transferring data points computed by two or more multiply-add units of the plurality of multiply-add units to a first adder of the plurality of adders,
wherein the first adder is to compute a sum of the data points.

### Claim 16 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein performing the one or more vector operations comprises:
performing one or more activation functions of the neural network model based on precomputed values of the one or more activation functions, the precomputed values of the one or more activation functions stored in one or more look-up tables of the vector operation unit.

### Claim 17

An integrated circuit (IC) device, comprising:
a memory die comprising a plurality of memory blocks; and
a logic die placed over the memory die, the logic die to perform matrix multiplication operations of a neural network model, the logic die comprising:
a plurality of multiply-add units,
an interconnect fabric coupled with the plurality of multiply-add units to receive data points from the plurality of multiply-add units, and
a plurality of adders on the interconnect fabric, the plurality of adders to accumulate the data points.

### Claim 18 (depends on 17)

The IC device of claim 17, further comprising:
a plurality of vias, a via extending between a memory block in the memory die and a compute unit in the logic die.

### Claim 19 (depends on 17)

The IC device of claim 17, wherein the logic die further comprises:
an interface unit, the interface unit to receive an input of the logic die; and
a vector operation unit, the vector operation unit to perform one or more vector operations of the neural network model based on the input,
wherein the vector operation unit comprises one or more vector registers and one or more scalar registers, wherein data is transferred between the memory block and the one or more vector registers or the one or more scalar registers through the interconnect fabric.

### Claim 20 (depends on 17)

The IC device of claim 17, where the plurality of adders are arranged in a sequence, wherein data computed by a first adder in the sequence is transferred to a second adder in the sequence through the interconnect fabric, wherein the first adder is to receive data points computed by two or more multiply-add units of the plurality of multiply-add units and to compute a sum of the data points.
