# US 2025/0117359 A1 · Dual pipeline parallel systolic array

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0117359 A1
- Document ID: US20250117359A1
- Status: Published application
- Kind: A1
- Application number: 18/913,758
- Filed: 2024-10-11
- Published: 2025-04-10
- Earliest claimed: 2021-06-25
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Jorge Parra; Jiasheng Chen; Supratim Pal; Fangwen Fu; Sabareesh Ganapathy; Chandra Gurram; Chunhui Mei; Yue Qi
- Web page: https://patentgrep.com/patent/US20250117359A1

## CPC

- G06F 9/30145: {Instruction analysis, e.g. decoding, instruction word fields}
- G06F 15/8046: {Systolic arrays}
- G06F 9/3001: {Arithmetic instructions}
- G06F 9/30036: {Instructions to perform operations on packed data, e.g. vector, tile or matrix operations}
- G06F 9/30038: {using a mask}
- G06F 9/3802: {Instruction prefetching}
- G06F 9/382: {Pipelined decoding, e.g. using predecoding}
- G06F 9/3828: {with global bypass, e.g. between pipelines, between clusters}
- G06F 9/3893: {controlled in tandem, e.g. multiplier-accumulator}
- G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A processing apparatus described herein includes a general-purpose parallel processing engine comprising a systolic array having multiple pipelines, each of the multiple pipelines including multiple pipeline stages, wherein the multiple pipelines include a first pipeline, a second pipeline, and a common input shared between the first pipeline and the second pipeline.

## Claims

### Claim 1

An accelerator device comprising:
a system interconnect; and
a general-purpose parallel processing engine coupled with the system interconnect, the general-purpose parallel processing engine comprising a matrix engine having a first pipeline, a second pipeline, and a common input shared between the first pipeline and the second pipeline, the matrix engine including a first output memory associated with the first pipeline, a second output memory associated with the second pipeline, and common output circuitry configurable to output from one of the first output memory and the second output memory.

### Claim 2 (depends on 1)

The accelerator device as in claim 1, wherein the first pipeline is to operate concurrently with the second pipeline.

### Claim 3 (depends on 2)

The accelerator device as in claim 2, wherein the matrix engine includes a first set of multiple inputs associated with an accumulator value, a second set of multiple inputs associated with row data for a matrix multiply operation, and the common input that is shared between the first pipeline and the second pipeline.

### Claim 4 (depends on 3)

The accelerator device as in claim 3, wherein the common input is associated with column data for the matrix multiply operation.

### Claim 5 (depends on 1)

The accelerator device as in claim 1, wherein the general-purpose parallel processing engine is to fetch an instruction to perform operations associated with a matrix instruction and decode the instruction into multiple sub-instructions.

### Claim 6 (depends on 5)

The accelerator device as in claim 5, wherein to decode the instruction into the multiple sub-instructions includes to generate a first set of sub-instructions for execution by the first pipeline and to generate a second set of sub-instructions for execution by the second pipeline.

### Claim 7 (depends on 6)

The accelerator device as in claim 6, wherein the first set of sub-instructions and the second set of sub-instructions reference a common set of registers to store data associated with the common input shared between the first pipeline and the second pipeline.

### Claim 8 (depends on 7)

The accelerator device as in claim 7, wherein the matrix engine includes circuitry to:
read, by the first pipeline, a first set of matrix elements specified by operands of the first set of sub-instructions and a second set of matrix elements specified by operands of the second set of sub-instructions;
store, by the first pipeline, a first sub-set of matrix elements to memory within the matrix engine, the memory accessible by the second pipeline;
relay, by the first pipeline, a second sub-set of matrix elements to the second pipeline;
perform, by the first pipeline, processing operations specified by the first set of sub-instructions; and
perform, by the second pipeline, processing operations specified by the second set of sub-instructions.

### Claim 9 (depends on 7)

The accelerator device as in claim 7, wherein to generate the first set of sub-instructions for execution by the first pipeline includes to determine a first set of registers that store operands for the first set of sub-instructions and determine a second set of registers that store operands for the second set of sub-instructions.

### Claim 10 (depends on 9)

The accelerator device as in claim 9, wherein the common output circuitry is to write output from one of the first output memory and the second output memory to a register file associated with the matrix engine.

### Claim 11

A method comprising:
providing a matrix engine having multiple pipelines including a first pipeline and a second pipeline;
sharing a common input between the first pipeline and the second pipeline of the multiple pipelines;
associating a first output memory with the first pipeline and a second output memory with the second pipeline; and
configuring common output circuitry to output from one of the first output memory and the second output memory.

### Claim 12 (depends on 11)

The method of claim 11, comprising:
reading operand data for an instruction to be executed by the matrix engine from a register file associated with the matrix engine, the operand data including matrix elements associated with the instruction;
executing a first portion of the instruction via the first pipeline and concurrently executing a second portion of the instruction via the second pipeline; and
writing output of the first portion of the instruction and the second portion of the instruction to the register file.

### Claim 13 (depends on 12)

The method of claim 12, wherein reading operand data for the instruction includes:
reading, by the first pipeline, matrix elements associated with the first portion of the instruction and the second portion of the instruction;
storing, by the first pipeline, a first sub-set of matrix elements to memory within the matrix engine, the memory accessible by the second pipeline; and
relaying, by the first pipeline, a second sub-set of matrix elements to the second pipeline.

### Claim 14 (depends on 12)

The method of claim 12, wherein writing output to the register file includes:
writing output from the first pipeline to a first output buffer associated with the first pipeline;
writing output from the second pipeline to a second output buffer associated with the second pipeline; and
writing output from the first output buffer and the second output buffer to the register file via a common output.

### Claim 15

A system comprising:
a memory device; and
an accelerator device coupled to the memory device, the accelerator device comprising multiple pipelines of processing elements, each of the multiple pipelines including multiple pipeline stages, the multiple pipelines including a first pipeline, a second pipeline, and a common input shared between the first pipeline and the second pipeline, the common input associated with column data for a matrix multiply operation, wherein the multiple pipeline stages each include multiple processing channels, each of the multiple processing channels includes a first set of multipliers associated with a first pipeline stage, a second set of multipliers associated with a second pipeline stage, and an adder that is common to the first pipeline stage and the second pipeline stage.

### Claim 16 (depends on 15)

The system of claim 15, wherein the accelerator device includes a first set of multiple inputs associated with an accumulator value, a second set of multiple inputs associated with row data for a matrix multiply operation, and the common input that is shared between the first pipeline and the second pipeline.

### Claim 17 (depends on 15)

The system as in claim 15, wherein the accelerator device is to fetch an instruction to perform operations associated with a matrix instruction and decode the instruction into multiple portions of the instruction.

### Claim 18 (depends on 17)

The system as in claim 17, wherein the accelerator device is to:
execute a first portion of the instruction via the first pipeline; and
execute a second portion of the instruction via the second pipeline, the first portion of the instruction and the second portion of the instruction to reference a common set of registers to store data associated with the common input shared between the first pipeline and the second pipeline.

### Claim 19 (depends on 18)

The system as in claim 18, wherein the accelerator device includes circuitry to:
read, by the first pipeline, a first set of matrix elements specified by operands of the first portion of the instruction and a second set of matrix elements specified by operands of the second portion of the instruction;
store, by the first pipeline, a first sub-set of matrix elements to memory within the accelerator device, the memory accessible by the second pipeline;
relay, by the first pipeline, a second sub-set of matrix elements to the second pipeline;
perform, by the first pipeline, processing operations specified by the first portion of the instruction; and
perform, by the second pipeline, processing operations specified by the second portion of the instruction.

### Claim 20 (depends on 15)

The system as in claim 15, wherein common output circuitry is to write output from one of a first output memory and a second output memory to a register file associated with the accelerator device.
