# US 2026/0252392 A1 · Programmable stream triggered multithreading capable streaming dataflow deep learning accelerator

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0252392 A1
- Document ID: US20260252392A1
- Status: Published application
- Kind: A1
- Application number: 19/064,410
- Filed: 2025-02-26
- Published: 2026-08-27
- Earliest claimed: 2025-02-26
- Assignees: STMicroelectronics International N.V.
- Applicants: STMicroelectronics International N.V.
- Inventors: Thomas BOESCH; Surinder Pal SINGH; Giuseppe DESOLI; Riccardo MASSA; Antonio DE VITA
- Web page: https://patentgrep.com/patent/US20260252392A1

## CPC

- G06F 9/30087: {Synchronisation or serialisation instructions}
- G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals}
- G06F 9/3851: {from multiple instruction streams, e.g. multistreaming}
- G06F 9/3888: {controlled by a single instruction for multiple threads [SIMT] in parallel}
- G06F 9/4806: {Task transfer initiation or dispatching}
- G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues}
- G06F 9/505: {considering the load}
- G06F 9/522: {Barrier synchronisation}
- G06F 13/4022: {using switching circuits, e.g. switching matrix, connection or expansion network (G06F13/4009 takes precedence)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A stream-triggered multi-thread accelerator includes a data streaming interface, a memory, vector processing circuitry and scheduling circuitry. The data streaming interface, in operation, receives and transmits data streams of a plurality of data streaming channels. The memory, in operation, stores a plurality of instruction threads. The plurality of instruction threads include wait-for-trigger instructions specifying streaming data trigger thresholds, and instructions having data streaming channels of the plurality of data streaming channels as operands. The vector processing circuitry is coupled to the memory and to the data streaming interface. The vector processing circuitry, in operation, executes instruction threads of the plurality of instruction threads. The scheduling circuitry, in operation, schedules execution of instruction threads of the plurality of instruction threads by the vector processing circuitry based on the streaming data trigger thresholds of the wait-for-trigger instructions.

## Claims

### Claim 1

A stream-triggered multi-thread accelerator, comprising:
a data streaming interface, which, in operation, receives and transmits data streams of a plurality of data streaming channels;
memory, which, in operation, stores a plurality of instruction threads, the plurality of instruction threads including:
wait-for-trigger instructions specifying streaming data trigger thresholds; and
instructions having data streaming channels of the plurality of data streaming channels as operands;
vector processing circuitry coupled to the memory and to the data streaming interface, wherein the vector processing circuitry, in operation, executes instruction threads of the plurality of instruction threads; and
scheduling circuitry, which, in operation, schedules execution of instruction threads of the plurality of instruction threads by the vector processing circuitry based on the streaming data trigger thresholds of the wait-for-trigger instructions.

### Claim 2 (depends on 1)

The stream-triggered multi-thread accelerator of claim 1, wherein,
the plurality of data streaming channels are virtual data streaming channels and the data streaming interface, in operation, receives data streams via multiple stream links supporting the plurality of virtual data streaming channels.

### Claim 3 (depends on 2)

The stream-triggered multi-thread accelerator of claim 2 wherein an instruction thread of the plurality of instruction threads includes a wait-for-trigger instruction specifying a streaming data trigger threshold associated with a virtual data streaming channel of the plurality of virtual data streaming channels.

### Claim 4 (depends on 2)

The stream-triggered multi-thread accelerator of claim 2, wherein an instruction thread of the plurality of instruction threads includes a compound trigger instruction specifying a first streaming data trigger threshold associated with a first virtual data streaming channel and a second streaming data trigger threshold associated with a second virtual data streaming channel.

### Claim 5 (depends on 2)

The stream-triggered multi-thread accelerator of claim 2, wherein the memory includes:
an instruction memory, which, in operation, stores the instruction threads;
a scratchpad memory, which, in operation, buffers data associated with virtual data streaming channels of the plurality of virtual data streaming channels; and
configuration registers, which, in operation, store configuration information associated with virtual data streaming channels of the plurality of data streaming channels.

### Claim 6 (depends on 5)

The stream-triggered multi-thread accelerator of claim 5, wherein the configuration information associated with a data streaming channel includes a trigger ID and a data threshold.

### Claim 7 (depends on 5)

The stream-triggered multi-thread accelerator of claim 5, comprising stream control circuitry coupled to the data streaming interface and to the scratchpad memory, wherein the stream control circuitry, in operation, controls storage of data associated with the virtual data streaming channels in the scratchpad memory.

### Claim 8 (depends on 7)

The stream-triggered multi-thread accelerator of claim 7, wherein the stream control circuitry implements pointers to control the storage of data associated with the virtual data streaming channels in the scratchpad memory.

### Claim 9 (depends on 7)

The stream-triggered multi-thread accelerator of claim 7, wherein the stream control circuitry implements stream stall protocols to control the flow of data in the virtual data streaming channels.

### Claim 10 (depends on 2)

The stream-triggered multi-thread accelerator of claim 2, wherein the vector processing circuitry supports an instruction set architecture including:
scaler operations; and
vector operations.

### Claim 11 (depends on 1)

The stream-triggered multi-thread accelerator of claim 1, wherein the plurality of instruction threads include instructions having:
memory register operands;
memory address operands;
data streaming channel operands; or
combinations thereof.

### Claim 12 (depends on 1)

The stream-triggered multi-thread accelerator of claim 1, wherein the scheduling circuitry, in operation, interleaves execution of instruction threads of the plurality of instruction threads by the vector processing circuitry.

### Claim 13 (depends on 12)

The stream-triggered multi-thread accelerator of claim 12, wherein the scheduling circuitry, in operation, schedules execution of instruction threads of the plurality of instruction threads by the vector processing circuitry based on priorities associated with instruction threads of the plurality of instruction threads.

### Claim 14 (depends on 1)

The stream-triggered multi-thread accelerator of claim 1, wherein an instruction thread of the plurality of instruction threads has a single active vector instruction.

### Claim 15

A system, comprising:
a stream switch; and
a plurality of programmable components coupled to the stream switch, the plurality of programmable components including a stream-triggered multi-thread accelerator including:
a data streaming interface coupled to the stream switch, which, in operation, receives and transmits data streams of a plurality of data streaming channels;
memory, which, in operation, stores a plurality of instruction threads, the plurality of instruction threads including:
wait-for-trigger instructions specifying streaming data trigger thresholds; and
instructions having data streaming channels of the plurality of data streaming channels as operands; and
processing circuitry coupled to the memory and to the data streaming interface, wherein the processing circuitry, in operation, executes instruction threads of the plurality of instruction threads based on the streaming data trigger thresholds of the wait-for-trigger instructions.

### Claim 16 (depends on 15)

The system of claim 15, comprising multi-context control circuitry coupled to the stream-triggered multi-thread accelerator, wherein the multi-context control circuitry, in operation, provides context information to the stream-triggered multi-thread accelerator.

### Claim 17 (depends on 15)

The system of claim 15, wherein,
the plurality of data streaming channels are virtual data streaming channels and the data streaming interface, in operation, receives data streams via multiple stream links supporting the plurality of virtual data streaming channels.

### Claim 18 (depends on 17)

The system of claim 17, wherein an instruction thread of the plurality of instruction threads includes a compound trigger instruction specifying a first streaming data trigger threshold associated with a first virtual data streaming channel and a second streaming data trigger threshold associated with a second virtual data streaming channel.

### Claim 19 (depends on 17)

The system of claim 17, wherein the stream-triggered multi-thread accelerator comprises stream control circuitry coupled to the data streaming interface, wherein the stream control circuitry, in operation, controls storage of data associated with the virtual data streaming channels in the memory using data pointers and stall protocols.

### Claim 20 (depends on 15)

The system of claim 15, comprising:
a host processor;
host memory; and
a system bus coupled to the host processor and the host memory, wherein the stream-triggered multi-thread accelerator includes a bus interface and the plurality of instruction threads includes instructions having operands corresponding to addresses in the host memory.

### Claim 21 (depends on 15)

The system of claim 15, wherein the plurality of instruction threads include instructions:
having data streaming channels of the plurality of data streaming channels as destination operands;
having data streaming channels of the plurality of data streaming channels as source operands; or
combinations thereof.

### Claim 22

A method, comprising:
streaming data streams of a plurality of data streaming channels to a stream-triggered multi-thread accelerator via a stream switch; and
executing instruction threads of a plurality of instruction threads using the stream-triggered multi-thread accelerator, wherein,
the plurality of instruction threads include:
wait-for-trigger instructions specifying streaming data trigger thresholds; and
instructions having data streaming channels of the plurality of data streaming channels as operands; and
the executing instruction threads of the plurality of instruction threads includes scheduling execution of instruction threads of the plurality of instruction threads based on the streaming data trigger thresholds of the wait-for-trigger instructions.

### Claim 23 (depends on 22)

The method of claim 22, wherein the plurality of data streaming channels are virtual data streaming channels.

### Claim 24 (depends on 23)

The method of claim 23 wherein an instruction thread of the plurality of instruction threads includes a wait-for-trigger instruction specifying a streaming data trigger threshold associated with a virtual data streaming channel of the plurality of virtual data streaming channels.

### Claim 25 (depends on 23)

The method of claim 23, wherein an instruction thread of the plurality of instruction threads includes a compound trigger instruction specifying a first streaming data trigger threshold associated with a first virtual data streaming channel and a second streaming data trigger threshold associated with a second virtual data streaming channel.

### Claim 26 (depends on 23)

The method of claim 23, comprising:
storing the instruction threads of the plurality of instruction threads in an instruction memory of the stream-triggered multi-thread accelerator;
buffering data associated with virtual data streaming channels of the plurality of virtual data streaming channels in a scratchpad memory of the stream-triggered multi-thread accelerator; and
storing configuration information associated with virtual data streaming channels of the plurality of data streaming channels in configuration registers of the stream-triggered multi-thread accelerator.

### Claim 27 (depends on 26)

The method of claim 26, wherein the configuration information associated with a data streaming channel includes a trigger ID and a data threshold.

### Claim 28 (depends on 26)

The method of claim 26, comprising implementing pointers to control storage of data associated with the virtual data streaming channels in the scratchpad memory.

### Claim 29 (depends on 28)

The method of claim 28, comprising implementing stream stall protocols to control the flow of data in the virtual data streaming channels.

### Claim 30 (depends on 22)

The method of claim 22, wherein the plurality of instruction threads include instructions having:
memory register operands;
memory address operands;
data streaming channel operands; or
combinations thereof.

### Claim 31 (depends on 22)

The method of claim 22, wherein the scheduling execution of instruction threads of the plurality of instruction threads includes interleaving execution of instruction threads of the plurality of instruction threads.

### Claim 32 (depends on 31)

The method of claim 31, wherein the scheduling execution of instruction threads of the plurality of instruction threads is based on priorities associated with instruction threads of the plurality of instruction threads.

### Claim 33

A non-transitory computer-readable medium storing contents which configure a stream-triggered multi-thread accelerator to perform a method, the method comprising:
receiving data streams of a plurality of data streaming channels via a stream switch; and
executing instruction threads of a plurality of instruction threads, wherein,
the plurality of instruction threads include:
wait-for-trigger instructions specifying streaming data trigger thresholds; and
instructions having data streaming channels of the plurality of data streaming channels as operands; and
the executing instruction threads of the plurality of instruction threads includes scheduling execution of instruction threads of the plurality of instruction threads based on the streaming data trigger thresholds of the wait-for-trigger instructions.

### Claim 34 (depends on 33)

The non-transitory computer-readable medium of claim 33, wherein the plurality of data streaming channels are virtual data streaming channels.

### Claim 35 (depends on 33)

The non-transitory computer-readable medium of claim 33, wherein an instruction thread of the plurality of instruction threads includes a compound trigger instruction specifying a first streaming data trigger threshold associated with a first virtual data streaming channel and a second streaming data trigger threshold associated with a second virtual data streaming channel.

### Claim 36 (depends on 33)

The non-transitory computer-readable medium of claim 33, wherein the method comprises:
storing the instruction threads of the plurality of instruction threads in an instruction memory of the stream-triggered multi-thread accelerator;
buffering data associated with virtual data streaming channels of the plurality of virtual data streaming channels in a scratchpad memory of the stream-triggered multi-thread accelerator; and
storing configuration information associated with virtual data streaming channels of the plurality of data streaming channels in configuration registers of the stream-triggered multi-thread accelerator.

### Claim 37 (depends on 33)

The non-transitory computer-readable medium of claim 33, wherein the contents comprise the plurality of instruction threads.
