Deterministic memory for tensor streaming processors
AssigneeGroq, Inc.
InventorDennis Charles Abts
Life of this patent
Estimating the term…
Loading patent…
AssigneeGroq, Inc.
InventorDennis Charles Abts
Estimating the term…
Embodiments are directed to a deterministic streaming system with one or more deterministic streaming processors each having an array of processing elements and a first deterministic memory coupled to the processing elements. The deterministic streaming system further includes a second deterministic memory with multiple data banks having a global memory address space, and a controller. The controller initiates retrieval of first data from the data banks of the second deterministic memory as a first plurality of streams, each stream of the first plurality of streams streaming toward a respective group of processing elements of the array of processing elements. The controller further initiates writing of second data to the data banks of the second deterministic memory as a second plurality of streams, each stream of the second plurality of streams streaming from the respective group of processing elements toward a respective data bank of the second deterministic memory.
A deterministic streaming system comprising:
A method of deterministic computing at a deterministic streaming system, the method comprising:
A non-transitory computer-readable storage medium having stored thereon executable instructions, which when executed by a computer processor cause the computer processor to:
Dependencies are inferred from the claim text.