Enhanced input of machine-learning accelerator activations
AssigneeGoogle Inc.
InventorsLukasz Lew, Wren Romano
Life of this patent
Estimating the term…
Abstract
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for scheduling operations on a machine-learning accelerator having multiple tiles. The apparatus includes a processor having a plurality of tiles and scheduling circuitry that is configured to select a respective input activation for each tile of the plurality of tiles from either an activation line for the tile or a delay register for the activation line.
Claims11
(canceled)
A method performed using a processor comprising a plurality of activation lines and a plurality of delay registers, wherein each delay register is paired with a respective activation line, the method comprising:
- on a first global tick, populating a first delay register with a first activation value from a first activation line of the processor, and
- routing a second activation value to the first activation line;
- on a first local tick of the first global tick, providing at least the first activation value from the delay register to a compute tile of the processor;
- and
- on each subsequent local tick of the first global tick, providing one or more additional activation values from the plurality of activation lines after providing at least the first activation value from the delay register.
Dependencies are inferred from the claim text.