Back to results
US 11,442,890 B1Granted
On-circuit data activity monitoring for a systolic array
AssigneeAmazon Technologies, Inc.
InventorThomas A Volpe
Life of this patent
Estimating the term…
Abstract
On-circuit data activity monitoring may be performed for a systolic array. A current data activity measurement may be determined for changes in input data for processing at a systolic array and compared with a prior data activity measurement. Based on the comparison, a throttling recommendation may be provided to a management component to determine whether to perform the throttling recommendation.
Claims20
A system, comprising:
- at least one processor;
- a memory, storing program instructions that when executed by the at least one processor cause the at least one processor to submit one or more machine learning tasks for processing to a machine learning accelerator;
- and
- the machine learning accelerator in an integrated circuit, the machine learning accelerator comprising:
- a systolic array comprising a plurality of processing elements to perform respective operations on a number of the plurality of processing elements to perform one or more machine learning tasks;
- and
- a data activity monitor, configured to:
- for a first period of time, determine a first data activity measurement of changes in respective values of input data to the systolic array via an x-direction bus;
- for a second period of time, determine a second data activity measurement of changes in respective values of prior input data to the systolic array via the x-direction bus;
- compare the first data activity measurement with the second data activity measurement to determine a throttling recommendation for the systolic array;
- and
- send the throttling recommendation to a management component for the integrated circuit.
9 more elements
A method, comprising:
- for a first period of time, determining, by a data activity monitor in a first portion of an integrated circuit, a first data activity measurement from changes in respective values of input data received for processing through a plurality of processing elements in a systolic array, the systolic array in a second portion of the integrated circuit;
- comparing, by the data activity monitor, the first data activity measurement with a second data activity measurement determined from changes in respective values of prior input data received for processing through the plurality of processing elements in the systolic array for a second period of time to determine a throttling recommendation for the systolic array;
- and
- providing, by the data activity monitor, the throttling recommendation to a management component for the integrated circuit.
1 more element
A device, comprising an integrated circuit, the integrated circuit comprising:
- a systolic array comprising a plurality of processing elements that perform respective operations on a number of the plurality of processing elements during respective cycles;
- and
- a data activity monitor, configured to:
- for a first period of time, determine a first data activity measurement of changes in respective values of input data to the plurality of processing elements in the systolic array;
- compare the first data activity measurement with a second data activity measurement determined from changes in respective values of prior input data for a second period of time to determine a throttling recommendation for the systolic array;
- and
- send the throttling recommendation to a management component for the integrated circuit.
4 more elements
Dependencies are inferred from the claim text.