Back to results
US 2020/0050582 A1Published application
Performing concurrent operations in a processing element
AssigneeAmazon Technologies, Inc.
InventorsDana Michelle Vantrease, Ron Diamant
Life of this patent
Estimating the term…
Abstract
A processing element (PE) of a systolic array can perform neural networks computations on two or more data elements of an input data set using the same weight. Thus, two or more output data elements corresponding to an output data set may be generated. Based on the size of the input data set and an input data type, the systolic array can process a single data element or multiple data elements in parallel.
Claims20
An integrated circuit device comprising:
- a state buffer configured to provide row data and a weight value;
- a processing element (PE) including:
- a row input interface configured to receive a row input based on the row data;
- a column input interface configured to receive a column input;
- and
- a column output interface configured to provide a column output computed from the row input, the column input, and the weight value;
- an output buffer configured to store a computational result derived from the column output;
- and
- an activation engine configured to apply a function to the computational result and store an output of the function in the state buffer.
6 more elements
A processing element (PE) comprising:
- a first interface configured to receive a first X-in element and a second X-in element, and
- a second interface configured to receive a first Y-in element and a second Y-in element,
- wherein the PE is configured to:
- perform a first computational operation on the first X-in element and a weight value to generate a first intermediate result, and on the second X-in element and the weight value to generate a second intermediate result;
- and
- perform a second computational operation on the first intermediate result and the first Y-in element to generate a first Y-out element, and on the second intermediate result and the second Y-in element to generate a second Y-out element.
3 more elements
A method comprising:
- receiving, by a processing element (PE), a first X-in element and a second X-in element along a row datapath;
- receiving, by the PE, a first Y-in element and a second Y-in element along a column datapath;
- performing, by the PE, a first computational operation on the first X-in element with a weight value to generate a first result, and on the second X-in element with the weight value to generate a second result;
- performing, by the PE, a second computational operation on the first result with the first Y-in element to generate a first Y-out element, and on the second result with the second Y-in element to generate a second Y-out element;
- and
- outputting the first Y-out element and the second Y-out element along the column datapath.
3 more elements
Dependencies are inferred from the claim text.