Unified programming interface for regrained tile execution
AssigneeIntel Corporation
InventorsSara Baghsorkhi, Mohammad Reza Haghighat
Life of this patent
Estimating the term…
Abstract
Systems, apparatuses and methods may provide for technology that detects a tensor operation in an application, wherein the tensor operation has an unspecified tensor input size, determines the input tensor size at runtime, and selects a partition configuration for the tensor operation based at least in part on the input tensor size and one or more runtime conditions. In one example, the technology searches a lookup table for the input tensor size and at least one of the runtime condition(s) to select the partition configuration.
Claims20
A method of generating computer program instructions of executing a deep neural network, the method comprising:
- detecting a size of an input tensor of a tensor operation in the deep neural network;
- and
- partitioning the tensor operation into computations based on the size of the input tensor and one or more runtime conditions of a hardware device executing the deep neural network, wherein partitioning the tensor operation comprises partitioning the input tensor into a plurality of data tiles, a data tile is a portion of the input tensor, and the computations are to be performed by the hardware device as at least part of a re-grained tile execution on the plurality of data tiles.
One or more non-transitory computer-readable media storing instructions executable to perform operations for generating computer program instructions of executing a deep neural network, the operations comprising:
- detecting a size of an input tensor of a tensor operation in the deep neural network;
- and
- partitioning the tensor operation into computations based on the size of the input tensor and one or more runtime conditions of a hardware device executing the deep neural network, wherein partitioning the tensor operation comprises partitioning the input tensor into a plurality of data tiles, a data tile is a portion of the input tensor, and the computations are to be performed by the hardware device as at least part of a re-grained tile execution on the plurality of data tiles.
An apparatus, comprising:
- a processor;
- and
- one or more non-transitory computer-readable media storing instructions executable by the processor to perform operations for generating computer program instructions of executing a deep neural network, the operations comprising:
- detecting a size of an input tensor of a tensor operation in the deep neural network;
- and
- partitioning the tensor operation into computations based on the size of the input tensor and one or more runtime conditions of a hardware device executing the deep neural network, wherein partitioning the tensor operation comprises partitioning the input tensor into a plurality of data tiles, a data tile is a portion of the input tensor, and the computations are to be performed by the hardware device as at least part of a re-grained tile execution on the plurality of data tiles.
Dependencies are inferred from the claim text.