Back to results
US 2024/0256285 A1Published application
Parallelizing multi-phase kernels with cross-phase dependency on heterogenous hardware
AssigneeMicrosoft Technology Licensing, LLC
InventorsSkand HURKAT, Tiyasa MITRA
Life of this patent
Estimating the term…
Abstract
The methods and systems perform multi-phase algorithms on data tensors. The methods and systems overlap the phases of a multi-phase algorithm and process different phases of the multi-phase algorithm concurrently on independent segments of a data tensor using multiple heterogeneous hardware execution units. The methods and systems process an entire segment of the data tensor with a phase before moving on to a next phase for the segment.
Claims20
A method, comprising:
- identifying a multi-phase algorithm to perform on a data tensor;
- and
- providing, to a processor with multiple hardware execution units, instructions to simultaneously process different phases of the multi-phase algorithm on independent segments of the data tensor using the multiple hardware execution units of the processor.
A method, comprising:
- identifying a multi-phase algorithm to perform on a data tensor;
- creating a fused phase by combining a plurality of phases of the multi-phase algorithm together;
- providing, to a processor with multiple hardware execution units, instructions to simultaneously process the fused phase on independent segments of the data tensor using the multiple hardware execution units of the processor;
- and
- continuing to provide, to the processor with multiple hardware execution units, instructions to process the fused phase on the independent segments of the data tensor until each phase of the multi-phase algorithm is processed in order on each segment of the data tensor.
2 more elements
Dependencies are inferred from the claim text.