Back to results
US 12,602,252 B2Granted
Sparse matrix multiplication in a neural network
AssigneeNVIDIA Corporation
InventorsJorge Albericio Latorre, Chong Yu
Life of this patent
Estimating the term…
Abstract
Apparatuses, systems, and methods to enable matrix multiplication acceleration by modifying an input to apply sparsity through sparse activation filtering. In at least one embodiment, a neural network modifies pixels within an image through sparse activation filtering to enable use of one or more matrix multiplication acceleration units to perform a sparse patch embedding operation.
Claims20
A processor, comprising:
- one or more circuits to:
- modify one or more values corresponding to one or more pixels within one or more images to zero according to a sparsity constraint;
- and
- cause one or more operations to be performed, using one or more matrix multiplication acceleration units, on one or more operands representing pixels including the one or more modified pixels, wherein the one or more matrix multiplication acceleration units are configured to accelerate operation based on the sparsity constraint.
1 more element
A system, comprising:
- one or more processors to:
- modify one or more values corresponding to one or more pixels within one or more images to zero according to a sparsity constraint;
- and
- cause one or more operations to be performed, using one or more matrix multiplication acceleration units, on one or more operands representing pixels including the one or more modified pixels, wherein the one or more matrix multiplication acceleration units are configured to accelerate operation based on the sparsity constraint.
1 more element
A method, comprising:
- modifying one or more values corresponding to one or more pixels within one or more images to zero according to a sparsity constraint;
- and
- causing one or more operations to be performed, using one or more matrix multiplication acceleration units, on one or more operands representing pixels including the one or more modified pixels, wherein the one or more matrix multiplication acceleration units are configured to accelerate operation based on the sparsity constraint.
Dependencies are inferred from the claim text.