Back to results
US 10,853,035 B2Granted
Multiply-accumulate “0” data gating
AssigneeIntel Corporation
InventorsYaniv Fais, Tomer Bar-On, Jacob Subag, Jeremie Dreyfuss, Lev Faivishevsky, Michael Behar, Amit Bleiweiss, Guy Jacob, Gal Leibovich, Itamar Ben-Ari, Galina Ryvchin, Eyal Yaacoby
Life of this patent
Estimating the term…
Abstract
In an example, an apparatus comprises a plurality of execution units and logic, at least partially including hardware logic, to gate at least one of a multiply unit or an accumulate unit in response to an input of value zero. Other embodiments are also disclosed and claimed.
Claims20
An apparatus comprising:
- an instruction cache to receive graphics processing instructions;
- a general-purpose graphics processing compute block comprising a plurality of graphics processing cores to perform operations to execute the graphics processing instructions;
- and
- processing circuitry to:
- receive, into at least one of a multiply unit or an accumulate unit, a first inference weight and a second inference weight from a layer of a convolutional neural network;
- and
- negate the second inference weight, bypass the multiply unit, and use a shift register when at least one of the first inference weight or the second inference weight are within a threshold value of a power of two, such that the multiply unit performs no operations on the first inference weight or the second inference weight.
4 more elements
A method, comprising:
- receiving graphics processing instructions in an instruction cache of a general purpose graphics processor:
- performing operations to execute the graphics processing instructions;
- and
- receiving, into at least one of a multiply unit or an accumulate unit of the general purpose graphics processor, a first inference weight and a second inference weight from a layer of a convolutional neural network;
- and
- negating the second inference weight, bypassing the multiply unit, and using a shift register when at least one of the first inference weight or the second inference weight are within a threshold value of a power of two, such that the multiply unit performs no operations on the first inference weight or the second inference weight.
3 more elements
Dependencies are inferred from the claim text.