Stochastic rounding of numerical values
AssigneeNVIDIA Corporation
InventorsJonah M. Alben, Paulius Micikevicius, Hao Wu, Ming Yiu Siu
Life of this patent
Estimating the term…
Loading patent…
AssigneeNVIDIA Corporation
InventorsJonah M. Alben, Paulius Micikevicius, Hao Wu, Ming Yiu Siu
Estimating the term…
A method, computer readable medium, and system are disclosed for rounding numerical values. A set of bits from an input value is identified as a rounding value. A second set of bits representing a second value is extracted from the input value and added with the rounding value to produce a sum. The sum is truncated to produce the rounded output value. Thus, the present invention provides a stochastic rounding technique that rounds up an input value as a function of a second value and a rounding value, both of which were obtained from the input value. When the second value and rounding value are obtained from consistent bit locations of the input value, the resulting output value is deterministic. Stochastic rounding, which is deterministic, is advantageously applicable in deep learning applications.
A circuit, configured to:
A method, comprising:
A non-transitory, computer-readable storage medium storing instructions that, when executed by a processing unit, cause the processing unit to:
Dependencies are inferred from the claim text.