Mixed-precision computations with state compression
AssigneeAmazon Technologies, Inc.
InventorsKun Xu, Sundeep Amirineni, Paul Gilbert Meyer, Ron Diamant
Life of this patent
Estimating the term…
Abstract
A technique for matching the throughput between writing into and reading from a memory can include receiving, in parallel, computational results in a high precision format for storing into the memory at a first frequency, and storing the computational results in the memory. The technique may further include rounding the computational results using round-to-the-nearest-even or stochastic rounding to down-convert the computational results from the high precision format to a low precision format in parallel, and outputting the computational results in the low precision format in parallel from the memory at a second frequency.
Claims20
An integrated circuit device comprising:
- a memory operable to store computational results;
- a write interface operable to write the computational results received at a first frequency into the memory;
- a read interface operable to read the computational results from the memory and output the computational results at a second frequency, the second frequency being different from the first frequency;
- and
- a down-converter operable to perform down-conversion of the computational results from a high precision format into a low precision format by rounding the computational results,
- wherein the down-conversion is performed when writing the computational results into the memory or when reading the computational results from the memory.
A method comprising:
- receiving, in parallel, computational results in a high precision format at a write interface for storing into a memory at a first frequency;
- storing the computational results in the memory;
- rounding the computational results by a down-converter connected to the memory using round-to-the-nearest-even or stochastic rounding to down-convert the computational results from the high precision format to a low precision format in parallel;
- and
- outputting the computational results in the low precision format in parallel from the memory at a second frequency by a read interface, the second frequency being different from the first frequency,
- wherein the down-conversion is performed when writing the computational results into the memory or when reading the computational results from the memory.
Dependencies are inferred from the claim text.