Integrated memory system for high performance Bayesian and classical inference of neural networks
AssigneeThe Board of Trustees of the University of Illinois
InventorsAmit Ranjan Trivedi, Theja Tulabandhula, Priyesh Shukla, Ahish Shylendra, Shamma Nasrin
Life of this patent
Estimating the term…
Abstract
A memory module system for a high-dimensional weight space neural network configured to process machine learning data streams using Bayesian Inference and/or Classical Inference is set forth. The memory module can include embedded high speed random number generators (RNGs). The memory module is configured to compute, store and sample neural network weights by adapting operating precision to optimize the computing effort based on available weight space and application specifications.
Claims6
A memory module system for a high-dimensional weight space neural network configured to process machine learning data streams comprising:
- a memory module comprising a static random access memory (SRAM) array and a cross-SRAM processing layer, the SRAM array comprising an array of SRAM cells, multiplexer, analog-to-digital converter (ADC) and multiplicand buffer, the memory module with embedded random number generators (RNGs) within the memory module, where the SRAM array is configured for scalar product computation to determine statistical density storage;
- the memory module configured to store neural network weights, sample the neural network weights, and compute one or more scalar product using the sampled neural network weights and one or more corresponding applied inputs, where the memory module adapts operating precision to optimize computing effort based on available weight space and application specifications;
- and
- transform the one or more scalar product into an output signal.
Dependencies are inferred from the claim text.