Parallel operations in compute systems
AssigneeOpenAI OpCo, LLC
InventorsBurak Erbagci, Cagla Cakir, Alexander Almela Conklin, Tracey DellaRova, Jean-Didier Allegrucci
Life of this patent
Estimating the term…
Loading patent…
AssigneeOpenAI OpCo, LLC
InventorsBurak Erbagci, Cagla Cakir, Alexander Almela Conklin, Tracey DellaRova, Jean-Didier Allegrucci
Estimating the term…
The disclosure is related to systems, apparatuses, devices, and methods for parallel operations in computing systems that may be useful for heavy AI training and inference workloads. The disclosed technology provides arrangements for efficient computation. In some implementations, a compute-in-memory (CIM) device or macro is configured to perform vector matrix multiplication (VMM) operations between a vector of activation values and a matrix of weight values. A column cell in the CIM macro has bitcells are configured to store weight values and other bitcells are configured to store weight values that are different from the first weight valuse. The CIM macro is further configured to perform, in parallel, read/write operations to the first set of bitcells and the VMM operation in the second set of bitcells based on a weight select signal.
An apparatus comprising:
A method for performing a write operation in a compute-in-memory (CIM) macro comprising a column cell having a first set of bitcells connected to a first set of wordlines and a second set of bitcells connected to a second set of wordlines, the method comprising:
A system comprising:
Dependencies are inferred from the claim text.