Parallel operations in compute systems
AssigneeOpenAI OpCo, LLC
InventorsBurak Erbagci, Cagla Cakir, Alexander Almela Conklin, Tracey DellaRova, Jean-Didier Allegrucci
Life of this patent
Estimating the term…
Loading patent…
AssigneeOpenAI OpCo, LLC
InventorsBurak Erbagci, Cagla Cakir, Alexander Almela Conklin, Tracey DellaRova, Jean-Didier Allegrucci
Estimating the term…
The disclosure is related to systems, apparatuses, devices, and methods for parallel operations in computing systems that may be useful for heavy AI training and inference workloads. The disclosed technology provides arrangements for efficient computation. In some implementations, a compute-in-memory (CIM) device or macro is configured to perform vector matrix multiplication (VMM) operations between a vector of activation values and a matrix of weight values. A column cell in the CIM macro has bitcells are configured to store weight values and other bitcells are configured to store weight values that are different from the first weight values. The CIM macro is further configured to perform, in parallel, read/write operations to the first set of bitcells and the VMM operation in the second set of bitcells based on a weight select signal.
A compute apparatus to minimize stalls using parallelization, the compute apparatus comprising:
A compute apparatus, comprising:
A method of operating a compute-in-memory apparatus, the method comprising
Dependencies are inferred from the claim text.