Systems and methods for high bandwidth memory with unidirectional data flow
AssigneeGoogle Inc.
InventorsHoria Alexandru Toma, Gurushankar Rajamani, Sukalpa Biswas, Robert S. Sprinkle
Life of this patent
Estimating the term…
Abstract
The present application relates to systems and methods for providing high bandwidth connections between memory and computing units. For example, memory units can be configured to perform concurrent read and write operations in parallel to one another. The memory units can also be configured to alter the relative bandwidths that are available for the read and write operations. For example, bi-directional transmission interfaces of a memory unit can be assigned to operate as uni-directional interfaces that are a part of either a data input path or a data output path.
Claims19
A system for computing and memory communication comprising:
- a computing unit;
- and
- a high-bandwidth memory (HBM), having a plurality of data transmission interfaces that are bi-directional, wherein the HBM is configured to access assignment data relating to read/write assignments for the plurality of data transmission interfaces and assign a first subset of the data transmission interfaces to operate unidirectionally as a data input path for receiving data corresponding to write operations based on the assignment data, and to assign a second subset of the data transmission interfaces to operate unidirectionally as a data output path for transmitting data corresponding to read operations based on the assignment data, and wherein the HBM is further configured to communicate with the computing unit so as to perform a read operation and a write operation in parallel.
A method for computing and memory communication comprising:
- accessing assignment data relating to read/write assignments for a plurality of data transmission interfaces;
- assigning, based on the assignment data, a first subset of data transmission interfaces that are bi-directional to operate unidirectionally as a data input path for receiving data corresponding to write operations and a second subset of data transmission interfaces to operate unidirectionally as a data output path for transmitting data corresponding to read operations;
- receiving, by a high-bandwidth memory (HBM), a first transmission identifying a read operation to be performed and a second transmission identifying a write operation to be performed;
- and performing, by the HBM, the write operation using the first subset of data transmission interfaces and the read operation using the second subset of data transmission interfaces.
Dependencies are inferred from the claim text.