Back to results
US 2026/0087339 A1Published application
Apparatus with parallel artificial intelligence computation circuit and methods for operating the same
AssigneeMicron Technology, Inc.
InventorsRohit Sehgal, Nitin N. Okhade, Rohit Sindhu
Life of this patent
Estimating the term…
Abstract
Methods, apparatuses, and systems related to a memory drive configured for Artificial Intelligence (AI) training are described. The memory drive may include Neural Processing Units (NPUs) that preprocess raw data for training an AI model.
Claims20
An apparatus comprising:
- a communication interface configured to (1) receive raw training data from an external Central Processing Unit (CPU) and (2) send preprocessed training data to the external CPU;
- a set of memory cells coupled to the communication interface and configured to store the raw training data and the preprocessed training data, wherein the set of memory cells is arranged according to multiple channels that are configured to separately and independently facilitate internal communications and/or access, wherein each channel includes two or more ranks;
- and
- Neural Processing Units (NPUs) coupled to the set of memory cells and configured to operate on the raw training data stored in the multiple channels to generate the preprocessed training data based on reformatting the raw training data,
- wherein the preprocessed training data is configured to be used by an accelerator module to train an Artificial Intelligence (AI) model, and
- wherein at least one of the NPUs is uniquely assigned to each channel.
3 more elements
A Compute Express Link (CXL) memory drive comprising:
- a CXL interface configured to communicate with an external Central Processing Unit (CPU),
- wherein the communication includes:
- receiving a first raw data;
- receiving a second raw data after the first raw data;
- sending a first preprocessed data associated with the first raw data;
- and
- sending a second preprocessed data associated with the first raw data after sending the first preprocessed data, wherein the first and second preprocessed data are configured for training an Artificial Intelligence (AI) model;
- Dynamic Random Access Memory (DRAM) devices coupled to the communication interface and including a set of memory cells arranged into multiple channels each including at least a first rank and a second rank;
- Multiple Neural Processing Units (NPUs) configured to generate the first and second preprocessed data by reformatting the first and second raw data, respectively, wherein each of the NPUs is uniquely coupled to one of the multiple channels;
- a memory controller coupled to the CXL interface and the DRAM devices, the memory controller configured to:
- write the first raw data to the first rank of the multiple channels;
- concurrently (1) operate the NPUs to generate the first preprocessed data from the first raw data in the first rank of the multiple channels while (2) writing the second raw data to the second rank of the multiple channels;
- after generating the first preprocessed data, operate the NPUs to generate the second preprocessed data from the second raw data in the second rank of the multiple channels while reading the first preprocessed data from the first raw data.
10 more elements
A method of operating a memory drive, the method comprising:
- receiving a first raw data from an external device using a communication interface of the memory drive;
- writing the first raw data into first ranks within multiple channels of memory locations;
- concurrently (1) operating Neural Processing Units (NPUs) that are within the memory drive and coupled to the multiple channels to generate a first preprocessed data by reformatting the first raw data in the first ranks while (2) receiving a second raw data using the communication interface and then (3) writing the second raw data into second ranks within the multiple channels of memory locations;
- after generating the first preprocessed data, concurrently (1) operating the NPUs to generate a second preprocessed data by reformatting the second raw data in the second ranks while (2) reading the first preprocessed data and/or (3) sending the first preprocessed data to the external device using the communication interface;
- and
- after generating the second preprocessed data, sending the second preprocessed data to the external device using the communication interface, wherein the first and second preprocessed data are results of preprocessing raw data in preparation for training an Artificial Intelligence (AI) model.
3 more elements
Dependencies are inferred from the claim text.