Read operations using memory sub-system controller memory buffer during artificial intelligence inference
AssigneeMicron Technology, Inc.
InventorsLuca Bert, Suresh Rajgopal
Life of this patent
Estimating the term…
Abstract
A processing device in a memory sub-system receives, from a host system, a memory access request for a chunk of data stored at a non-volatile memory device of a memory sub-system. The processing device retrieves a block of data comprising the chunk from the non-volatile memory device and storing the block of data in a controller memory buffer, wherein the memory sub-system comprises a volatile memory device with a first portion configured as the controller memory buffer, and provides the chunk of data from the controller memory buffer to the host system.
Claims20
A system comprising:
- a non-volatile memory device;
- a volatile memory device comprising a first portion configured as a controller memory buffer;
- and
- a processing device, operatively coupled with the non-volatile memory device and the volatile memory device, to perform operations comprising:
- receiving, from a host system, a memory access request for a chunk of data stored at the non-volatile memory device;
- retrieving a block of data comprising the chunk from the non-volatile memory device and storing the block of data in the controller memory buffer;
- and
- providing the chunk of data from the controller memory buffer to the host system.
A method comprising:
- receiving, from a host system, a memory access request for a chunk of data stored at a non-volatile memory device of a memory sub-system;
- retrieving a block of data comprising the chunk from the non-volatile memory device and storing the block of data in a controller memory buffer, wherein the memory sub-system comprises a volatile memory device with a first portion configured as the controller memory buffer;
- and
- providing the chunk of data from the controller memory buffer to the host system.
A non-transitory computer-readable storage medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:
- receiving, from a host system, a memory access request for a chunk of data stored at a non-volatile memory device of a memory sub-system;
- retrieving a block of data comprising the chunk from the non-volatile memory device and storing the block of data in a controller memory buffer, wherein the memory sub-system comprises a volatile memory device with a first portion configured as the controller memory buffer;
- and
- providing the chunk of data from the controller memory buffer to the host system.
Dependencies are inferred from the claim text.