Interleaved cache prefetching

#Embodiments of the disclosure relate generally to memory sub-systems, and more specifically, relate to memory sub-system prefetching into interleaved caches.

#A memory sub-system can include one or more memory devices that store data. The memory devices can be, for example, non-volatile memory devices and volatile memory devices. In general, a host system can utilize a memory sub-system to store data at the memory devices and to retrieve data from the memory devices.

#The present disclosure will be understood more fully from the detailed description given below and from the accompanying drawings of various embodiments of the disclosure.

#FIG. 1 illustrates an example computing system that includes a memory sub-system in accordance with some embodiments of the present disclosure.

#FIG. 2 is an example system that includes a memory device having a controller for interleaved cache prefetching in accordance with some embodiments of the present disclosure.

#Aspects of the present disclosure are directed to memory sub-system prefetching into interleaved caches, in particular to memory sub-systems that include a prefetching component. A memory sub-system can be a storage system, storage device, a memory module, or a combination of such. An example of a memory sub-system is a storage system such as a solid-state drive (SSD). Examples of storage devices and memory modules are described below in conjunction with FIG. 1, et alibi. In general, a host system can utilize a memory sub-system that includes one or more components, such as memory devices that store data. The host system can provide data to be stored at the memory sub-system and can request data to be retrieved from the memory sub-system.

#Server systems can use a plurality of memory channels interleaved. The interleaving granularity dictates which channel is servicing memory requests issued by a host memory controller. For example, a 64B interleaving granularity means that the bytes addressed from 0 to 63 are serviced by channel 0, 64 to 127 by channel 1, and so on until the last channel number is reached. After the last channel, a return to channel 0 is made. A 128B interleaving granularity would instead allocate addresses 0 to 127 to channel 0, 128 to 255 to channel 1, etc.

#Some memory technologies and interfaces allow the deployment of hybrid memory subsystems. These hybrid memory subsystems may include a cache for quick access to “hot” data and a backing store with slower data access times for “cold” data. Prefetching is a technique that allows for proactively bringing data from a backing store into a cache in anticipation of future accesses that might be requested by the host memory controller. Prefetching can improve system performance and reduce latencies.