US 2026/0186973 A1 · INCREASED FILE LOADS USING FILE BASED OPTIMIZATION AND PREFETCH WITHIN A MEMORY SYSTEM

Abstract

Methods, systems, and devices for increased file loads using file based optimization (FBO) and prefetch within a memory system are described. A system may support using a prefetch command to prioritize prefetching for artificial intelligence (AI) related data (or other high priority data). A host system may transmit a prefetch command for the AI-related data before performing one or more AI operations that use the data. In response, the memory system may prefetch the AI-related data and store the data in a cache. The storage of the AI-related data in the cache may be prioritized over other data types associated with lower priorities. The host system may transmit an FBO command to defragment the AI-related data in the memory system prior to the prefetch, which may reduce latency of the prefetch.

Claims22

Dependent claims

A memory system, comprising:

one or more memory devices;
and
processing circuitry coupled with the one or more memory devices and configured to cause the memory system to:
receive a prefetch command to prefetch first data stored in the memory system, wherein the prefetch command indicates an address range associated with the first data and a first priority of the first data;
prefetch, in accordance with one or more prefetch parameters, the first data from one or more memory arrays within the memory system to a cache of the memory system, wherein the one or more prefetch parameters are in accordance with the first priority of the first data;
receive a first read command for the first data, wherein the first read command indicates the address range associated with the first data and the first priority of the first data;
and
read, in response to the first read command, the first data from the cache of the memory system.

5 more elements

A non-transitory computer-readable medium storing code comprising instructions which, when executed by one or more processors of a memory system, cause the memory system to:

receive a prefetch command to prefetch first data stored in a memory system, wherein the prefetch command indicates an address range associated with the first data and a first priority of the first data;
prefetch, in accordance with one or more prefetch parameters, the first data from one or more memory arrays within the memory system to a cache of the memory system, wherein the one or more prefetch parameters are in accordance with the first priority of the first data;
receive a first read command for the first data, wherein the first read command indicates the address range associated with the first data and the first priority of the first data;
and
read, in response to the first read command, the first data from the cache of the memory system.

2 more elements

A method, comprising:

receiving a prefetch command to prefetch first data stored in a memory system, wherein the prefetch command indicates an address range associated with the first data and a first priority of the first data;
prefetching, in accordance with one or more prefetch parameters, the first data from one or more memory arrays within the memory system to a cache of the memory system, wherein the one or more prefetch parameters are in accordance with the first priority of the first data;
receiving a first read command for the first data, wherein the first read command indicates the address range associated with the first data and the first priority of the first data;
and
reading, in response to the first read command, the first data from the cache of the memory system.

2 more elements

Dependencies are inferred from the claim text.

Increased file loads using file based optimization and prefetch within a memory system

Life of this patent

Increased file loads using file based optimization and prefetch within a memory system

Life of this patent

Abstract

Claims22