# US 2021/0342094 A1 · Read Performance of Memory Devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342094 A1
- Document ID: US20210342094A1
- Status: Published application
- Kind: A1
- Application number: 16/863,202
- Filed: 2020-04-30
- Published: 2021-11-04
- Earliest claimed: 2020-04-30
- Assignees: Macronix International Co., Ltd.
- Applicants: Macronix International Co., Ltd.
- Inventors: Ting-Yu Liu; Yi-Chun Liu
- Web page: https://patentgrep.com/patent/US20210342094A1

## CPC

- G06F 3/0616: {in relation to life time, e.g. increasing Mean Time Between Failures [MTBF]}
- G06F 3/0659: {Command handling arrangements, e.g. command buffers, queues, command scheduling}
- G06F 3/0604: {Improving or facilitating administration, e.g. storage management}
- G06F 3/061: {Improving I/O performance}
- G06F 3/0656: {Data buffering arrangements}
- G06F 3/0674: {Disk device}
- G06F 3/0679: {Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]}
- G06F 3/0685: {Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays}
- G06F 12/10: Address translation
- G06F 12/124: {being minimized, e.g. non MRU}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A memory controller managing a memory device receives a memory read command from a host device that is communicably coupled to the memory device. The memory device includes a storage memory comprising a first type of memory cells and a cache memory comprising a second type of memory cells. The memory controller determines, from the memory read command, a physical address of a target memory location in the storage memory indicated by the memory read command. The memory controller executes a read operation on the target memory location corresponding to the physical address. The memory controller determines a read attribute of the target memory location. Conditioned on determining that the read attribute satisfies one or more threshold conditions, the memory controller programs an entry in the cache memory with information corresponding to the target memory location.

## Claims

### Claim 1

A method comprising:
receiving, at a memory controller managing a memory device, a memory read command from a host device that is communicably coupled to the memory device, wherein the memory device includes a storage memory comprising a first type of memory cells and a cache memory comprising a second type of memory cells;
determining, by the memory controller from the memory read command, a physical address of a target memory location in the storage memory indicated by the memory read command;
executing, by the memory controller, a read operation on the target memory location corresponding to the physical address;
determining, by the memory controller, a read attribute of the target memory location; and
conditioned on determining that the read attribute satisfies one or more threshold conditions, programming an entry in the cache memory with information corresponding to the target memory location.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining the physical address of the target memory location comprises determining that the physical address corresponds to a first memory location in the storage memory without an associated memory location in the cache memory, the method further comprising:
executing the read operation on the first memory location in the storage memory;
determining whether an entry corresponding to the first memory location is present in a read tracking data structure, the read tracking data structure including a plurality of entries indicating recent frequently read memory locations in the storage memory, wherein the recent frequently read memory locations correspond to a threshold number of most recently accessed memory locations in the storage memory;
conditioned on determining that the read tracking data structure includes a particular entry corresponding to the first memory location, moving the particular entry to a head of the read tracking data structure; and
conditioned on determining that the read tracking data structure does not include an entry corresponding to the first memory location:
copying data from the first memory location in the storage memory to a second memory location in the cache memory, and
adding a new entry to the read tracking data structure indicating the first memory location in the storage memory.

### Claim 3 (depends on 2)

The method of claim 2, wherein copying the data from the first memory location in the storage memory to the second memory location in the cache memory comprises:
determining that the cache memory is full, and in response to the determining:
identifying a least recently used (LRU) entry in the read tracking data structure,
removing, from the cache memory, data corresponding to the LRU entry, and
removing the LRU entry from the read tracking data structure;
following removing the data corresponding to the LRU entry from the cache memory, copying the data from the first memory location in the storage memory to the second memory location in the cache memory; and
following removing the LRU entry from the read tracking data structure:
adjusting positions of existing entries in the read tracking data structure, and
adding the new entry to the head of the read tracking data structure.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining the physical address of the target memory location comprises determining that the physical address corresponds to a first memory location in the storage memory without an associated memory location in the cache memory, the method further comprising:
executing the read operation on the first memory location in the storage memory;
determining that an entry corresponding to the first memory location is present in a read tracking data structure, the read tracking data structure including a plurality of entries indicating recent frequently read memory locations in the storage memory, wherein the recent frequently read memory locations correspond to a threshold number of most recently accessed memory locations in the storage memory;
in response to determining that the read tracking data structure includes the entry corresponding to the first memory location, determining whether the entry is included in a delta window, wherein the delta window includes a subset of entries in the read tracking data structure that have been accessed using read commands from the host device within a known time interval, the subset of entries including an entry at a head of the read tracking data structure;
conditioned on determining that the entry is included in the delta window:
moving the entry to the head of the read tracking data structure;
determining whether a data mirror flag for the entry is set to a copy value, wherein the copy value for the data mirror flag indicates that data from the first memory location in the storage memory is to be copied to a second memory location in the cache memory;
upon determining that the data mirror flag for the entry is set to the copy value, copying data from the first memory location in the storage memory to a second memory location in the cache memory; and
upon determining that the data mirror flag for the entry is not set to the copy value, setting the data mirror flag for the entry to the copy value; and
conditioned on determining that the entry is not included in the delta window:
moving the entry to the head of the read tracking data structure, wherein the entry is included in the delta window; and
setting the data mirror flag for the entry to the copy value.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining the physical address of the target memory location comprises determining that the physical address corresponds to a first memory location in the storage memory without an associated memory location in the cache memory, the method further comprising:
executing the read operation on the first memory location in the storage memory;
determining that an entry corresponding to the first memory location is present in a read tracking data structure, the read tracking data structure including a plurality of entries indicating recent frequently read memory locations in the storage memory, wherein the recent frequently read memory locations correspond to a threshold number of most recently accessed memory locations in the storage memory;
in response to determining that the read tracking data structure includes the entry corresponding to the first memory location:
moving the entry to a head of the read tracking data structure,
incrementing a read count for the entry, and
determining whether the incremented read count for the entry satisfies a threshold read count value, wherein entries in the read tracking data structure with respective read counts satisfying the threshold read count value correspond to memory locations in the storage memory having data mirrored to memory locations in the cache memory; and
upon determining that the incremented read count for the entry satisfies the threshold read count value, copying data from the first memory location in the storage memory to a second memory location in the cache memory.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining the physical address of the target memory location comprises determining that the physical address corresponds to a first memory location in the storage memory without an associated memory location in the cache memory, the method further comprising:
executing the read operation on the first memory location in the storage memory;
determining that an entry corresponding to the first memory location is present in a read tracking data structure, the read tracking data structure including a plurality of entries indicating recent frequently read memory locations in the storage memory, wherein the recent frequently read memory locations correspond to a threshold number of most recently accessed memory locations in the storage memory;
in response to determining that the read tracking data structure includes the entry corresponding to the first memory location:
incrementing a read count for the entry, and
determining whether the entry is included in a delta window, wherein the delta window includes a subset of entries in the read tracking data structure that have been accessed using read commands from the host device within a known time interval, the subset of entries including an entry at a head of the read tracking data structure;
conditioned on determining that the entry is included in the delta window:
moving the entry to the head of the read tracking data structure, and
determining whether the incremented read count for the entry satisfies a threshold read count value, wherein entries in the read tracking data structure with respective read counts satisfying the threshold read count value correspond to memory locations in the storage memory having data mirrored to memory locations in the cache memory; and
conditioned on determining that the incremented read count for the entry satisfies the threshold read count value:
copying data from the first memory location in the storage memory to a second memory location in the cache memory, and
setting data mirror flag for the entry to indicate that data from the first memory location in the storage memory is copied to the second memory location in the cache memory; and
conditioned on determining that the entry is not included in the delta window:
moving the entry to the head of the read tracking data structure, wherein the entry at the head of the read tracking data structure is included in the delta window.

### Claim 7 (depends on 1)

The method of claim 1, wherein executing the read operation on the target memory location comprises:
obtaining, by the memory controller, data from the target memory location, and
sending, by the memory controller to the host device, the data.

### Claim 8 (depends on 1)

The method of claim 1, wherein the memory read command includes a logical address corresponding to the target memory location, and wherein determining the physical address of the target memory location comprises:
accessing, by the memory controller, an address translation data structure that includes a plurality of entries mapping logical addresses of memory locations sent by the host device to physical addresses of memory locations in the memory device; and
selecting, by the memory controller using the logical address included in the memory read command, an entry from the plurality of entries in the address translation data structure, the entry providing a mapping between the logical address included in the memory read command and the physical address of the target memory location.

### Claim 9 (depends on 8)

The method of claim 8, wherein programming the entry in the cache memory with information corresponding to the target memory location comprises:
modifying the entry in the address translation data structure to include a memory address of a cache memory location corresponding to the programmed entry in the cache memory.

### Claim 10 (depends on 1)

The method of claim 1, wherein determining a read attribute of the target memory location and programming an entry in a cache memory with information corresponding to the target memory location conditioned on determining that the read attribute satisfies one or more threshold conditions comprises:
upon determining that a first read attribute of the target memory location satisfies a first threshold condition, programming an entry in a first-level cache memory with information corresponding to the target memory location; and
upon determining that the first read attribute of the target memory location satisfies the first threshold condition and a second read attribute of the target memory location satisfies a second threshold condition, programming an entry in a second-level cache memory with information corresponding to the target memory location, wherein the second-level cache memory includes a buffer in the host device.

### Claim 11 (depends on 10)

The method of claim 10, wherein the first read attribute includes a parameter indicating a time the target memory location was accessed, and the second read attribute includes one of a read count or an access time interval.

### Claim 12 (depends on 1)

The method of claim 1, wherein the first type of memory cells in the storage memory includes one of a multi-level cell (MLC) memory, a triple-level cell (TLC) memory, or a quad-level cell (QLC) memory, and wherein the second type of memory cells in the cache memory includes a single-level cell (SLC) memory.

### Claim 13

A memory device comprising:
a storage memory including a first type of memory cells;
a cache memory including a second type of memory cells; and
a memory controller to manage access to the storage memory and the cache memory, wherein the memory controller is configured to perform operations comprising:
receiving a memory read command from a host device that is communicably coupled to the memory device;
determining, from the memory read command, a physical address of a target memory location in the storage memory indicated by the memory read command;
executing a read operation on the target memory location corresponding to the physical address;
determining a read attribute of the target memory location; and
conditioned on determining that the read attribute satisfies one or more threshold conditions, programming an entry in the cache memory with information corresponding to the target memory location.

### Claim 14 (depends on 13)

The memory device of claim 13, wherein determining the physical address of the target memory location comprises determining that the physical address corresponds to a first memory location in the storage memory without an associated memory location in the cache memory, the operations further comprising:
executing the read operation on the first memory location in the storage memory;
determining whether an entry corresponding to the first memory location is present in a read tracking data structure, the read tracking data structure including a plurality of entries indicating recent frequently read memory locations in the storage memory, wherein the recent frequently read memory locations correspond to a threshold number of most recently accessed memory locations in the storage memory;
conditioned on determining that the read tracking data structure includes a particular entry corresponding to the first memory location, moving the particular entry to a head of the read tracking data structure; and
conditioned on determining that the read tracking data structure does not include an entry corresponding to the first memory location:
copying data from the first memory location in the storage memory to a second memory location in the cache memory, and
adding a new entry to the read tracking data structure indicating the first memory location in the storage memory.

### Claim 15 (depends on 14)

The memory device of claim 14, wherein copying the data from the first memory location in the storage memory to the second memory location in the cache memory comprises:
determining that the cache memory is full, and in response to the determining:
identifying a least recently used (LRU) entry in the read tracking data structure,
removing, from the cache memory, data corresponding to the LRU entry, and
removing the LRU entry from the read tracking data structure;
following removing the data corresponding to the LRU entry from the cache memory, copying the data from the first memory location in the storage memory to the second memory location in the cache memory; and
following removing the LRU entry from the read tracking data structure:
adjusting positions of existing entries in the read tracking data structure, and
adding the new entry to the head of the read tracking data structure.

### Claim 16 (depends on 13)

The memory device of claim 13, wherein determining the physical address of the target memory location comprises determining that the physical address corresponds to a first memory location in the storage memory without an associated memory location in the cache memory, the operations further comprising:
executing the read operation on the first memory location in the storage memory;
determining that an entry corresponding to the first memory location is present in a read tracking data structure, the read tracking data structure including a plurality of entries indicating recent frequently read memory locations in the storage memory, wherein the recent frequently read memory locations correspond to a threshold number of most recently accessed memory locations in the storage memory;
in response to determining that the read tracking data structure includes the entry corresponding to the first memory location, determining whether the entry is included in a delta window, wherein the delta window includes a subset of entries in the read tracking data structure that have been accessed using read commands from the host device within a known time interval, the subset of entries including an entry at a head of the read tracking data structure;
conditioned on determining that the entry is included in the delta window:
moving the entry to the head of the read tracking data structure;
determining whether a data mirror flag for the entry is set to a copy value, wherein the copy value for the data mirror flag indicates that data from the first memory location in the storage memory is to be copied to a second memory location in the cache memory;
upon determining that the data mirror flag for the entry is set to the copy value, copying data from the first memory location in the storage memory to a second memory location in the cache memory; and
upon determining that the data mirror flag for the entry is not set to the copy value, setting the data mirror flag for the entry to the copy value; and
conditioned on determining that the entry is not included in the delta window:
moving the entry to the head of the read tracking data structure, wherein the entry is included in the delta window; and
setting the data mirror flag for the entry to the copy value.

### Claim 17 (depends on 13)

The memory device of claim 13, wherein determining the physical address of the target memory location comprises determining that the physical address corresponds to a first memory location in the storage memory without an associated memory location in the cache memory, the operations further comprising:
executing the read operation on the first memory location in the storage memory;
determining that an entry corresponding to the first memory location is present in a read tracking data structure, the read tracking data structure including a plurality of entries indicating recent frequently read memory locations in the storage memory, wherein the recent frequently read memory locations correspond to a threshold number of most recently accessed memory locations in the storage memory;
in response to determining that the read tracking data structure includes the entry corresponding to the first memory location:
moving the entry to a head of the read tracking data structure,
incrementing a read count for the entry, and
determining whether the incremented read count for the entry satisfies a threshold read count value, wherein entries in the read tracking data structure with respective read counts satisfying the threshold read count value correspond to memory locations in the storage memory having data mirrored to memory locations in the cache memory; and
upon determining that the incremented read count for the entry satisfies the threshold read count value, copying data from the first memory location in the storage memory to a second memory location in the cache memory.

### Claim 18 (depends on 13)

The memory device of claim 13, wherein determining the physical address of the target memory location comprises determining that the physical address corresponds to a first memory location in the storage memory without an associated memory location in the cache memory, the operations further comprising:
executing the read operation on the first memory location in the storage memory;
determining that an entry corresponding to the first memory location is present in a read tracking data structure, the read tracking data structure including a plurality of entries indicating recent frequently read memory locations in the storage memory, wherein the recent frequently read memory locations correspond to a threshold number of most recently accessed memory locations in the storage memory;
in response to determining that the read tracking data structure includes the entry corresponding to the first memory location:
incrementing a read count for the entry, and
determining whether the entry is included in a delta window, wherein the delta window includes a subset of entries in the read tracking data structure that have been accessed using read commands from the host device within a known time interval, the subset of entries including an entry at a head of the read tracking data structure;
conditioned on determining that the entry is included in the delta window:
moving the entry to the head of the read tracking data structure,
determining whether the incremented read count for the entry satisfies a threshold read count value, wherein entries in the read tracking data structure with respective read counts satisfying the threshold read count value correspond to memory locations in the storage memory having data mirrored to memory locations in the cache memory; and
conditioned on determining that the incremented read count for the entry satisfies the threshold read count value:
copying data from the first memory location in the storage memory to a second memory location in the cache memory, and
setting data mirror flag for the entry to indicate that data from the first memory location in the storage memory is copied to the second memory location in the cache memory; and
conditioned on determining that the entry is not included in the delta window:
moving the entry to the head of the read tracking data structure, wherein the entry at the head of the read tracking data structure is included in the delta window.

### Claim 19 (depends on 13)

The memory device of claim 13, wherein the memory read command includes a logical address corresponding to the target memory location, and wherein determining the physical address of the target memory location comprises:
accessing, by the memory controller, an address translation data structure that includes a plurality of entries mapping logical addresses of memory locations sent by the host device to physical addresses of memory locations in the memory device; and
selecting, by the memory controller using the logical address included in the memory read command, an entry from the plurality of entries in the address translation data structure, the entry providing a mapping between the logical address included in the memory read command and the physical address of the target memory location.

### Claim 20 (depends on 19)

The memory device of claim 19, wherein programming the entry in the cache memory with information corresponding to the target memory location comprises:
modifying the entry in the address translation data structure to include a memory address of a cache memory location corresponding to the programmed entry in the cache memory.

### Claim 21 (depends on 13)

The memory device of claim 13, wherein determining a read attribute of the target memory location and programming an entry in a cache memory with information corresponding to the target memory location conditioned on determining that the read attribute satisfies one or more threshold conditions comprises:
upon determining that a first read attribute of the target memory location satisfies a first threshold condition, programming an entry in a first-level cache memory with information corresponding to the target memory location; and
upon determining that the first read attribute of the target memory location satisfies the first threshold condition and a second read attribute of the target memory location satisfies a second threshold condition, programming an entry in a second-level cache memory with information corresponding to the target memory location, wherein the second-level cache memory includes a buffer in the host device.

### Claim 22 (depends on 21)

The memory device of claim 21, wherein the first read attribute includes a parameter indicating a time the target memory location was accessed, and the second read attribute includes one of a read count or an access time interval.

### Claim 23 (depends on 13)

The memory device of claim 13, wherein the first type of memory cells in the storage memory includes one of a multi-level cell (MLC) memory, a triple-level cell (TLC) memory, or a quad-level cell (QLC) memory, and wherein the second type of memory cells in the cache memory includes a single-level cell (SLC) memory.

### Claim 24

A memory controller for managing a memory device, the memory controller comprising:
one or more processors; and
one or more machine-readable media storing instructions that, when executed, cause the one or more processors to perform operations comprising:
receiving a memory read command from a host device that is communicably coupled to the memory device, wherein the memory device includes a storage memory comprising a first type of memory cells and a cache memory comprising a second type of memory cells;
determining, from the memory read command, a physical address of a target memory location in the storage memory indicated by the memory read command;
executing a read operation on the target memory location corresponding to the physical address;
determining a read attribute of the target memory location; and
conditioned on determining that the read attribute satisfies one or more threshold conditions, programming an entry in the cache memory with information corresponding to the target memory location.
