# US 2025/0156330 A1 · System and method for application agnostic device cache for tiered memory device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0156330 A1
- Document ID: US20250156330A1
- Status: Published application
- Kind: A1
- Application number: 18/757,476
- Filed: 2024-06-27
- Published: 2025-05-15
- Earliest claimed: 2023-11-14
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Ramdas KACHARE; Mohammadreza SOLTANIYEH; Jimmy LAU; Hingkwan HUEN
- Web page: https://patentgrep.com/patent/US20250156330A1

## CPC

- G06F 12/0862: with prefetch
- G06F 11/3037: {where the computing system component is a memory, e.g. virtual memory, cache (accessing, addressing or allocating within memory systems or architectures G06F12/00; checking stores for correct operation G11C29/00)}
- G06F 11/3471: {Address tracing}
- G06F 12/0246: {in block erasable memory, e.g. flash memory}
- G06F 12/0868: Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
- G06F 2212/1016: Performance improvement
- G06F 2212/602: Details relating to cache prefetching
- G06F 2212/6026: Prefetching based on access pattern detection, e.g. stride based prefetch
- G06F 2212/7202: Allocation control and policies
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A tiered memory device is disclosed. The tiered memory device may include a first memory and a second memory. A monitoring circuit may monitor the first memory to generate a heat map and a miss map based at least in part on a request received from a processor. A policy engine may evict a first data from the first memory to the second memory and may prefetch a second data from the second memory to the first memory based at least in part on the heat map and the miss map.

## Claims

### Claim 1

A tiered memory device, comprising:
a first memory;
a second memory;
a monitoring circuit to monitor the first memory to generate a heat map and a miss map based at least in part on a request received from a processor; and
a policy engine to evict a first data from the first memory to the second memory and to prefetch a second data from the second memory to the first memory based at least in part on the heat map and the miss map.

### Claim 2 (depends on 1)

The tiered memory device according to claim 1, wherein:
the tiered memory device exposes an address range to the processor;
the address range is divided into a first region and a second region based at least in part on a region size;
the heat map includes a first heat information for the first region and a second heat for the second region; and
the miss map includes a first miss information for the first region and a second miss for the second region.

### Claim 3 (depends on 1)

The tiered memory device according to claim 1, wherein:
the heat map includes a heat information regarding how often data is accessed by the processor; and
the miss map includes a miss information regarding how often data is requested by the processor but is absent from the first memory.

### Claim 4 (depends on 1)

The tiered memory device according to claim 1, wherein the monitoring circuit is configured to update the heat map and the miss map periodically.

### Claim 5

A method, comprising:
determining, using a monitoring circuit of a tiered memory device, an access count for a first memory of the tiered memory device, the tiered memory device including the first memory and a second memory;
determining, using the monitoring circuit of the tiered memory device, a miss count for the first memory of the tiered memory device;
calculating, using the monitoring circuit of the tiered memory device, a heat information for the first memory of the tiered memory device based at least in part on the access count;
calculating, using the monitoring circuit of the tiered memory device, a miss information for the first memory of the tiered memory device based at least in part on the miss count; and
providing the heat information and the miss information to a policy engine associated with the tiered memory device.

### Claim 6 (depends on 5)

The method according to claim 5, wherein:
calculating, using the monitoring circuit of the tiered memory device, the heat information for the first memory of the tiered memory device based at least in part on the access count includes calculating, using the monitoring circuit of the tiered memory device, the heat information for the first memory of the tiered memory device based at least in part on the access count and an average access rate; and
calculating, using the monitoring circuit of the tiered memory device, the miss information for the first memory of the tiered memory device based at least in part on the miss count includes calculating, using the monitoring circuit of the tiered memory device, the miss information for the first memory of the tiered memory device based at least in part on the miss count and an average miss rate.

### Claim 7 (depends on 6)

The method according to claim 6, wherein:
calculating, using the monitoring circuit of the tiered memory device, the heat information for the first memory of the tiered memory device based at least in part on the access count and an average access rate includes applying a first weight to the access count and a second weight to an average access rate; and
calculating, using the monitoring circuit of the tiered memory device, the miss information for the first memory of the tiered memory device based at least in part on the miss count and an average miss rate includes applying a third weight to the miss count and a fourth weight to an average miss rate.

### Claim 8 (depends on 5)

The method according to claim 5, wherein:
the method further comprises:
determining an address range for the tiered memory device;
exposing the address range for the tiered memory device to a processor; and
identifying a first region and a second region in the address range based at least in part on a region size;
determining, using the monitoring circuit of the tiered memory device, the access count for the first memory of the tiered memory device includes determining, using the monitoring circuit of the tiered memory device, a first access count for the first region in the first memory of the tiered memory device and a second access count for the second region in the first memory of the tiered memory device;
determining, using the monitoring circuit of the tiered memory device, a miss count for the first memory of the tiered memory device includes determining, using the monitoring circuit of the tiered memory device, a first miss count for the first region in the first memory of the tiered memory device and a second miss count for the second region in the first memory of the tiered memory device;
calculating, using the monitoring circuit of the tiered memory device, a heat information for the first memory of the tiered memory device based at least in part on the access count includes:
calculating, using the monitoring circuit of the tiered memory device, a first heat information for the first region in the first memory of the tiered memory device based at least in part on the first access count for the first region in the first memory of the tiered memory device; and
calculating, using the monitoring circuit of the tiered memory device, a second heat information for the second region in the first memory of the tiered memory device based at least in part on the second access count for the second region in the first memory of the tiered memory device; and
calculating, using the monitoring circuit of the tiered memory device, a miss information for the first memory of the tiered memory device based at least in part on the miss count includes:
calculating, using the monitoring circuit of the tiered memory device, a first miss information for the first region in the first memory of the tiered memory device based at least in part on the first miss count for the first region in the first memory of the tiered memory device; and
calculating, using the monitoring circuit of the tiered memory device, a second miss information for the second region in the first memory of the tiered memory device based at least in part on the second miss count for the second region in the first memory of the tiered memory device.

### Claim 9 (depends on 5)

The method according to claim 5, further comprising:
receiving, at a controller of the tiered memory device, an access request from a processor;
incrementing, by the monitoring circuit, the access count based at least in part receiving the access request from the processor; and
incrementing, by the monitoring circuit, the miss count based at least in part on a data requested by the access request being in the first memory of the tiered memory device.

### Claim 10 (depends on 9)

The method according to claim 9, wherein:
receiving, at the controller of the tiered memory device, the access request from a processor includes determining a region identifier for a first region in the first memory of the tiered memory device based at least in part on the access request, the first memory including the first region and a second region;
incrementing, by the monitoring circuit, the access count based at least in part receiving the access request from the processor includes incrementing, by the monitoring circuit, a first access count associated with the region identifier associated with the first region in the first memory of the tiered memory device based at least in part on receiving the access request from the processor; and
incrementing, by the monitoring circuit, the miss count based at least in part on a data requested by the access request being in the first memory includes incrementing, by the monitoring circuit, a first miss count associated with the region identifier associated with the first region in the first memory of the tiered memory device based at least in part on the data requested by the access request being in the first region in first memory of the tiered memory device.

### Claim 11 (depends on 10)

The method according to claim 10, wherein:
the first region includes a first set of addresses exposed to the processor by the tiered memory device;
the second region includes a second set of addresses exposed to the processor by the tiered memory device; and
the first set of addresses is distinct from the second set of addresses.

### Claim 12 (depends on 5)

The method according to claim 5, further comprising resetting the access count and the miss count based at least in part on calculating the heat information for the first memory of the tiered memory device and the miss information for the first memory of the tiered memory device.

### Claim 13 (depends on 5)

The method according to claim 5, wherein:
calculating, using the monitoring circuit of the tiered memory device, the heat information for the first memory of the tiered memory device based at least in part on the access count includes:
calculating an average access rate for the first memory of the tiered memory device based at least in part on the access count; and
calculating the heat information for the first memory of the tiered memory device from the average access rate for the first memory of the tiered memory device; and
calculating, using the monitoring circuit of the tiered memory device, the miss information for the first memory of the tiered memory device based at least in part on the miss count includes:
calculating an average miss rate for the first memory of the tiered memory device based at least in part on the miss count; and
calculating the miss information for the first memory of the tiered memory device from the average miss rate for the first memory of the tiered memory device.

### Claim 14 (depends on 13)

The method according to claim 13, wherein:
calculating the heat information for the first memory of the tiered memory device from the average access rate for the first memory of the tiered memory device includes calculating the heat information for the first memory of the tiered memory device based at least in part on comparing the average access rate for the first memory of the tiered memory device against a first threshold; and
calculating the miss information for the first memory of the tiered memory device from the average miss rate for the first memory of the tiered memory device includes calculating the miss information for the first memory of the tiered memory device based at least in part on comparing the average miss rate for the first memory of the tiered memory device against a second threshold.

### Claim 15 (depends on 5)

The method according to claim 5, further comprising prefetching, by the policy engine, a data from the second memory into the first memory based at least in part on the heat information for the first memory of the tiered memory device.

### Claim 16 (depends on 5)

The method according to claim 5, further comprising determining a prefetch priority for a data from the second memory into the first memory based at least in part on the miss information for the first memory of the tiered memory device.

### Claim 17 (depends on 5)

The method according to claim 5, further comprising evicting, by the policy engine, a data from the first memory to the second memory based at least in part on the miss information for the first memory of the tiered memory device.

### Claim 18 (depends on 5)

The method according to claim 5, further comprising determining an eviction priority for a data from the first memory to the second memory based at least in part on the heat information for the first memory of the tiered memory device.

### Claim 19

An article, comprising a non-transitory storage medium, the non-transitory storage medium having stored thereon instructions that, when executed by a machine, result in:
determining, using a monitoring circuit of a tiered memory device, an access count for a first memory of the tiered memory device, the tiered memory device including the first memory and a second memory;
determining, using the monitoring circuit of the tiered memory device, a miss count for the first memory of the tiered memory device;
calculating, using the monitoring circuit of the tiered memory device, a heat information for the first memory of the tiered memory device based at least in part on the access count;
calculating, using the monitoring circuit of the tiered memory device, a miss information for the first memory of the tiered memory device based at least in part on the miss count; and
providing the heat information and the miss information to a policy engine associated with the tiered memory device.

### Claim 20 (depends on 19)

The article according to claim 19, wherein:
calculating, using the monitoring circuit of the tiered memory device, the heat information for the first memory of the tiered memory device based at least in part on the access count includes calculating, using the monitoring circuit of the tiered memory device, the heat information for the first memory of the tiered memory device based at least in part on the access count and an average access rate; and
calculating, using the monitoring circuit of the tiered memory device, the miss information for the first memory of the tiered memory device based at least in part on the miss count and the second miss information includes calculating, using the monitoring circuit of the tiered memory device, the miss information for the first memory of the tiered memory device based at least in part on the miss count and an average miss rate.
