# US 2026/0086948 A1 · Unloaded cache bypass

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0086948 A1
- Document ID: US20260086948A1
- Status: Published application
- Kind: A1
- Application number: 19/341,124
- Filed: 2025-09-26
- Published: 2026-03-26
- Earliest claimed: 2022-06-28
- Assignees: Micron Technology, Inc.
- Applicants: Micron Technology, Inc.
- Inventors: Emanuele Confalonieri
- Web page: https://patentgrep.com/patent/US20260086948A1

## CPC

- G06F 12/0888: using selective caching, e.g. bypass
- G06F 12/0895: of parts of caches, e.g. directory or tag array
- G06F 2212/60: Details of cache memory
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems, apparatuses, and methods related to a memory controller for unloaded cache bypass are described. An example memory controller can be coupled to a memory device. The example memory controller can include a cache. The cache can include a cache sequence controller configured to determine a quantity of a pending cache look-up operations, determine the quantity satisfies an unloaded bypass threshold, and cause performance of a bypass memory operation that bypasses the cache and accesses the memory device.

## Claims

### Claim 1

A system, comprising:
a memory device; and
a memory controller coupled to the memory device and comprising:
a cache including a metric logic configured to track a quantity of pending cache look-up operations in a queue of the cache; and
a cache sequence controller coupled to the cache and configured to:
compare the quantity of pending cache look-up operations to a threshold quantity responsive to receiving a read request from a host, wherein the threshold is varied based on a cache hit rate of cache look-up operations; and
cause performance of a bypass read operation that bypasses the cache and accesses the memory device responsive to determining the quantity is less than or equal to the threshold.

### Claim 2 (depends on 1)

The system of claim 1, wherein:
the threshold is decreased based on the cache hit rate being above a target hit rate; and
the threshold is increased based on the cache hit rate being below a target hit rate.

### Claim 3 (depends on 1)

The system of claim 1, wherein the memory controller is configured to cause performance of a cache look-up operation associated with the cache substantially contemporaneously with the performance of the bypass read operation.

### Claim 4 (depends on 3)

The system of claim 3, wherein performance of the cache look-up operation results in a cache hit, and wherein the memory controller is configured to discard data read from the memory device in association with the bypass read operation.

### Claim 5 (depends on 3)

The system of claim 3, wherein performance of the cache look-up operation results in a cache miss.

### Claim 6 (depends on 5)

The system of claim 5, wherein the cache miss is a clean cache miss, and wherein the cache sequence controller is further to cache-in data read from the memory device in association with the bypass read operation.

### Claim 7 (depends on 5)

The system of claim 5, wherein the cache miss is a dirty cache miss, and wherein:
the cache sequence controller is configured to cache-in data read from the memory device in association with the bypass read operation; and
the memory controller is configured to cause performance of a cache write-back operation to write data from the cache to the memory device.

### Claim 8 (depends on 1)

The system of claim 1, wherein the metric logic including counters, and wherein the counters comprise a cache hit counter, write hit counter, or a combination thereof.

### Claim 9 (depends on 1)

The system of claim 1, wherein the cache further comprises a cache memory and a cache controller.

### Claim 10 (depends on 1)

The system of claim 1, wherein the cache sequence controller is configured to cause performance of a cache look-up operation responsive to determining the quantity exceeds the threshold.

### Claim 11 (depends on 10)

The system of claim 10, wherein the cache sequence controller is configured to continue causing performance of cache look-up operations responsive to receiving subsequent read requests from the host until the quantity of pending cache look-up operations is less than an exit threshold.

### Claim 12

A method, comprising:
determining, by a memory controller coupled to a memory device, a quantity of pending cache look-up operations in a queue associated with a cache responsive to receiving a host access request;
determining the quantity of pending cache look-up operations is less than or equal to a threshold that is variable based on a cache hit rate of cache look-up operations; and
responsive to determining the quantity of pending cache look-up operations is less than or equal to the threshold:
causing performance of a bypass read operation that bypasses the cache and accesses the memory device; and
causing performance of a cache look-up operation substantially contemporaneously with the performance of the bypass read operation.

### Claim 13 (depends on 12)

The method of claim 12, wherein data associated with the performance of the bypass read operation is selectively utilized based on a type of result of the cache look-up operation.

### Claim 14 (depends on 12)

The method of claim 12, wherein the threshold is equal to a non-zero quantity of pending cache look-up operations.

### Claim 15 (depends on 12)

The method of claim 12, wherein the threshold is equal to zero pending cache look-up operations.

### Claim 16

An apparatus, comprising:
a memory device; and
a memory controller coupled to the memory device and comprising:
a cache including a metric logic configured to track a quantity of pending cache look-up operations in a queue of the cache; and
a cache sequence controller coupled to the cache and configured to:
responsive to receiving a host read request:
determine that the quantity of pending cache look-up operations satisfies a variable unloaded bypass threshold, wherein the variable unloaded bypass threshold is varied based on a cache hit rate of cache look-up operations;
cause performance of a cache look-up operation; and
in parallel with performance of the cache look-up operation, cause initiation of a bypass read operation that bypasses the cache and accesses the memory device to read data corresponding to the host read request from the memory device.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the cache is configured to operate in accordance with a First-in First-out (FIFO) cache replacement policy.

### Claim 18 (depends on 16)

The apparatus of claim 16, wherein the cache sequence controller is to cause performance of a plurality of bypass read operations when the quantity of the pending cache look-up operations in the queue is less than or equal to the variable unloaded bypass threshold.

### Claim 19 (depends on 16)

The apparatus of claim 16, further comprising an exit threshold that is less than the variable unloaded bypass threshold, wherein the cache sequence controller is to abstain from performance of any bypass read operation until the quantity of the pending look-up operations is less than the exit threshold.

### Claim 20 (depends on 16)

The apparatus of claim 16, wherein:
the variable unloaded bypass threshold is decreased based on the cache hit rate being above a target hit rate; and
the variable unloaded bypass threshold is increased based on the cache hit rate being below a target hit rate.
