# US 2026/0064594 A1 · Handling lookup requests for storage circuitry

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0064594 A1
- Document ID: US20260064594A1
- Status: Published application
- Kind: A1
- Application number: 18/817,421
- Filed: 2024-08-28
- Published: 2026-03-05
- Earliest claimed: 2024-08-28
- Assignees: Arm Limited
- Applicants: Arm Limited
- Inventors: David Michael BULL
- Web page: https://patentgrep.com/patent/US20260064594A1

## CPC

- G06F 12/0802: Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F 12/126: with special data handling, e.g. priority of data or instructions, handling errors or pinning
- G06F 12/0895: of parts of caches, e.g. directory or tag array
- G06F 12/12: Replacement control
- G06F 2212/1016: Performance improvement
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An apparatus comprises control information storage to store a plurality of entries of control information for controlling data processing operations relating to a given memory address; eviction storage to store a plurality of entries that have been evicted from the control information storage; lookup handling circuitry to control handling of a lookup request for data corresponding to a target memory address. When in a parallel mode, the lookup handling circuitry controls the control information storage and the eviction storage to perform the lookup request in parallel; and when in a serial mode, the lookup handling circuitry controls the control information storage to perform the lookup request, and controls the eviction storage to perform the lookup request in response to the lookup request missing in the control information storage. Mode control circuitry controls whether the lookup handling circuitry is to operate in the parallel mode or the serial mode.

## Claims

### Claim 1

An apparatus comprising:
control information storage configured to store a plurality of entries of control information for controlling data processing operations relating to a given memory address;
eviction storage configured to store a plurality of entries that have been evicted from the control information storage;
lookup handling circuitry configured to control handling of a lookup request for data corresponding to a target memory address, wherein:
in a parallel mode, the lookup handling circuitry is configured to control the control information storage and the eviction storage to perform the lookup request in parallel; and
in a serial mode, the lookup handling circuitry is configured to control the control information storage to perform the lookup request, and to control the eviction storage to perform the lookup request in response to the lookup request missing in the control information storage; and
mode control circuitry configured to control whether the lookup handling circuitry is to operate in the parallel mode or the serial mode.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the mode control circuitry is configured to maintain a utilisation metric indicative of a utilisation of the control information storage and the eviction storage and to control whether the lookup handling circuitry is to operate in the parallel mode or the serial mode in dependence on the utilisation metric.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the mode control circuitry is configured to monitor a number of hits in the control information storage and the eviction storage during a predetermined sample period and to set the utilisation metric based on the number of hits.

### Claim 4 (depends on 2)

The apparatus of claim 2, wherein the mode control circuitry comprises tracking circuitry configured to track the utilisation of the control information storage and the eviction storage based on at least one bitmap representative of the plurality of entries in the control information storage and the plurality of entries in the eviction storage.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein
the tracking circuitry is responsive to a hit signal indicative of a given entry in the control information storage or the eviction storage to set a corresponding bit in the bitmap; and
in response to expiry of a predetermined sample period, the mode control circuitry is configured to set the utilisation metric based on the number of set bits in the bitmap.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein, at least in the serial mode, the mode control circuitry is configured to maintain an eviction storage hit rate metric indicative of a fraction of lookup requests in the eviction storage that detect a hit, and to control whether the lookup handling circuitry is to operate in the parallel mode or the serial mode in dependence on the eviction storage hit rate metric.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein
the mode control circuitry comprises a counter, the value of the counter being indicative of the number of hits in the eviction storage; and
the mode control circuitry is configured to reset the counter upon expiry of a predetermined sampling period.

### Claim 8 (depends on 6)

The apparatus of claim 6, wherein the mode control circuitry comprises history storage circuitry configured to store a hit history indicative of entries that have been hit in the eviction storage.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the history storage circuitry is configured to allocate hit data indicative of a given entry in response to a first hit on the given entry during a predetermined sampling period.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the mode control circuitry is configured to control the lookup handling circuitry to switch from the serial mode to the parallel mode in response to an activation metric satisfying an activation condition; and
the mode control circuitry is configured to control the lookup handling circuitry to switch from the parallel mode to the serial mode in response to a deactivation metric satisfying a deactivation condition.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein
the mode control circuitry is configured to determine that the activation condition is satisfied based on a comparison of the activation metric with an activation threshold; and
the mode control circuitry is configured to determine that the deactivation condition is satisfied based on a comparison of the deactivation metric with a deactivation threshold.

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein the mode control circuitry is configured to set the activation condition to be more easily satisfied than the deactivation condition.

### Claim 13 (depends on 1)

The apparatus of claim 1, wherein the mode control circuitry is responsive to an occurrence of a context switch to cause the lookup handling circuitry to operate in the serial mode.

### Claim 14 (depends on 1)

The apparatus of claim 1, wherein the eviction storage is configured to have one or more of:
a larger capacity than the control information storage; and
a different indexing scheme than the control information storage.

### Claim 15 (depends on 1)

The apparatus of claim 1, comprising result combination circuitry configured to, while the lookup handling circuitry is operating in the parallel mode, receive a first lookup result from the control information storage and a second lookup result from the eviction storage, and to generate a final lookup result as a response to the lookup request.

### Claim 16 (depends on 1)

The apparatus of claim 1, wherein the control information storage is any one of:
a memory address translation cache;
a prediction cache.

### Claim 17 (depends on 1)

A system comprising:
the apparatus of claim 1, implemented in at least one packaged chip;
at least one system component;
and a board,
wherein the at least one packaged chip and the at least one system component are assembled on the board.

### Claim 18 (depends on 17)

A chip-containing product comprising the system of claim 17, wherein the system is assembled on a further board with at least one other product component.

### Claim 19

A method comprising:
storing, in control information storage, a plurality of entries of control information for controlling data processing operations relating to a given memory address;
storing, in eviction storage, a plurality of entries that have been evicted from the control information storage;
controlling handling of a lookup request for data corresponding to a target memory address, wherein:
in a parallel mode, controlling the control information storage and the eviction storage to perform the lookup request in parallel; and
in a serial mode, controlling the control information storage to perform the lookup request, and to control the eviction storage to perform the lookup request in response to the lookup request missing in the control information storage; and
controlling whether the lookup handling circuitry is to operate in the parallel mode or the serial mode.

### Claim 20

An apparatus comprising:
a cache configured to store a plurality of entries of data;
an eviction cache to store a plurality of entries that have been evicted from the cache;
lookup handling circuitry configured to control handling of a lookup request for data corresponding to a target memory address, wherein:
in a parallel mode, the lookup handling circuitry is configured to control the cache and the eviction cache to perform the lookup request in parallel; and
in a serial mode, the lookup handling circuitry is configured to control the cache to perform the lookup request, and to control the eviction cache to perform the lookup request in response to the lookup request missing in the cache; and
mode control circuitry configured to control whether the lookup handling circuitry is to operate in the parallel mode or the serial mode.
