# US 2026/0093630 A1 · Technique for efficiently operating a data processing unit when in a data retention mode

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0093630 A1
- Document ID: US20260093630A1
- Status: Published application
- Kind: A1
- Application number: 18/904,293
- Filed: 2024-10-02
- Published: 2026-04-02
- Earliest claimed: 2024-10-02
- Assignees: Arm Limited
- Applicants: Arm Limited
- Inventors: Yue ZHAO; Rong ZHANG
- Web page: https://patentgrep.com/patent/US20260093630A1

## CPC

- G06F 12/0815: Cache consistency protocols
- G06F 1/3275: {Power saving in memory, e.g. RAM, cache}
- G06F 1/3287: by switching off individual functional units in the computer system
- G06F 12/0831: using a bus scheme, e.g. with bus monitoring or watching means
- G06F 12/084: with a shared cache
- G06F 2212/1028: Power efficiency
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

A processing unit has processing circuitry for performing data processing operations on data accessible in memory, and cache storage to store a subset of the data accessible in the memory, for access by the processing circuitry. Memory control circuitry controls access to a given portion of the memory associated with the processing unit, the given portion of memory comprising at least a shareable memory region to store data that is also accessible by at least one external processing element. Snoop circuitry, responsive to a snoop request identifying a memory address, performs a coherency action in respect of data stored in the cache storage for the identified memory address. Power control circuitry enables the processing unit to be transitioned between a plurality of operating modes, including a data retention mode where the data in the cache storage is retained whilst the processing circuitry and the snoop circuitry are inactive. When transitioning the processing unit into the data retention mode, a given invalidation coherency action is performed in order to invalidate each cache entry storing data associated with a memory address in the shareable memory region. Whilst the processing unit is in the data retention mode, the memory control circuitry allows a write operation instigated by the at least one external processing element, that specifies a given memory address within the shareable memory region, to be performed without waking up the snoop circuitry to process a corresponding snoop request for the given memory address.

## Claims

### Claim 1

A processing unit comprising:
processing circuitry configured to perform data processing operations on data accessible in memory;
cache storage having a plurality of cache entries configured to store a subset of the data accessible in the memory, for access by the processing circuitry;
memory control circuitry configured to control access to a given portion of the memory associated with the processing unit, the given portion of memory comprising at least a shareable memory region to store data that is also accessible by at least one external processing element external to the processing unit;
snoop circuitry, responsive to a snoop request identifying a memory address, to perform a coherency action in respect of data stored in the cache storage for the identified memory address; and
power control circuitry configured to enable the processing unit to be transitioned between a plurality of operating modes, including a data retention mode where the data in the cache storage is retained whilst the processing circuitry and the snoop circuitry are configured to be inactive;
wherein:
the power control circuitry is configured, when transitioning the processing unit into the data retention mode, to cause a given invalidation coherency action to be performed in order to invalidate each cache entry storing data associated with a memory address in the shareable memory region; and
the memory control circuitry is configured, whilst the processing unit is in the data retention mode, to allow a write operation instigated by the at least one external processing element, that specifies a given memory address within the shareable memory region, to be performed without waking up the snoop circuitry to process a corresponding snoop request for the given memory address.

### Claim 2 (depends on 1)

A processing unit as claimed in claim 1, wherein:
the plurality of operating modes further comprises a normal mode where the processing circuitry and the snoop circuitry are configured to be active; and
the memory control circuitry is configured, whilst the processing unit is in the normal mode, to be responsive to the write operation instigated by the at least one external processing element to allow the write operation to be performed but in addition to cause the corresponding snoop request to be issued to the snoop circuitry to cause the coherency action to be performed in the event that data for the given memory address is stored within the cache storage.

### Claim 3 (depends on 1)

A processing unit as claimed in claim 1, wherein the given portion of memory further comprises a non-shareable memory region to store data inaccessible to the at least one external processing element.

### Claim 4 (depends on 1)

A processing unit as claimed in claim 1, wherein the cache storage is configured to treat any cacheable data associated with a memory address in the shareable memory region as write through, and the given invalidation coherency action comprises marking as invalid each cache entry storing data associated with a memory address in the shareable memory region.

### Claim 5 (depends on 1)

A processing unit as claimed in claim 1, further comprising:
register storage associated with the cache storage, the register storage providing a plurality of register entries, wherein each register entry is arranged to store state information for an associated cache entry of the cache storage, and the state information is sufficient to enable identification of the cache entries that have stored therein data associated with a memory address in the shareable memory region; and
the power control circuitry is arranged to cause the given invalidation coherency action to be performed by referencing the state information in the register storage without requiring a lookup in the cache storage to be performed.

### Claim 6 (depends on 5)

A processing unit as claimed in claim 5, wherein performance of the given invalidation coherency action comprises identifying each register entry whose state information indicates that the associated cache entry has stored therein data associated with a memory address in the shareable memory region, and for each identified register entry updating the state information to indicate that the associated cache entry is in an invalid state.

### Claim 7 (depends on 1)

A processing unit as claimed in claim 1, wherein the memory comprises a further portion that is accessible to the processing unit via interconnect circuitry, the further portion comprising a further shareable memory region to store data that is also accessible by the at least one external processing element, and a further non-shareable memory region to store data inaccessible to the at least one external processing element.

### Claim 8 (depends on 5)

A processing unit as claimed in claim 5, wherein:
each register entry is arranged to identify, for the associated cache entry, one of the following states:
a first state indicating that the associated cache entry is invalid;
a second state indicating that the associated cache entry stores data that is clean and in a shareable memory region of the memory;
a third state indicating that the associated cache entry stores data that is clean and in a non-shareable memory region of the memory;
a fourth state indicating that the associated cache entry stores data that is dirty and in the non-shareable memory region of the memory.

### Claim 9 (depends on 7)

A processing unit as claimed in claim 7, wherein the processing unit is arranged to treat any data stored in the further shareable memory region as non-cacheable so that the cache storage is arranged, when caching data from the further portion of the memory, to only cache data from the further non-shareable memory region.

### Claim 10 (depends on 8)

A processing unit as claimed in claim 8, wherein:
the memory comprises a further portion that is accessible to the processing unit via interconnect circuitry, the further portion comprising a further shareable memory region to store data that is also accessible by the at least one external processing element, and a further non-shareable memory region to store data inaccessible to the at least one external processing element;
the processing unit is arranged to treat any data stored in the further shareable memory region as non-cacheable so that the cache storage is arranged, when caching data from the further portion of the memory, to only cache data from the further non-shareable memory region; and
the second state indicates that the associated cache entry stores data that is clean and in the shareable memory region of the given portion of the memory, since the cache storage is not configured to cache data from the further shareable memory region.

### Claim 11 (depends on 1)

A processing unit as claimed in claim 1, wherein:
each cache entry comprises a data entry for storing data and a TAG entry for storing address indicating information used to identify the memory address associated with that data; and
the snoop circuitry is arranged when processing a snoop request identifying a given memory address, to reference at least a subset of the TAG entries to determine whether one of the cache entries stores data for the given memory address, and in that event to perform the coherency action.

### Claim 12 (depends on 11)

A processing unit as claimed in claim 11, wherein the coherency action comprises invalidating said one of the cache entries when the data for the given memory address is being treated as write through.

### Claim 13 (depends on 1)

A processing unit as claimed in claim 1, wherein for a given item of cacheable data in a non-shareable memory region of the memory, the cache storage is configured to identify whether that given item of cacheable data, when stored in the cache storage, is to be treated as write through data or write back data.

### Claim 14 (depends on 1)

A processing unit as claimed in claim 1, wherein the at least one external processing element comprises at least an accelerator device configured to perform tasks on behalf of the processing unit.

### Claim 15 (depends on 1)

A processing unit as claimed in claim 1, wherein:
the memory comprises a further portion that is accessible to the processing unit via interconnect circuitry; and
the given portion is configured to provide the processing unit with lower latency access to data than when accessing data in the further portion.

### Claim 16

A method of operating a processing unit, comprising:
performing, using processing circuitry, data processing operations on data accessible in memory;
storing, within a cache storage having a plurality of cache entries, a subset of the data accessible in the memory, for access by the processing circuitry;
controlling, using memory control circuitry, access to a given portion of the memory associated with the processing unit, the given portion of memory comprising at least a shareable memory region to store data that is also accessible by at least one external processing element external to the processing unit;
responsive to a snoop request identifying a memory address, performing using snoop circuitry a coherency action in respect of data stored in the cache storage for the identified memory address;
transitioning the processing unit between a plurality of operating modes, including a data retention mode where the data in the cache storage is retained whilst the processing circuitry and the snoop circuitry are configured to be inactive;
when transitioning the processing unit into the data retention mode, causing a given invalidation coherency action to be performed in order to invalidate each cache entry storing data associated with a memory address in the shareable memory region; and
whilst the processing unit is in the data retention mode, allowing a write operation instigated by the at least one external processing element, that specifies a given memory address within the shareable memory region, to be performed without waking up the snoop circuitry to process a corresponding snoop request for the given memory address.

### Claim 17 (depends on 1)

A system comprising:
the processing unit of claim 1, implemented in at least one packaged chip;
at least one system component; and
a board,
wherein the at least one packaged chip and the at least one system component are assembled on the board.

### Claim 18 (depends on 17)

A chip-containing product comprising the system of claim 17, wherein the system is assembled on a further board with at least one other product component.

### Claim 19 (depends on 1)

A non-transitory, computer-readable storage medium storing computer-readable code for fabrication of the processing unit of claim 1.
