# US 2026/0086713 A1 · Circuitry and methods for supporting cached and non-cached atomic operations in a scalable shared-memory system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0086713 A1
- Document ID: US20260086713A1
- Status: Published application
- Kind: A1
- Application number: 18/898,530
- Filed: 2024-09-26
- Published: 2026-03-26
- Earliest claimed: 2024-09-26
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Vincent Cave; Robert Pawlowski; Scott Cline; Joshua Fryman
- Web page: https://patentgrep.com/patent/US20260086713A1

## CPC

- G06F 3/0607: {by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device}
- G06F 9/52: Program synchronisation; Mutual exclusion, e.g. by means of semaphores
- G06F 3/0659: {Command handling arrangements, e.g. command buffers, queues, command scheduling}
- G06F 3/067: {Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]}
- G06F 9/526: {Mutual exclusion algorithms}
- G06F 12/0813: with a network or matrix configuration
- G06F 12/0815: Cache consistency protocols
- G06F 12/0842: for multiprocessing or multitasking
- G06F 12/0857: {by multiple requestors}
- G06F 12/0888: using selective caching, e.g. bypass
- G06F 12/1063: {the data cache being concurrently virtually addressed}
- G06F 12/0811: with multilevel cache hierarchies
- G06F 2212/1008: Correctness of operation, e.g. memory ordering
- G06F 2212/1024: Latency reduction
- G06F 2212/1056: Simplification
- G06F 2212/254: Distributed memory
- G06F 2212/455: Image or video data
- G06F 2212/657: Virtual address space management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Techniques for supporting cached and non-cached atomic operations in a scalable shared-memory system are described. In certain examples, a computing system includes a first compute socket comprising a plurality of first compute tiles that are coupled by a first interconnect and that each comprise a plurality of first tile memories, a respective plurality of first tile memory atomic operations management circuits for the plurality of first tile memories, and a plurality of compute slices that each comprise a first compute circuit, a first cache, a first cache atomic operations management circuit for the first cache, a first memory, and a first memory atomic operations management circuit for the first memory; and a second compute socket, coupled to the first compute socket, comprising a plurality of second compute tiles that are coupled by a second interconnect and that each comprise a plurality of second tile memories, a respective plurality of second tile memory atomic operations management circuits for the plurality of second tile memories, and a plurality of compute slices that each comprise a second compute circuit, a second cache, a second cache atomic operations management circuit for the second cache, a second memory, and a second memory atomic operations management circuit for the second memory, wherein a first cache atomic operations management circuit of a first compute tile of the first compute socket is to, in response to an atomic memory access request for data by a first compute circuit of the first compute tile: read a virtual address of the atomic memory access request, and in response to a field of the virtual address being set to a first value, cause a lock of the data in a first cache of the first compute tile, perform an operation on the data to generate updated data, store the updated data in the first cache, and unlock the data in the first cache in response to the store.

## Claims

### Claim 1

An apparatus comprising:
a first compute socket comprising a plurality of first compute tiles that each comprise a plurality of first tile memories, a respective plurality of first tile memory atomic operations management circuits for the plurality of first tile memories, and a plurality of compute slices that each comprise a first compute circuit, a first cache, a first cache atomic operations management circuit for the first cache, a first memory, and a first memory atomic operations management circuit for the first memory; and
a second compute socket, coupled to the first compute socket, comprising a plurality of second compute tiles that each comprise a plurality of second tile memories, a respective plurality of second tile memory atomic operations management circuits for the plurality of second tile memories, and a plurality of compute slices that each comprise a second compute circuit, a second cache, a second cache atomic operations management circuit for the second cache, a second memory, and a second memory atomic operations management circuit for the second memory,
wherein a first cache atomic operations management circuit of a first compute tile of the first compute socket is to, in response to an atomic memory access request for data by a first compute circuit of the first compute tile:
read a virtual address of the atomic memory access request, and
in response to a field of the virtual address being set to a first value, cause a lock of the data in a first cache of the first compute tile, perform an operation on the data to generate updated data, store the updated data in the first cache, and unlock the data in the first cache in response to the store.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the first value is a plurality of bits that have a same value.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the first compute socket is to, in response to the field of the virtual address being set to a second value, cause the atomic memory access request for the data to bypass the first cache of the first compute socket, bypass the first cache atomic operations management circuit of the first cache, be sent to a second memory atomic operations management circuit for a second memory of the second compute socket, and receive the updated data from the operation on the data from the second memory performed by the second memory atomic operations management circuit.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the second value is a plurality of bits that have a different value.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the first caches, the first memories, and the first tile memories of the first compute socket are within a first memory coherency domain, and the second caches, the second memories, and the second tile memories of the second compute socket are within a second memory coherency domain that is separate from the first memory coherency domain.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the first compute tile comprises a translation lookaside buffer, and the field of the virtual address does not affect a translation of the virtual address to a physical address.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the first compute tile comprises a load-store unit, and the first cache atomic operations management circuit of the first compute tile is to, in response to the field of the virtual address being set to the first value:
send, to the first cache, a lock request and a request identifier of the load-store unit that issued the store of the updated data in the first cache; and
send, to the first cache, an unlock request and the request identifier of the load-store unit that issued the store of the updated data in the first cache after the operation on the data to generate the updated data is performed.

### Claim 8

A method comprising:
generating an atomic memory access request for data by a first compute circuit of a first compute tile of a first compute socket of a system, wherein the system comprises:
the first compute socket comprising a plurality of first compute tiles that each comprise a plurality of first tile memories, a respective plurality of first tile memory atomic operations management circuits for the plurality of first tile memories, and a plurality of compute slices that each comprise a first compute circuit, a first cache, a first cache atomic operations management circuit for the first cache, a first memory, and a first memory atomic operations management circuit for the first memory, and
a second compute socket, coupled to the first compute socket, comprising a plurality of second compute tiles that each comprise a plurality of second tile memories, a respective plurality of second tile memory atomic operations management circuits for the plurality of second tile memories, and a plurality of compute slices that each comprise a second compute circuit, a second cache, a second cache atomic operations management circuit for the second cache, a second memory, and a second memory atomic operations management circuit for the second memory;
reading, by a first cache atomic operations management circuit of the first compute tile of the first compute socket, a virtual address of the atomic memory access request; and
in response to a field of the virtual address being set to a first value, causing a lock of the data in a first cache of the first compute tile by the first cache atomic operations management circuit, performing an operation on the data to generate updated data, storing the updated data in the first cache, and unlocking, by the first cache atomic operations management circuit, the data in the first cache in response to the store.

### Claim 9 (depends on 8)

The method of claim 8, wherein the first value is a plurality of bits that have a same value.

### Claim 10 (depends on 8)

The method of claim 8, further comprising, in response to the field of the virtual address being set to a second value:
causing, by the first compute socket, the atomic memory access request for the data to bypass the first cache of the first compute socket,
causing, by the first compute socket, the atomic memory access request for the data to bypass the first cache atomic operations management circuit of the first cache; and
sending, by the first compute socket, the atomic memory access request for the data to a second memory atomic operations management circuit for a second memory of the second compute socket; and
receiving, by the first cache atomic operations management circuit of the first compute socket, the updated data from the operation on the data from the second memory performed by the second memory atomic operations management circuit of the second compute socket.

### Claim 11 (depends on 10)

The method of claim 10, wherein the second value is a plurality of bits that have a different value.

### Claim 12 (depends on 8)

The method of claim 8, further comprising:
maintaining the first caches, the first memories, and the first tile memories of the first compute socket within a first memory coherency domain; and
maintaining the second caches, the second memories, and the second tile memories of the second compute socket within a second memory coherency domain that is separate from the first memory coherency domain.

### Claim 13 (depends on 8)

The method of claim 8, further comprising performing a translation of the virtual address to a physical address by a translation lookaside buffer of the first compute tile, wherein the field of the virtual address does not affect the translation of the virtual address to the physical address.

### Claim 14 (depends on 8)

The method of claim 8, further comprising, in response to the field of the virtual address being set to the first value:
sending, to the first cache by the first cache atomic operations management circuit of the first compute tile, a lock request and a request identifier of a load-store unit, of the first compute tile, that issued the store of the updated data in the first cache; and
sending, to the first cache by the first cache atomic operations management circuit of the first compute tile, an unlock request and the request identifier of the load-store unit that issued the store of the updated data in the first cache after the operation on the data to generate the updated data is performed.

### Claim 15

A system comprising:
a first compute socket comprising a plurality of first compute tiles that are coupled by a first interconnect and that each comprise a plurality of first tile memories, a respective plurality of first tile memory atomic operations management circuits for the plurality of first tile memories, and a plurality of compute slices that each comprise a first compute circuit, a first cache, a first cache atomic operations management circuit for the first cache, a first memory, and a first memory atomic operations management circuit for the first memory; and
a second compute socket, coupled to the first compute socket, comprising a plurality of second compute tiles that are coupled by a second interconnect and that each comprise a plurality of second tile memories, a respective plurality of second tile memory atomic operations management circuits for the plurality of second tile memories, and a plurality of compute slices that each comprise a second compute circuit, a second cache, a second cache atomic operations management circuit for the second cache, a second memory, and a second memory atomic operations management circuit for the second memory,
wherein a first cache atomic operations management circuit of a first compute tile of the first compute socket is to, in response to an atomic memory access request for data by a first compute circuit of the first compute tile:
read a virtual address of the atomic memory access request, and
in response to a field of the virtual address being set to a first value, cause a lock of the data in a first cache of the first compute tile, perform an operation on the data to generate updated data, store the updated data in the first cache, and unlock the data in the first cache in response to the store.

### Claim 16 (depends on 15)

The system of claim 15, wherein the first compute socket is to, in response to the field of the virtual address being set to a second value, cause the atomic memory access request for the data to bypass the first cache of the first compute socket, bypass the first cache atomic operations management circuit of the first cache, be sent to a second memory atomic operations management circuit for a second memory of the second compute socket, and receive the updated data from the operation on the data from the second memory performed by the second memory atomic operations management circuit.

### Claim 17 (depends on 16)

The system of claim 16, wherein the first value is a plurality of bits that have a same value, and the second value is a plurality of bits that have a different value.

### Claim 18 (depends on 15)

The system of claim 15, wherein the first caches, the first memories, and the first tile memories of the first compute socket are within a first memory coherency domain, and the second caches, the second memories, and the second tile memories of the second compute socket are within a second memory coherency domain that is separate from the first memory coherency domain.

### Claim 19 (depends on 15)

The system of claim 15, wherein the first compute tile comprises a translation lookaside buffer, and the field of the virtual address does not affect a translation of the virtual address to a physical address.

### Claim 20 (depends on 15)

The system of claim 15, wherein the first compute tile comprises a load-store unit, and the first cache atomic operations management circuit of the first compute tile is to, in response to the field of the virtual address being set to the first value:
send, to the first cache, a lock request and a request identifier of the load-store unit that issued the store of the updated data in the first cache; and
send, to the first cache, an unlock request and the request identifier of the load-store unit that issued the store of the updated data in the first cache after the operation on the data to generate the updated data is performed.
