# US 2023/0056044 A1 · Scalable System on a Chip

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0056044 A1
- Document ID: US20230056044A1
- Status: Published application
- Kind: A1
- Application number: 17/821,296
- Filed: 2022-08-22
- Published: 2023-02-23
- Earliest claimed: 2021-08-23
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Per H. Hammarlund; Lior Zimet; James Vash; Gaurav Garg; Sergio Kolor; Harshavardhan Kaushikkar; Ramesh B. Gunna; Steven R. Hutsell
- Web page: https://patentgrep.com/patent/US20230056044A1

## CPC

- G06F 12/0831: using a bus scheme, e.g. with bus monitoring or watching means
- G06F 12/0811: with multilevel cache hierarchies
- G06F 12/0813: with a network or matrix configuration
- G06F 12/0815: Cache consistency protocols
- G06F 12/0824: {Distributed directories, e.g. linked lists of caches}
- G06F 12/109: for multiple virtual address spaces, e.g. segmentation (G06F12/1036 takes precedence)
- G06F 12/128: adapted to multidimensional cache systems, e.g. set-associative, multicache, multiset or multilevel
- G06F 13/161: {with latency improvement}
- G06F 13/1668: {Details of memory controller}
- G06F 13/28: using burst mode transfer, e.g. direct memory access {DMA}, cycle steal (G06F13/32 takes precedence)
- G06F 13/4068: {Electrical coupling}
- G06F 15/17368: {non hierarchical topologies}
- G06F 15/7807: {System on chip, i.e. computer system on a single chip; System in package, i.e. computer system on one or more chips in a single package}
- G06F 12/0833: {in combination with broadcast means (e.g. for invalidation or updating)}
- G06F 2212/1016: Performance improvement
- G06F 2212/1024: Latency reduction
- G06F 2212/1048: Scalability
- G06F 2212/305: being part of a memory device, e.g. cache DRAM
- G06F 2212/455: Image or video data
- G06F 2212/657: Virtual address space management
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

A system including a plurality of processor cores, a plurality of graphics processing units, a plurality of peripheral circuits, and a plurality of memory controllers is configured to support scaling of the system using a unified memory architecture.

## Claims

### Claim 1

A system, comprising:
a plurality of processor cores;
a plurality of graphics processing units;
a plurality of peripheral devices distinct from the processor cores and graphics processing units;
one or more memory controller circuits configured to interface with a system memory; and
an interconnect fabric configured to provide communication between the one or more memory controller circuits and the processor cores, graphics processing units, and peripheral devices;
wherein the processor cores, graphics processing units, peripheral devices and memory controllers are configured to communicate via a unified memory architecture.

### Claim 2 (depends on 1)

The system of claim 1, wherein the processor cores, graphics processing units, and peripheral devices are configured to access any address within a unified address space defined by the unified memory architecture.

### Claim 3 (depends on 2)

The system of claim 2, wherein the unified address space is a virtual address space distinct from a physical address space provided by the system memory.

### Claim 4 (depends on 1)

The system of claim 1, wherein the unified memory architecture provides a common set of semantics for memory access by the processor cores, graphics processing units, and peripheral devices.

### Claim 5 (depends on 4)

The system of claim 4, wherein the semantics include memory ordering properties.

### Claim 6 (depends on 4)

The system of claim 4, wherein the semantics include quality of service attributes.

### Claim 7 (depends on 4)

The system of claim 4, wherein the semantics include cache coherency.

### Claim 8 (depends on 1)

The system of claim 1, wherein the one or more memory controller circuits include respective interfaces to one or more memory devices that are mappable to random access memory.

### Claim 9 (depends on 8)

The system of claim 8, wherein one or more memory devices comprise dynamic random access memory (DRAM).

### Claim 10 (depends on 1)

The system of claim 1, further comprising one or more levels of cache between the processor cores, graphics processing units, peripheral devices, and the system memory.

### Claim 11 (depends on 10)

The system of claim 10, wherein the one or more memory controller circuits include respective memory caches interposed between the interconnect fabric and the system memory, wherein the respective memory caches are one of the one or more levels of cache.

### Claim 12 (depends on 1)

The system of claim 1 further comprising a plurality of directories configured to track a coherency state of subsets of the unified memory address space, wherein the plurality of directories are distributed in the system.

### Claim 13 (depends on 12)

The system of claim 12 wherein the plurality of directories are distributed to the memory controllers.

### Claim 14 (depends on 1)

The system of claim 1 wherein a given memory controller of the one or more memory controller circuits comprises a directory configured to track a plurality of cache blocks that correspond to data in a portion of the system memory to which the given memory controller interfaces, wherein the directory is configured to track which of a plurality of caches in the system are caching a given cache block of the plurality of cache blocks, wherein the directory is precise with respect to memory requests that have been ordered and processed at the directory even in the event that the memory requests have not yet completed in the system.

### Claim 15 (depends on 14)

The system of any claim 14 wherein the given memory controller is configured to issue one or more coherency maintenance commands for the given cache block based on a memory request for the given cache block, wherein the one or more coherency maintenance commands include a cache state for the given cache block in a corresponding cache of the plurality of caches, wherein the corresponding cache is configured to delay processing of a given coherency maintenance command based on the cache state in the corresponding cache not matching the cache state in the a given coherency maintenance command.

### Claim 16 (depends on 14)

The system of any of claim 14 wherein a first cache is configured to store the given cache block in a primary shared state and a second cache is configured to store the given cache block in a secondary shared state, and wherein the given memory controller is configured to cause the first cache transfer the given cache block to a requestor based on the memory request and the primary shared state in the first cache.

### Claim 17 (depends on 14)

The system of claim 14 wherein the given memory controller is configured to issue one of a first coherency maintenance command and a second coherency maintenance command to a first cache of the plurality of caches based on a type of a first memory request, wherein the first cache is configured to forward a first cache block to a requestor that issued the first memory request based on the first coherency maintenance command, and wherein the first cache is configured to return the first cache block to the given memory controller based on the second coherency maintenance command.

### Claim 18

A system on a chip (SOC), comprising:
a plurality of processor cores;
a plurality of graphics processing units;
a plurality of peripheral devices;
one or more memory controller circuits; and
an interconnect fabric configured to provide communication between the one or more memory controller circuits and the processor cores, graphics processing units, and peripheral devices;
wherein the processor cores, graphics processing units, peripheral devices and memory controllers are configured to communicate over the interconnect fabric via a unified memory architecture.

### Claim 19 (depends on 18)

The SOC of claim 18, wherein the processor cores, graphics processing units, and peripheral devices are configured to access any address within a unified address space defined by the unified memory architecture.

### Claim 20 (depends on 18)

The SOC of claim 18, wherein the unified memory architecture provides a common set of semantics for memory access by the processor cores, graphics processing units, and peripheral devices.

### Claim 21 (depends on 20)

The SOC of claim 20, wherein the semantics include memory ordering properties.

### Claim 22 (depends on 20)

The SOC of claim 20, wherein the semantics include quality of service attributes.

### Claim 23 (depends on 20)

The SOC of claim 20, wherein the semantics include memory coherency.

### Claim 24 (depends on 23)

The SOC of claim 23, further comprising a plurality of directories configured to track a coherency state of subsets of the unified memory address space, wherein the plurality of directories are distributed in the SOC.

### Claim 25 (depends on 24)

The SOC of claim 24 wherein the plurality of directories are distributed to the memory controllers.

### Claim 26 (depends on 18)

The SOC of claim 18 wherein a given memory controller of the one or more memory controller circuits comprises a directory configured to track a plurality of cache blocks that correspond to data in a portion of the system memory to which the given memory controller interfaces, wherein the directory is configured to track which of a plurality of caches in the system are caching a given cache block of the plurality of cache blocks, wherein the directory is precise with respect to memory requests that have been ordered and processed at the directory even in the event that the memory requests have not yet completed in the system.

### Claim 27

A method comprising:
communicating, in a system on a chip (SOC), using a unified memory architecture over a communication fabric among a plurality of memory controllers, a plurality of processors, a plurality of peripheral circuits, wherein the unified memory architecture provides a common set of semantics for memory access by the processor cores, graphics processing units, and peripheral devices.

### Claim 28 (depends on 27)

The method of claim 27, wherein the semantics include memory ordering properties.

### Claim 29 (depends on 27)

The method of claim 27, wherein the semantics include quality of service attributes.

### Claim 30 (depends on 27)

The method of claim 27, wherein the semantics include memory coherency.
