# US 2025/0094093 A1 · Optics-Based Distributed Unified Memory System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0094093 A1
- Document ID: US20250094093A1
- Status: Published application
- Kind: A1
- Application number: 18/610,974
- Filed: 2024-03-20
- Published: 2025-03-20
- Earliest claimed: 2023-09-20
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Eran Tamari; Brian S. Leibowitz
- Web page: https://patentgrep.com/patent/US20250094093A1

## CPC

- G06F 3/067: {Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]}
- G06F 3/0604: {Improving or facilitating administration, e.g. storage management}
- G06F 3/0655: {Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Techniques are disclosed relating to computing systems that use silicon photonics. In some embodiments, a computing system includes a plurality of compute die packages that include processors configured to execute program instructions that operate on data stored in a distributed memory accessible via a unified memory architecture. The computing system further includes a plurality of memory die packages configured to implement the unified memory architecture such that a given one of the memory die packages includes one or more optical interfaces configured to receive memory requests from the processors and one or more memory controllers configured to access a portion of the distributed memory in response to the received memory requests.

## Claims

### Claim 1

A computing system, comprising:
a plurality of compute die packages that include processors configured to execute program instructions that operate on data stored in a distributed memory accessible via a unified memory architecture;
a plurality of memory die packages configured to implement the unified memory architecture, wherein a given one of the memory die packages includes:
one or more optical interfaces configured to receive memory requests from the processors; and
one or more memory controllers configured to access a portion of the distributed memory in response to the received memory requests.

### Claim 2 (depends on 1)

The computing system of claim 1, wherein the given memory die package includes:
a cache configured to store a subset of the data stored in the portion of the distributed memory, wherein the given memory die package is configured to service one or more of memory requests from the cache.

### Claim 3 (depends on 1)

The computing system of claim 1, wherein the given memory die package includes:
one or more memories coupled to the one or more memory controllers and corresponding to the portion of distributed memory.

### Claim 4 (depends on 1)

The computing system of claim 1, wherein the given memory die package includes:
a memory controller die including a cache and the one or more memory controllers; and
one or more optical dies coupled to memory controller die via one or more die-to-die interconnects and including the one or more optical interfaces.

### Claim 5 (depends on 1)

The computing system of claim 1, further comprising:
a memory tray including multiple ones of the memory die packages.

### Claim 6 (depends on 5)

The computing system of claim 5, further comprising:
a memory rack, wherein the memory tray is one of a plurality of memory trays inserted into the memory rack.

### Claim 7 (depends on 1)

The computing system of claim 1, wherein the processors include one or more central processing units (CPUs).

### Claim 8 (depends on 7)

The computing system of claim 7, wherein the processors further include one or more graphics processing units (GPUs), application-specific integrated circuit (ASICs), or field-programmable gate arrays (FPGAs).

### Claim 9 (depends on 1)

The computing system of claim 1, wherein a given one of the plurality of compute die packages includes:
a compute die includes one or more processors and a die-to-die interconnect; and
an optical die coupled to the compute die via the die-to-die interconnect and including one or more optical interfaces.

### Claim 10 (depends on 9)

The computing system of claim 9, further comprising:
a compute tray including the plurality of compute die packages.

### Claim 11 (depends on 10)

The computing system of claim 10, further comprising:
a compute rack, wherein the compute tray is one of a plurality of compute trays inserted into the compute rack.

### Claim 12 (depends on 11)

The computing system of claim 11, further comprising:
a plurality of interconnected compute nodes, wherein a given one of the compute nodes includes one or more compute racks coupled to one or more memory racks.

### Claim 13 (depends on 1)

The computing system of claim 1, wherein the processors are configured to access any address within a unified address space defined by the unified memory architecture.

### Claim 14 (depends on 1)

The computing system of claim 1, wherein a given page within a unified address space defined by the unified memory architecture is distributed among multiple ones of memory die packages.

### Claim 15 (depends on 1)

The computing system of claim 1, wherein the compute die packages and the memory die packages are coupled together via an optical interconnect fabric that includes at least two networks having heterogeneous operational characteristics.

### Claim 16

An integrated circuit, comprising:
a memory die package having one or more co-packaged dies, wherein the memory die package includes:
an optical interface configured to receive, via an optical fiber, memory requests from one or more processors;
a memory controller coupled to a memory and configured to service the memory requests; and
a cache of the memory configured to store a portion of data stored in the memory.

### Claim 17 (depends on 16)

The integrated circuit of claim 16, wherein the memory die package is configured to implement a unified memory architecture of a distributed memory accessible to the one or more processors.

### Claim 18 (depends on 17)

The integrated circuit of claim 17, wherein the memory die package is configured to store a given page within a unified address space defined by the unified memory architecture such that the given page is distributed among the memory die package and one or more additional memory die packages.

### Claim 19

An integrated circuit, comprising:
a compute die package having one or more co-packaged dies, wherein the compute die package includes:
one or more processors configured to execute program instructions that operate on data stored in a distributed memory accessible via a unified memory architecture; and
an optical interface configured to send, via an optical fiber, memory requests to one or more memory die packages configured to implement the unified memory architecture.

### Claim 20 (depends on 19)

The integrated circuit of claim 19, wherein the one or more processors include one or more central processing units (CPUs), graphics processing units (GPUs), application-specific integrated circuit (ASICs), or field-programmable gate arrays (FPGAs).
