# US 2022/0045757 A1 · Coherent photonic computing architectures

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0045757 A1
- Document ID: US20220045757A1
- Status: Published application
- Kind: A1
- Application number: 17/395,849
- Filed: 2021-08-06
- Published: 2022-02-10
- Earliest claimed: 2020-08-06
- Assignees: Celestial AI Inc.
- Applicants: Celestial AI Inc.
- Inventors: Nikolaos Pleros; David Lazovsky; George Giamougiannis; Apostolos Tsakyridis; Angelina Totovic
- Web page: https://patentgrep.com/patent/US20220045757A1

## CPC

- H04B 10/27: Arrangements for networking
- G02F 1/225: in an optical waveguide structure
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/063: using electronic means
- G06N 3/067: using optical means
- G06N 3/0675: {using electro-optical, acousto-optical or opto-electronic means}
- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- H04B 10/07: Arrangements for monitoring or testing transmission systems; Arrangements for fault measurement of transmission systems
- H04Q 11/0005: {Switch and router aspects}
- G06N 3/048: Activation functions
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 10/40: Physical realisations or architectures of quantum processors or components for manipulating qubits, e.g. qubit coupling or qubit control
- H04B: TRANSMISSION
- G02F: OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04Q: SELECTING (switches, relays, selectors H01H; wireless communication networks H04W)

## Abstract

Disclosed are coherent photonic circuit architectures that optically implement linear algebraic computations. In neuromorphic applications of such photonic circuit architectures, individual neural network layers can be implemented by coherent optical linear neurons in a crossbar configuration, integrated with electronic circuitry at the interfaces between neural network layers to determine the neuron inputs to one layer based on the neuron outputs of the preceding layer. Wavelength division multiplexing can be used to efficiently implement certain specific network models, optionally in conjunction with electro-optic switches to render a generic hardware configuration programmable.

## Claims

### Claim 1

A system comprising a photonic circuit that includes:
an optical splitter configured to split carrier light into a plurality of optical carrier signals;
a plurality of input cells comprising first optical amplitude modulators configured to impart a plurality of computational inputs onto the plurality of optical carrier signals to thereby create first modulated optical signals;
a plurality of sets of weighting cells, the weighting cells in each set being coupled at their inputs to outputs of the plurality of input cells and comprising a plurality of second optical amplitude modulators configured to impart a plurality of computational weights onto the first modulated optical signals received from the input cells to thereby create second modulated optical signals associated with the set; and
a plurality of optical combiners each associated with one of the sets of weighting cells and configured to coherently combine the second modulated optical signals associated with the set into an optical output signal.

### Claim 2 (depends on 1)

The system of claim 1, wherein the weighting cells of the plurality of sets are arranged in an array comprising a plurality of rows and a plurality of columns, each column of weighting cells corresponding to one of the sets of weighting cells, and each row of weighting cells being associated with and coupled to one of the input cells.

### Claim 3 (depends on 2)

The system of claim 2, wherein the photonic circuit further includes a plurality of optical input waveguides, each optical input waveguide being associated with one of the input cells and configured to guide the first modulated optical signal created in the input cell along the associated row of weighting cells, wherein optical taps placed along each of the optical input waveguides at inputs of the associated weighting cells couple the first modulated optical signal sequentially from the optical input waveguide into the associated weighting cells.

### Claim 4 (depends on 3)

The system of claim 3, wherein the optical taps along each of the optical input waveguides are configured to couple, to the associated weighting cells, fractions of an optical power guided in the optical input waveguide that increase in a direction of propagation of the first modulated optical signal, such that the first modulated optical signals coupled into the weighting cells are substantially equal in power along the optical input waveguide.

### Claim 5 (depends on 2)

The system of claim 2, wherein each of the optical combiners comprises an optical output waveguide and a plurality of optical couplers placed along the optical output waveguide and configured to sequentially couple the second modulated optical signals from the associated set of weighting cells into the optical output waveguide.

### Claim 6 (depends on 1)

The system of claim 1, wherein the optical splitter and the optical combiners are collectively configured to cause the second modulated optical signals associated with each set of weighting cells to be combined into the corresponding optical output signals in equal proportions.

### Claim 7 (depends on 1)

The system of claim 1, wherein the optical splitter comprises a cascade of bifurcating splitters that couple the carrier light sequentially to inputs of the plurality of input cells.

### Claim 8 (depends on 1)

The system of claim 1, wherein the photonic circuit further includes a plurality of optical delay lines imparting optical delays on the second modulated optical signals to balance optical path lengths between the input cells and an optical output of each of the optical combiners.

### Claim 9 (depends on 1)

The system of claim 1, wherein at least one of the first optical amplitude modulators or the second optical amplitude modulators comprise electro-absorption modulators or multi-quantum-confined Stark effect (QCSE) electro-absorption modulators.

### Claim 10 (depends on 1)

The system of claim 1, wherein the second optical amplitude modulators comprise optical phase change cells.

### Claim 11 (depends on 1)

They system of claim 1, wherein the weighting cells in each set further comprise a plurality of phase shifters associated with the plurality of second amplitude modulators, configurable to impart signs of the computational weights onto the first modulated optical signals.

### Claim 12 (depends on 11)

The system of claim 11, wherein the phase shifters comprise at least one of a thermal phase shifter, an electro-optic phase shifter, or a phase-change-material-based phase shifter.

### Claim 13 (depends on 1)

The system of claim 1, wherein the photonic circuit further includes a plurality of photodetectors placed at optical outputs of the plurality of optical combiners to measure the optical output signals.

### Claim 14 (depends on 13)

The system of claim 13, further comprising:
electronic circuitry configured to control drivers associated with the plurality of first optical amplitude modulators, the plurality of second optical amplitude modulators, and the plurality of phase shifters, the electronic circuitry comprising memory storing the computational weights associated with the plurality of weighting cells.

### Claim 15 (depends on 14)

The system of claim 14, wherein the optical splitter, the plurality of input cells, the plurality of sets of weighting cells, the plurality of optical combiners, and the plurality of photodetectors implement a first neural network layer, the photonic circuit further comprising an additional optical splitter, an additional plurality of input cells, an additional plurality of sets of weighting cells, an additional plurality of optical combiners, and an additional plurality of photodetectors implementing a second neural network layer, the electronic circuitry being configured to control drivers associated with additional first optical amplitude modulators in the additional input cells of the second layer based on outputs of the plurality of photodetectors of the first layer.

### Claim 16 (depends on 14)

The system of claim 14, wherein the electronic circuitry is configured to:
cause a first set of computational weights associated with a first neural network layer to be applied by the plurality of sets of weighting cells;
as the first set of computational weights is applied, causing a first set of computational inputs to be applied by the first optical amplitude modulators and reading out the photodetectors measuring the optical output signals to obtain a first set of computational outputs associated with the first layer;
causing a second set of computational weights associated with a second neural network layer to be applied by the weighting cells; and
as the second set of computational weights is applied, causing a second set of computational inputs based on the first set of computational outputs to be applied by the first optical amplitude modulators and reading out the photodetectors measuring the optical output signals to obtain a second set of computational outputs associated with the second layer.

### Claim 17 (depends on 1)

The system of claim 1, wherein:
each of the input cells is associated with a respective one of the computational inputs and configured to impart that computational input, with one of the first optical amplitude modulators, on one of the optical carrier signals to create one of the first modulated optical signals; and
each of the optical combiners and its associated optical output signal are associated with a respective one of a plurality of computational outputs; and
each of the weighting cells is associated with a respective pair of one of the computational inputs and one of the computational outputs, and configured to impart, using one of the second amplitude modulators, one of the computational weights on the first modulated optical signals associated with that computational input to create one of the second modulated optical signals.

### Claim 18 (depends on 1)

The system of claim 1, wherein the carrier light is multiplexed light, the optical carrier signals are multiplexed optical carrier signals, and the optical output signals are multiplexed optical output signals.

### Claim 19 (depends on 18)

The system of claim 18, wherein the input cells each comprise a set of multiple first optical amplitude modulators associated with multiple wavelengths of the multiplexed optical carrier signals, preceded by a demultiplexer and followed by a multiplexer, the multiple first optical amplitude modulators in each input cell configured to create multiple respective first modulated optical signals by imparting multiple computational inputs onto the multiple wavelengths of the multiplexed optical carrier signals.

### Claim 20 (depends on 18)

The system of claim 18, wherein the weighting cells each comprise a set of multiple second optical amplitude modulators and/or phase shifters associated with multiple wavelengths of the multiplexed optical carrier signals, preceded by a demultiplexer and followed by a multiplexer, the multiple second optical amplitude modulators and/or phase shifters configured to create multiple respective second modulated optical signals by imparting multiple computational weights onto one or more first modulated optical signals.

### Claim 21 (depends on 18)

The system of claim 18, further comprising electro-optic switches preceding and following each of the input cells and each of the weighting cells, the electro-optic switches configurable to direct the multiplexed optical input signals along first or second input optical paths through the input cells and along first or second weighting optical paths through the weighting cells, wherein:
each of the input cells comprises a set of first optical amplitude modulators associated with multiple wavelengths of the multiplexed optical carrier signals and preceded by a demultiplexer and followed by a multiplexer along the first input optical path, and a separate first optical amplitude modulator along the second input optical path; and
each of the weighting cells comprises a set of second optical amplitude modulators and/or phase shifters associated with multiple wavelengths of the multiplexed optical carrier signals and preceded by a demultiplexer and followed by a multiplexer along the first weighting optical path, and a separate second optical amplitude modulator and/or phase shifter along the second weighting optical path.

### Claim 22 (depends on 21)

The system of claim 21, wherein the electro-optic switches are programmable for a plurality of configurations implementing a plurality of associated artificial neural network types, the plurality of configurations comprising:
a convolutional neural network configuration in which the multiplexed optical carrier signals are directed along the first input optical paths and the second weighting optical paths;
a fully connected neural network configuration in which the multiplexed optical carrier signals are directed along the second input optical paths and the first weighting optical paths; and
a neural network configuration in which the multiplexed optical input signals are directed along the first input optical paths and the first weighting optical paths.

### Claim 23

A photonic circuit comprising:
an optical splitter configured to split multiplexed light into a plurality of multiplexed optical carrier signals associated with a plurality of inputs;
a plurality of interferometric optical paths configured to receive the plurality of multiplexed optical carrier signals and generate multiplexed weighted optical input signals; and
an optical combiner configured to combine the multiplexed weighted optical input signals into a multiplexed optical output signal,
wherein each of the interferometric optical paths comprises:
a first electro-optical switch, a second electro-optical switch, and a third electro-optical switch, the first and second electro-optical switches configurable to switch the multiplexed optical carrier signal between first and second input optical paths and the second and third electro-optical switches configurable to switch multiplexed optical input signal between first and second weighting optical paths;
between the first and second electro-optical switches, an input cell comprising a set of first optical amplitude modulators associated with multiple wavelengths of the multiplexed optical carrier signals and preceded by a demultiplexer and followed by a multiplexer along the first input optical path, and a separate first optical amplitude modulator along the second input optical path, the input cell configured to generate the multiplexed optical input signal; and
between the second and third electro-optical switches, a weighting cell comprising a set of second optical amplitude modulators and phase shifters associated with multiple wavelengths of the multiplexed optical carrier signals and preceded by a demultiplexer and followed by a multiplexer along the first weighting optical path, and a separate second optical amplitude modulator and phase shifter along the second weighting optical path, the weighting cell configured to generate the multiplexed weighted optical input signal.

### Claim 24 (depends on 23)

The photonic circuit of claim 23, further comprising a demultiplexer at an output of the optical combiner, the demultiplexer configured to separate the multiplexed optical output signal into optical output signals of multiple wavelengths.

### Claim 25 (depends on 24)

The photonic circuit of claim 24, further comprising a plurality of photodetectors to measure the optical output signals at the multiple wavelengths.

### Claim 26

A photonic computing method comprising:
splitting light into a plurality of optical carrier signals associated with a plurality of computational inputs;
modulating amplitudes of the plurality of optical carrier signals to impart the computational inputs onto the optical carrier signals, thereby creating a plurality of first modulated optical signals;
splitting each of the optical input signals between a plurality of optical paths associated with a plurality of computational outputs;
modulating amplitudes and/or phases of the first modulated optical signals in each of the plurality of optical paths to impart computational weights, each associated with one of the plurality of computational inputs and one of the plurality of computational outputs, onto the first modulated optical signals, thereby generating second modulated optical signals; and
coherently combining, for each of the computational outputs, the second modulated optical signals in optical paths associated with the computational output into an optical output signal encoding the computational output.

### Claim 27 (depends on 26)

The method of claim 26, wherein each of the optical carrier signals is associated with one of the plurality of computational inputs, and each of the optical output signals is associated with one of the plurality of computational outputs.

### Claim 28 (depends on 26)

The method of claim 26, wherein the light is multiplexed light comprising multiple wavelengths, the optical carrier signals are multiplexed optical carrier signals each associated with multiple computational inputs imparted on the optical carrier signal at the multiple wavelengths to create multiple first modulated optical signals, and the optical output signals are multiplexed optical output signals associated with multiple computational outputs encoded in the optical output signal at the multiple wavelengths.