# US 2023/0057523 A1 · Optoelectronic computing systems > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2023/0057523 A1 - Document ID: US20230057523A1 - Status: Published application - Kind: A1 - Application number: 17/980,079 - Filed: 2022-11-03 - Published: 2023-02-23 - Earliest claimed: 2018-06-05 - Assignees: Lightelligence PTE. Ltd. - Applicants: Lightelligence PTE. Ltd. - Inventors: Arash Hosseinzadeh; Yelong Xu; Yanfei Bai; Huaiyu Meng; Ronald Gagnon; Cheng-Kuan Lu; Jonathan Terry; Jingdong Deng; Maurice Steinman; Yichen Shen - Web page: https://patentgrep.com/patent/US20230057523A1 ## CPC - G06N 3/0675: {using electro-optical, acousto-optical or opto-electronic means} - G02F 1/225: in an optical waveguide structure - G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)} - G06N 3/04: Architecture, e.g. interconnection topology - G06N 3/044: Recurrent networks, e.g. Hopfield networks - G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU] - G06N 3/045: Combinations of networks - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 3/047: Probabilistic or stochastic networks - G06N 3/0475: Generative networks - G06N 3/08: Learning methods - G06N 3/094: Adversarial learning - H04B 10/541: {Digital intensity or amplitude modulation} - G02F 1/212: {Mach-Zehnder type} - G02F 2203/05: wavelength dependent - G02F 2203/15: involving resonance effects, e.g. resonantly enhanced interaction - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G02F: OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04B: TRANSMISSION ## Abstract A system includes a first unit configured to generate a plurality of modulator control signals, and a processor unit. The processor unit includes: a light source or port configured to provide a plurality of light outputs, and a first set of optical modulators coupled to the light source or port and the first unit. The optical modulators in the first set are configured to generate an optical input vector by modulating the plurality of light outputs provided by the light source or port based on digital input values corresponding to a first set of modulator control signals in the plurality of modulator control signals, the optical input vector comprising a plurality of optical signals. The processor unit also includes a matrix multiplication unit that includes a second set of optical modulators. The matrix multiplication unit is coupled to the first unit, and is configured to transform the optical input vector into an analog output vector based on a plurality of digital weight values corresponding to a second set of modulator control signals in the plurality of modulator control signals applied to the second set of optical modulators. At least one optical modulator of at least one of the first set of optical modulators or the second set of optical modulators is configured to modulate an optical signal based on a first modulator control signal among the plurality of modulator control signals, and the first unit is configured to shape the first modulator control signal to include bandwidth-enhancement associated with a change in amplitude associated with a corresponding change in successive digital values corresponding to the first modulator control signal. ## Claims ### Claim 1 An apparatus comprising: a plurality of optical waveguides coupled to a first set of optical amplitude modulators, wherein a set of multiple input values are encoded on respective optical signals carried by the optical waveguides using the first set of optical amplitude modulators; a plurality of copying modules, and for each of at least two subsets of one or more optical signals, a corresponding set of one or more of the copying modules is configured to split the subset of one or more optical signals into two or more copies of the optical signals; a plurality of multiplication modules each comprising an optical amplitude modulator of a second set of optical amplitude modulators, and for each of at least two copies of a first subset of one or more optical signals, a corresponding multiplication module is configured to multiply the one or more optical signals of the first subset by one or more matrix element values using an optical amplitude modulator of the second set of optical amplitude modulators; and one or more summation modules, and for results of two or more of the multiplication modules, a corresponding one of the summation modules is configured to produce an electrical signal that represents a sum of the results of the two or more of the multiplication modules; wherein at least one optical amplitude modulator of at least one of the first set of optical amplitude modulators or the second set of optical amplitude modulators is configured to modulate an optical signal by a modulation value using a power that monotonically increases with respect to an absolute value of the modulation value. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the at least one optical amplitude modulator of at least one of the first set of optical amplitude modulators or the second set of optical amplitude modulators comprises a coherence-sensitive optical amplitude modulator configured to modulate the optical signal by the modulation value based on interference between optical waves that have a coherence length at least as long as a propagation distance through the coherence-sensitive optical amplitude modulator. ### Claim 3 (depends on 2) The apparatus of claim 2, wherein the coherence-sensitive optical amplitude modulator comprises a Mach-Zehnder Interferometer (MZI) that splits an optical wave guided by an input optical waveguide into a first optical waveguide arm of the MZI and a second optical waveguide arm of the MZI, the first optical waveguide arm includes an active phase shifter that imparts a relative phase shift with respect to a phase delay of the second optical waveguide arm, and the MZI combines optical waves from the first optical waveguide arm and the second optical waveguide arm into at least one output optical waveguide. ### Claim 4 (depends on 3) The apparatus of claim 3, wherein the power used to modulate the optical signal by the modulation value comprises a power applied to the active phase shifter. ### Claim 5 (depends on 1) The apparatus of claim 1, wherein the input values in the set of multiple input values encoded on the respective optical signals represent elements of an input vector that is being multiplied by a matrix that includes the one or more matrix element values. ### Claim 6 (depends on 5) The apparatus of claim 5, wherein a set of multiple output values are encoded on respective electrical signals produced by the one or more summation modules, and the output values in the set of multiple output values represent elements of an output vector that results from the input vector being multiplied by the matrix. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein each of the optical signals carried by an optical waveguide comprises an optical wave having a common wavelength that is substantially identical for all of the optical signals. ### Claim 8 (depends on 1) The apparatus of claim 1, wherein the copying modules include at least one copying module comprising an optical splitter that sends a predetermined fraction of the power of an optical wave at an input port of the copying module to a first output port of the copying module, and sends the remaining fraction of the power of the optical wave at the input port of the copying module to a second output port of the copying module. ### Claim 9 (depends on 8) The apparatus of claim 8, wherein the optical splitter comprises a waveguide optical splitter that sends a predetermined fraction of the power of an optical wave guided by an input optical waveguide of the copying module to a first output optical waveguide of the copying module, and sends the remaining fraction of the power of the optical wave guided by the input optical waveguide of the copying module to a second output optical waveguide of the copying module. ### Claim 10 (depends on 9) The apparatus of claim 9, wherein a guided mode of the input optical waveguide is adiabatically coupled to guided modes of each of the first and second output optical waveguides. ### Claim 11 (depends on 8) The apparatus of claim 8, wherein the optical splitter comprises a beam splitter that includes at least one surface that transmits the predetermined fraction of the power of the optical wave at the input port and reflects the remaining fraction of the power of the optical wave at the input port. ### Claim 12 (depends on 11) The apparatus of claim 11, wherein at least one of the plurality of optical waveguides comprises an optical fiber that is coupled to an optical coupler that couples a guided mode of the optical fiber to a free-space propagation mode. ### Claim 13 (depends on 1) The apparatus of claim 1, wherein the multiplication modules include at least one coherence-sensitive optical amplitude modulator configured to multiply the one or more optical signals of the first subset by one or more matrix element values based on interference between optical waves that have a coherence length at least as long as a propagation distance through the coherence-sensitive optical amplitude modulator. ### Claim 14 (depends on 13) The apparatus of claim 13, wherein the coherence-sensitive optical amplitude modulator comprises a Mach-Zehnder Interferometer (MZI) that splits an optical wave guided by an input optical waveguide into a first optical waveguide arm of the MZI and a second optical waveguide arm of the MZI, the first optical waveguide arm includes a phase shifter that imparts a relative phase shift with respect to a phase delay of the second optical waveguide arm, and the MZI combines optical waves from the first optical waveguide arm and the second optical waveguide arm into at least one output optical waveguide. ### Claim 15 (depends on 14) The apparatus of claim 14, wherein the MZI combines optical waves from the first optical waveguide arm and the second optical waveguide arm into each of a first output optical waveguide and a second output optical waveguide, a first photodetector receives an optical wave from the first output optical waveguide to generate a first photocurrent, a second photodetector receives an optical wave from the second output optical waveguide to generate a second photocurrent, and a result of the coherence-sensitive optical amplitude modulator comprises a difference between the first photocurrent and the second photocurrent. ### Claim 16 (depends on 13) The apparatus of claim 13, wherein the coherence-sensitive optical amplitude modulator comprises one or more ring resonators, including at least one ring resonator coupled to a first optical waveguide and at least one ring resonator coupled to a second optical waveguide. ### Claim 17 (depends on 16) The apparatus of claim 16, wherein a first photodetector receives an optical wave from the first optical waveguide to generate a first photocurrent, a second photodetector receives an optical wave from the second optical waveguide to generate a second photocurrent, and a result of the coherence-sensitive optical amplitude modulator comprises a difference between the first photocurrent and the second photocurrent. ### Claim 18 (depends on 1) The apparatus of claim 1, wherein the multiplication modules include at least one coherence-insensitive optical amplitude modulator configured to multiply the one or more optical signals of the first subset by one or more matrix element values based on absorption of energy within an optical wave. ### Claim 19 (depends on 18) The apparatus of claim 18, wherein the coherence-insensitive optical amplitude modulator comprises an electro-absorption modulator. ### Claim 20 (depends on 1) The apparatus of claim 1, wherein the one or more summation modules include at least one summation module comprising: (1) two or more input conductors that each carries an electrical signal in the form of an input current whose amplitude represents a respective result of a respective one of the multiplication modules, and (2) at least one output conductor that carries the electrical signal that represents the sum of the respective results in the form of an output current that is proportional to the sum of the input currents. ### Claim 21 (depends on 20) The apparatus of claim 20, wherein the two or more input conductors and the output conductor comprise wires that meet at one or more junctions among the wires, and the output current is substantially equal to the sum of the input currents. ### Claim 22 (depends on 20) The apparatus of claim 20, wherein at least a first input current of the input currents is provided in the form of at least one photocurrent generated by at least one photodetector that receives an optical signal generated by a first multiplication module of the multiplication modules. ### Claim 23 (depends on 22) The apparatus of claim 22, wherein the first input current is provided in the form of a difference between two photocurrents generated by different respective photodetectors that receive different respective optical signals both generated by the first multiplication module. ### Claim 24 (depends on 1) The apparatus of claim 1, wherein one of the copies of the first subset of one or more optical signals consists of a single optical signal on which one of the input values is encoded. ### Claim 25 (depends on 24) The apparatus of claim 24, wherein the multiplication module corresponding to the copy of the first subset multiplies the encoded input value by a single matrix element value. ### Claim 26 (depends on 1) The apparatus of claim 1, wherein one of the copies of the first subset of one or more optical signals includes more than one of the optical signals, and fewer than all of the optical signals, on which multiple input values are encoded. ### Claim 27 (depends on 26) The apparatus of claim 26, wherein the multiplication module corresponding to the copy of the first subset multiplies the encoded input values by different respective matrix element values. ### Claim 28 (depends on 27) The apparatus of claim 27, wherein different multiplication modules corresponding to different respective copies of the first subset of one or more optical signals are contained by different devices that are in optical communication to transmit one of the copies of the first subset of one or more optical signals between the different devices. ### Claim 29 (depends on 1) The apparatus of claim 1, wherein two or more of the plurality of optical waveguides, two or more of the plurality of copying modules, two or more of the plurality of multiplication modules, and at least one of the one or more summation modules are arranged on a substrate of a common device. ### Claim 30 (depends on 29) The apparatus of claim 29, wherein the device performs vector-matrix multiplication, wherein an input vector is provided as a set of optical signals, and an output vector is provided as a set of electrical signals. ### Claim 31 (depends on 1) The apparatus of claim 1, further comprising an accumulator that integrates an input electrical signal corresponding to an output of a multiplication module or a summation module, wherein the input electrical signal is encoded using a time domain encoding that uses on-off amplitude modulation within each of multiple time slots, and the accumulator produces an output electrical signal that is encoded with more than two amplitude levels corresponding to different duty cycles of the time domain encoding over the multiple time slots. ### Claim 32 (depends on 1) The apparatus of claim 1, wherein the two or more of the multiplication modules each correspond to a different subset of one or more optical signals. ### Claim 33 (depends on 1) The apparatus of claim 1, further comprising, for each copy of a second subset of one or more optical signals, different from the optical signals in the first subset of one or more optical signals, a multiplication module configured to multiply the one or more optical signals of the second subset by one or more matrix element values using optical amplitude modulation. ### Claim 34 A method comprising: encoding a set of multiple input values on respective optical signals using a first set of optical amplitude modulators; for each of at least two subsets of one or more optical signals, using a corresponding set of one or more copying modules to split the subset of one or more optical signals into two or more copies of the optical signals; for each of at least two copies of a first subset of one or more optical signals, using a corresponding multiplication module to multiply the one or more optical signals of the first subset by one or more matrix element values using an optical amplitude modulator of a second set of optical amplitude modulators; and for results of two or more of the multiplication modules, using a summation module configured to produce an electrical signal that represents a sum of the results of the two or more of the multiplication modules; wherein at least one optical amplitude modulator of at least one of the first set of optical amplitude modulators or the second set of optical amplitude modulators is configured to modulate an optical signal by a modulation value using a power that monotonically increases with respect to an absolute value of the modulation value.