US 2019/0095784 A1Published application

Photonic neural network system

AssigneeLook Dynamics, Inc.

InventorsRikki J. Crill, Jonathan C. Baiardo

Life of this patent

Estimating the term…

Loading patent…

Abstract

A system (10) for convolving and adding frames of data comprises a first sensor-display device (14) and a second sensor display device (26). Each sensor display device (14, 26) comprises an array (80) of transmit-receive modules (82). Each transmit-receive module (82) comprises a light sensor element (86), a light transmitter element (84), and a memory bank (90). A radial modulator device (20) is positioned where transmission of light fields comprising frames of data are Fourier transformed. Filters implemented by modulator elements of the radial modulator device (20) convolve the fields of light comprising the frames of data, which are then sensed on a pixel-by-pixel basis by the light sensor elements (86), which accumulate charges, thus sum pixel values of sequential convolved frames of data.

Claims11

Dependent claims

A system for convolving and suming frames of data, comprising:

a first sensor-display device comprising an array of transmit-receive modules, each transmit-receive module comprising a light sensor element, a light transmitter element, and a memory bank comprised of a plurality of memory cells;
a second sensor display device comprising an array of transmit-receive modules, each transmit-receive module comprising a light sensor element, a light transmitter element, and a memory bank comprised of a plurality of memory cells;
a radial modulator device having a plurality of modulator elements positioned at multiple radial distances and angular orientations in relation to an optic axis, the radial modulator device;
a first Fourier transform lens positioned between the light transmitter elements of the first sensor-display device and the radial modulator device, and a second Fourier transform lens positioned between the light transmitter elements of the first sensor-display device and the radial modulator device, and said radial modulator device being positioned a focal length from the first Fourier transform lens and a focal length from the second Fourier transform lens so that the radial modulator device is positioned in the Fourier transform planes of both the first Fourier transform lens and the second Fourier transform lens.

1 more element

A method of convolving and summing frames of data for a convolutional neural network, comprising

sequentially projecting the frames of data as a light fields in spatial domain along a first optic axis;
creating Fourier transforms the light fields in sequence at a Fourier transform plane;
convolving the light fields in sequence at the Fourier transform plane with a light modulator that has light modulating segments spaced at various radial distances and angular orientations with respect to the optic axis;
inverse-Fourier transforming the sequence of convolved light fields back into spatial domain at a first sensor display location;
sensing at the first sensor-display location each of the convolved light fields in the spatial domain on a pixel-by-pixel basis with capacitive light sensors at the pixel locations that have electric charge building capacity;
and
allowing the capacitive light sensors to accumulate the electric charges resulting from sensing in sequence the convolved light fields at the first sensor-display location;.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/137,522Filed 20 Sep 2018
Priority: 20 Sep 2017
Published: 28 Mar 2019
Term ends: Not estimatedThe source records don’t support an estimate.

Classification6 codes

G06N 3/0675
Using optical means: using electro-optical, acousto-optical or opto-electronic means
G06N 3/045
Architecture, e.g. interconnection topology: combinations of networks
G06N 3/0464
Architecture, e.g. interconnection topology: convolutional networks [CNN, ConvNet]
G06N 3/084
Learning methods: backpropagation, e.g. using gradient descent

Family

Application62/561,061Us provisional application · filed 20 Sep 2017
Application62/625,711Us provisional application · filed 2 Feb 2018
US 11,410,028 B2Related patent
US 2020/0012928 A9Published application
US 2019/0095784 A1This patent

From the US filing history. Foreign family members aren’t listed.