# US 2021/0173894 A1 · Array of integrated pixel and memory cells for deep in-sensor, in-memory computing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0173894 A1
- Document ID: US20210173894A1
- Status: Published application
- Kind: A1
- Application number: 16/705,434
- Filed: 2019-12-06
- Published: 2021-06-10
- Earliest claimed: 2019-12-06
- Assignees: GlobalFoundries U.S. Inc.
- Applicants: GLOBALFOUNDRIES U.S. Inc.
- Inventors: Akhilesh Jaiswal; Ajey Poovannummoottil Jacob
- Web page: https://patentgrep.com/patent/US20210173894A1

## CPC

- G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)}
- G11C 7/1006: {Data managing, e.g. manipulating data before writing or reading out, data bus switches or control circuits therefor}
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/065: Analogue means
- G11C 11/403: with charge regeneration common to a multiplicity of memory cells, i.e. external refresh
- G11C 11/4085: {Word line control circuits, e.g. word line drivers, - boosters, - pull-up, - pull-down, - precharge}
- G11C 11/4091: Sense or sense/refresh amplifiers, or associated sense circuitry, e.g. for coupled bit-line precharging, equalising or isolating
- G11C 11/4094: Bit-line management or control circuits
- G11C 11/4096: Input/output [I/O] data management or control circuits, e.g. reading or writing circuits, I/O drivers or bit-line switches
- G11C 11/54: using elements simulating biological cells, e.g. neuron
- G11C 13/0002: {using resistive RAM [RRAM] elements}
- G11C 17/06: using diode elements (G11C17/14 takes precedence)
- G11C 17/10: in which contents are determined during manufacturing by a predetermined arrangement of coupling elements, e.g. mask-programmable ROM
- H10B 12/30: {DRAM devices comprising one-transistor - one-capacitor [1T-1C] memory cells}
- H10F 39/18: Complementary metal-oxide-semiconductor [CMOS] image sensors; Photodiode array image sensors
- H10F 39/8037: {the integrated elements comprising a transistor}
- G06N 3/045: Combinations of networks
- G06N 3/063: using electronic means
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11C: STATIC STORES (semiconductor memory devices H10B)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H10B: ELECTRONIC MEMORY DEVICES
- H10F: INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION

## Abstract

Disclosed are embodiments of an integrated circuit structure (e.g., a processing chip), which includes an array of integrated pixel and memory cells configured for deep in-sensor, in-memory computing (e.g., of neural networks). Each cell incorporates a memory structure (e.g., DRAM structure or a ROM structure) with a storage node, which stores a first data value (e.g., a binary weight value), and a sensor connected to a sense node, which outputs a second data value (e.g., an analog input value). Each cell is selectively operable in a functional computing mode during which the voltage level on a bit line is adjusted as a function of both the first data value and the second data value. Each cell is further selectively operable in a storage node read mode. Furthermore, depending upon the type of memory structure (e.g., a DRAM structure), each cell is selectively operable in a storage node write mode.

## Claims

### Claim 1

An integrated circuit structure comprising:
an array of cells arranged in columns and rows, wherein each cell comprises:
a select transistor having a gate electrically connected to a word line for a row and a source region electrically connected to a bit line for a column;
a storage node operably connected to the select transistor, wherein the storage node stores a first data value;
a sense node operably connected to the select transistor; and
a photodioide electrically connected to the sense node,
wherein each cell is selectively operable in a functional computing mode, and
wherein, during the functional computing mode in a specific cell within a specific row and a specific column, the photodiode of the specific cell performs a sensing process resulting in a second data value being output on the sense node and a specific word line for the specific row is selectively activated causing the select transistor of the specific cell to switch to an ON state and a bit line voltage on a specific bit line for the specific column to be automatically adjusted as a function of both the first data value and the second data value.

### Claim 2 (depends on 1)

The integrated circuit structure of claim 1, wherein each cell further comprises a pixel that incorporates the photodiode and the sense node and wherein the pixel further comprises:
a reset transistor; and
an amplifying transistor,
wherein the reset transistor and the photodiode are electrically connected in series between a positive voltage rail and a ground rail,
wherein the sense node is at a junction between the reset transistor and the photodiode, and
wherein a gate of the amplifying transistor is electrically connected to the sense node.

### Claim 3 (depends on 1)

The integrated circuit structure of claim 1, wherein each cell further comprises a memory structure that incorporates the storage node and that comprises any of a dynamic random access memory structure and a read only memory structure.

### Claim 4 (depends on 1)

The integrated circuit structure of claim 1,
wherein any change in the bit line voltage on the specific bit line in response to the select transistor of the specific cell switching to the ON state is indicative of a product of the first data value on the storage node and the second data value on the sense node in the specific cell, and
wherein a total change in the bit line voltage on the specific bit line in response to multiple select transistors of multiple cells in the specific column switching to the ON state is indicative of a result of a dot product computation.

### Claim 5

An integrated circuit structure comprising:
an array of cells arranged in columns and rows, wherein each cell comprises:
a select transistor;
a dynamic random access memory structure comprising a storage node operably connected to the select transistor;
a sense node operably connected to the select transistor; and
a photodioide electrically connected to the sense node;
first word lines, each first word line being electrically connected to gates of select transistors of all cells in a corresponding row; and
first bit lines, each first bit line being electrically connected to source regions of select transistors of all cells in a corresponding column,
wherein each cell is selectively operable in a storage node write mode, a storage node read mode, and a functional computing mode,
wherein, during the storage node write mode in a specific cell within a specific row and a specific column, a first data value is stored on the storage node of the specific cell,
wherein, during the storage node read mode in the specific cell, the first data value is read from the storage node of the specific cell, and
wherein, during the functional computing mode in the specific cell, the photodiode of the specific cell performs a sensing process resulting in a second data value being output on the sense node and a specific word line for the specific row is selectively activated causing the select transistor of the specific cell to switch to an ON state and a bit line voltage on a specific first bit line for the specific column to be automatically adjusted as a function of both the first data value and the second data value.

### Claim 6 (depends on 5)

The integrated circuit structure of claim 5, wherein each cell further comprises a pixel that incorporates the photodiode and the sense node and wherein the pixel further comprises:
a reset transistor; and
an amplifying transistor,
wherein the reset transistor and the photodiode are electrically connected in series between a positive voltage rail and a ground rail,
wherein the sense node is at a junction between the reset transistor and the photodiode, and
wherein a gate of the amplifying transistor is electrically connected to the sense node.

### Claim 7 (depends on 6)

The integrated circuit structure of claim 6, wherein the pixel further comprises at least one additional transistor.

### Claim 8 (depends on 6)

The integrated circuit structure of claim 6,
wherein each cell further comprises: a second amplifying transistor, wherein the amplifying transistor, the second amplifying transistor and the select transistor are electrically connected in series between the positive voltage rail and a first bit line,
wherein the dynamic random access memory structure further comprises an access transistor,
wherein the storage node comprises a capacitor electrically connected in series between a drain region of the access transistor and ground,
wherein a gate of the second amplifying transistor is electrically connected to a junction between the capacitor and the drain region of the access transistor, and
wherein the integrated circuit structure further comprises:
second word lines, wherein each second word line is electrically connected to all gates of all access transistors in a corresponding row; and
second bit lines, wherein each second bit line is electrically connected to all source regions of all access transistors in a corresponding column.

### Claim 9 (depends on 5)

The integrated circuit structure of claim 5, wherein each cell further comprises at least one additional dynamic random access memory structure.

### Claim 10 (depends on 5)

The integrated circuit structure of claim 5,
wherein any change in the bit line voltage on the specific first bit line in response to the select transistor of the specific cell switching to the ON state is indicative of a product of the first data value on the storage node and the second data value on the sense node in the specific cell, and
wherein a total change in the bit line voltage on the specific first bit line in response to multiple select transistors of multiple cells in the specific column switching to the ON state is indicative of a result of a dot product computation.

### Claim 11 (depends on 5)

The integrated circuit structure of claim 5, further comprising transimpedance amplifiers for the columns, respectively, wherein each specific transimpedance amplifier for each specific column has a first input electrically connected to ground, a second input electrically connected to the specific bit line of the specific column and an output electrically connected to the specific bit line for the specific column.

### Claim 12 (depends on 11)

The integrated circuit structure of claim 11, further comprising analog-to-digital converters for the columns, respectively, wherein each specific analog-to-digital converter for each specific column is electrically connected to the output of the specific transimpedance amplifier.

### Claim 13

An integrated circuit structure comprising:
an array of cells arranged in columns and rows, wherein each cell comprises:
a select transistor;
a read only memory structure comprising a storage node operably connected to the select transistor and storing a first data value;
a sense node operably connected to the select transistor; and
a photodiode electrically connected to the sense node;
word lines, each word line being electrically connected to gates of select transistors of all cells in a corresponding row; and
bit lines, each bit line being electrically connected to source regions of select transistors of all cells in a corresponding column,
wherein each cell is selectively operable in a storage node read mode and a functional computing mode,
wherein, during the storage node read mode in a specific cell of a specific row and a specific column, the first data value is read from the storage node of the specific cell, and wherein, during the functional computing mode in the specific cell, the photodiode of the specific cell performs a sensing process resulting in a second data value being output on the sense node and a specific word line for the specific row is selectively activated causing the select transistor of the specific cell to switch to an ON state and a bit line voltage on a specific bit line for the specific column to be automatically adjusted as a function of both the first data value and the second data value.

### Claim 14 (depends on 13)

The integrated circuit structure of claim 13, wherein each cell further comprises a pixel that incorporates the photodiode and the sense node and wherein the pixel further comprises:
a reset transistor; and
an amplifying transistor,
wherein the reset transistor and the photodiode are electrically connected in series between a positive voltage rail and a ground rail,
wherein the sense node is at a junction between the reset transistor and the photodiode, and
wherein a gate of the amplifying transistor is electrically connected to the sense node.

### Claim 15 (depends on 14)

The integrated circuit structure of claim 14, wherein the pixel further comprises at least one additional transistor.

### Claim 16 (depends on 14)

The integrated circuit structure of claim 14,
wherein the read only memory structure comprises a single bit read only memory structure,
wherein the storage node is electrically connected to either a first voltage rail at a first voltage level such that the first data value is “0” or a second voltage rail at a second voltage level that is different from the first voltage level such that the first data value is a “1”, and
wherein the amplifying transistor and the select transistor are electrically connected in series between the storage node and a bit line.

### Claim 17 (depends on 14)

The integrated circuit structure of claim 14,
wherein the read only memory structure comprises a two-bit read only memory structure,
wherein the storage node is electrically connected to one of a first voltage rail at a first voltage level such that the first data value is “00”, a second voltage rail at a second voltage level that is greater than the first voltage level such that the first data value is “01”, a third voltage rail at a third voltage level that is greater than the second voltage level such that the first data value is “10” or a fourth voltage rail at a fourth voltage level that is greater than the third voltage level such that the first data value is “11”, and
wherein the amplifying transistor and the select transistor are electrically connected in series between the storage node and a bit line.

### Claim 18 (depends on 13)

The integrated circuit structure of claim 13,
wherein any change in the bit line voltage on the specific bit line in response to the select transistor of the specific cell switching to the ON state is indicative of a product of the first data value on the storage node and the second data value on the sense node in the specific cell, and
wherein a total change in the bit line voltage on the specific bit line in response to multiple select transistors of multiple cells in the specific column switching to the ON state is indicative of a result of a dot product computation.

### Claim 19 (depends on 13)

The integrated circuit structure of claim 13, further comprising transimpedance amplifiers for the columns, respectively, wherein each specific transimpedance amplifier for each specific column has a first input electrically connected to ground, a second input electrically connected to the specific bit line of the specific column and an output electrically connected to the specific bit line for the specific column.

### Claim 20 (depends on 19)

The integrated circuit structure of claim 19, further comprising analog-to-digital converters for the columns, respectively, wherein each specific analog-to-digital converter for each specific column is electrically connected to the output of the specific transimpedance amplifier.
