# US 2021/0343343 A1 · Voltage offset for compute-in-memory architecture

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0343343 A1
- Document ID: US20210343343A1
- Status: Published application
- Kind: A1
- Application number: 16/864,005
- Filed: 2020-04-30
- Published: 2021-11-04
- Earliest claimed: 2020-04-30
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Edward Harrison Teague; Zhongze Wang; Max Welling
- Web page: https://patentgrep.com/patent/US20210343343A1

## CPC

- G06N 3/063: using electronic means
- G11C 16/10: Programming or data input circuits
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G11C 7/1069: {I/O lines read out arrangements}
- G11C 7/16: Storage of analogue signals in digital stores using an arrangement comprising analogue/digital [A/D] converters, digital memories and digital/analogue [D/A] converters
- G11C 16/08: Address circuits; Decoders; Word-line control circuits
- G11C 16/24: Bit-line control circuits
- G11C 16/26: Sensing or reading circuits; Data output circuits
- G06N 3/045: Combinations of networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G11C: STATIC STORES (semiconductor memory devices H10B)

## Abstract

In one embodiment, an electronic device includes a compute-in-memory (CIM) array that includes a plurality of columns. Each column includes a plurality of CIM cells connected to a corresponding read bitline, a plurality of offset cells configured to provide a programmable offset value for the column, and an analog-to-digital converter (ADC) having the corresponding bitline as a first input and configured to receive the programmable offset value. Each CIM cell is configured to store a corresponding weight.

## Claims

### Claim 1

An electronic device comprising a compute-in-memory (CIM) array comprising a plurality of columns, wherein:
each column comprises:
a plurality of CIM cells connected to a read bitline;
a plurality of offset cells configured to provide a programmable offset value for the column; and
an analog-to-digital converter (ADC) having the read bitline as a first input and configured to receive the programmable offset value; and
each CIM cell is configured to store a corresponding weight.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein, for each column:
the plurality of CIM cells is configured to receive a corresponding plurality of input values;
each CIM cell is configured to generate an output based on both the corresponding stored weight and the corresponding input value and to provide the output to the read bitline;
the read bitline is configured to provide a sum of the outputs of the CIM cells to the ADC; and
the ADC is configured to generate and output a digital value corresponding to the provided sum of CIM cell outputs.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein, for each column:
each offset cell of the plurality of offset cells is configured to store a value and configured to provide its stored value to an offset bitline;
the offset bitline is different from the read bitline;
the offset bitline is configured to sum the values provided by the corresponding offset cells to generate the programmable offset value;
the offset bitline is configured to provide the programmable offset value to the ADC; and
the ADC is configured to use the programmable offset value to set a reference voltage for use in generating the digital value corresponding to the provided sum.

### Claim 4 (depends on 3)

The electronic device of claim 3, wherein:
each CIM cell comprises a static random-access memory (SRAM) cell connected to a capacitor via an input-line transistor controlled by the input value;
the capacitor of each CIM cell is connected to the read bitline via a read-wordline transistor controlled by a corresponding read wordline;
each offset cell comprises an SRAM cell connected to the offset bitline via a corresponding read-wordline transistor controlled by a corresponding read wordline.

### Claim 5 (depends on 4)

The electronic device of claim 4, wherein, for each column:
each CIM cell has a corresponding offset cell;
the read wordline corresponding to the CIM cell is the same as the read wordline corresponding to the corresponding offset cell.

### Claim 6 (depends on 2)

The electronic device of claim 2, wherein, for each column:
each offset cell of the plurality of offset cells is configured to store a value and configured to provide its stored value to the read bitline;
the programmable offset value is a sum of the stored values of the plurality of offset cells;
the read bitline is configured to add the programmable offset value to the sum of the outputs of the CIM cells to provide to the ADC.

### Claim 7 (depends on 6)

The electronic device of claim 6, wherein, for each column:
each CIM cell comprises a static random-access memory (SRAM) cell connected to a capacitor via an input-line transistor controlled by the input value;
the capacitor of each CIM cell is connected to the read bitline via a read-wordline transistor controlled by a corresponding read wordline;
each offset cell comprises an SRAM cell connected to the offset bitline via a corresponding read-wordline transistor controlled by a corresponding read wordline.

### Claim 8 (depends on 6)

The electronic device of claim 6, wherein, for each column, each offset cell and each CIM cell consist of the same components.

### Claim 9 (depends on 2)

The electronic device of claim 2, wherein, for each column:
each offset cell is configured to store a first value;
each offset cell is configured to receive a corresponding input value when the plurality of CIM cells receives the corresponding plurality of input values;
each offset cell is configured to provide the corresponding input value to the read bitline;
the programmable offset value is a sum of the input values of the plurality of offset cells;
the read bitline is configured to add the programmable offset value to the sum of the outputs of the CIM cells to provide to the ADC.

### Claim 10 (depends on 2)

The electronic device of claim 2, wherein, for each column:
each CIM cell is a flexible cell configured to be dynamically programmed to function as a CIM cell; and
each offset cell is a flexible cell configured to be dynamically programmed to function as an offset cell.

### Claim 11

A method for an electronic device wherein:
the electronic device comprises a compute-in-memory (CIM) array;
the CIM array comprises a plurality of columns;
each column comprises:
a plurality of CIM cells connected to a read bitline;
a plurality of offset cells; and
an analog-to-digital converter (ADC) having the read bitline as a first input;
the method comprising:
storing a corresponding weight in each CIM cell;
providing, to the ADC, by the plurality of offset values, a programmable offset value for the column.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
receiving, by the plurality of CIM cells, a corresponding plurality of input values;
generating, by each CIM cell, an output based on both the corresponding stored weight and the corresponding input value;
providing, by each CIM cell, the output to the read bitline;
providing, by the read bitline, a sum of the outputs of the CIM cells to the ADC; and
generating and outputting, by the ADC, a digital value corresponding to the provided sum of CIM cell outputs.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
storing a corresponding value in each offset cell of the plurality of offset cells;
providing, by each offset cell, its stored value to an offset bitline, wherein the offset bitline is different from the read bitline;
generating the programmable offset value, by the offset bitline, by summing the values provided by the corresponding offset cells;
providing to the ADC, by the offset bitline, the programmable offset value; and
generating the digital value corresponding to the provided sum, by the ADC, using the programmable offset value to set a reference voltage for the generating.

### Claim 14 (depends on 13)

The method of claim 13, wherein:
each CIM cell comprises a static random-access memory (SRAM) cell connected to a capacitor via an input-line transistor controlled by the input value;
the capacitor of each CIM cell is connected to the read bitline via a read-wordline transistor controlled by a corresponding read wordline;
each offset cell comprises an SRAM cell connected to the offset bitline via a corresponding read-wordline transistor controlled by a corresponding read wordline.

### Claim 15 (depends on 14)

The method of claim 14, wherein, for each column:
each CIM cell has a corresponding offset cell;
the read wordline corresponding to the CIM cell is the same as the read wordline corresponding to the corresponding offset cell.

### Claim 16 (depends on 12)

The method of claim 12, further comprising:
storing, in each offset cell of the plurality of offset cells, a corresponding value for provision to the read bitline, wherein the programmable offset value is a sum of the stored values of the plurality of offset cells; and
adding, by the read bitline, the programmable offset value to the sum of the outputs of the CIM cells for provision to the ADC.

### Claim 17 (depends on 16)

The method of claim 16, wherein, for each column:
each CIM cell comprises a static random-access memory (SRAM) cell connected to a capacitor via an input-line transistor controlled by the input value;
the capacitor of each CIM cell is connected to the read bitline via a read-wordline transistor controlled by a corresponding read wordline;
each offset cell comprises an SRAM cell connected to the offset bitline via a corresponding read-wordline transistor controlled by a corresponding read wordline.

### Claim 18 (depends on 16)

The electronic device of claim 16, wherein, for each column, each offset cell and each CIM cell consist of the same components.

### Claim 19 (depends on 12)

The method of claim 12, further comprising:
storing a first value in each offset cell;
receiving, by each offset cell, a corresponding input value when the plurality of CIM cells receives the corresponding plurality of input values;
providing to the read bitline, by each offset cell, the corresponding input value, wherein the programmable offset value is a sum of the input values of the plurality of offset cells;
adding, by the read bitline, the programmable offset value to the sum of the outputs of the CIM cells for provision to the ADC.

### Claim 20 (depends on 12)

The method of claim 12, wherein each CIM cell and each offset cell is a flexible cell, the method further comprising:
dynamically programming each of a first of flexible cells to function as a CIM cell; and
dynamically programming each of a second set of flexible cells to function as an offset cell.
