# US 2023/0068645 A1 · Memory device and method for computing-in-memory (cim)

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0068645 A1
- Document ID: US20230068645A1
- Status: Published application
- Kind: A1
- Application number: 17/576,898
- Filed: 2022-01-14
- Published: 2023-03-02
- Earliest claimed: 2021-08-27
- Assignees: Taiwan Semiconductor Manufacturing Company, Ltd.
- Applicants: Taiwan Semiconductor Manufacturing Company, Ltd.
- Inventors: Hidehiro FUJIWARA; Haruki MORI; Wei-Chang ZHAO
- Web page: https://patentgrep.com/patent/US20230068645A1

## CPC

- G06F 7/5443: {Sum of products (for applications thereof, see the relevant places, e.g. G06F17/10, H03H17/00)}
- G06F 7/501: Half or full adders, i.e. basic adder cells for one denomination
- G06F 15/7821: {Tightly coupled to memory, e.g. computational memory, smart memory, processor in memory}
- G11C 7/1006: {Data managing, e.g. manipulating data before writing or reading out, data bus switches or control circuits therefor}
- G11C 7/1057: {Data output buffers, e.g. comprising level conversion circuits, circuits for adapting load}
- G11C 7/1069: {I/O lines read out arrangements}
- G11C 7/1084: {Data input buffers, e.g. comprising level conversion circuits, circuits for adapting load}
- G11C 7/1096: {Write circuits, e.g. I/O line write drivers}
- G11C 7/12: Bit line control circuits, e.g. drivers, boosters, pull-up circuits, pull-down circuits, precharging circuits, equalising circuits, for bit lines
- G11C 8/16: Multiple access memory array, e.g. addressing one storage element via at least two independent addressing line groups
- G11C 11/419: Read-write [R-W] circuits
- G11C 11/54: using elements simulating biological cells, e.g. neuron
- H03K 19/20: characterised by logic function, e.g. AND, OR, NOR, NOT circuits (H03K19/003 - H03K19/01 take precedence)
- G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)}
- G06F 2207/4814: Non-logic devices, e.g. operational amplifiers
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11C: STATIC STORES (semiconductor memory devices H10B)
- H03K: PULSE TECHNIQUE (measuring pulse characteristics G01R; modulating sinusoidal oscillations with pulses H03C; transmission of digital information H04L; discriminator circuits detecting phase difference between two signals by counting or integrating cycles of oscillation H03D3/04; automatic control, starting, synchronisation or stabilisation of generators of electronic oscillations or pulses where the type of generator is irrelevant or unspecified H03L; coding, decoding or code conversion, in general H03M)

## Abstract

A memory device has a memory array including a memory segment to store weight data, a weight buffer coupled to the memory segment and configured to hold new weight data to be updated in the memory segment, a logic circuit, and a computation circuit coupled to an output of the logic circuit. The logic circuit further has a first input coupled to the memory segment by a bit line, and a second input configured to receive input data. The logic circuit is configured to generate, at the output, intermediate data corresponding to the input data and the weight data read from the memory segment through the bit line. The computation circuit is configured to, based on the intermediate data, generate output data corresponding to a computation performed on the input data and the weight data read from the at least one memory segment.

## Claims

### Claim 1

A memory device, comprising:
a memory array comprising at least one memory segment configured to store weight data;
at least one weight buffer coupled to the at least one memory segment, and configured to hold new weight data to be updated in the at least one memory segment;
at least one logic circuit having
a first input coupled to the at least one memory segment by at least one bit line,
a second input configured to receive input data, and
an output; and
a computation circuit coupled to the output of the at least one logic circuit,
wherein
the at least one logic circuit is configured to generate, at the output, intermediate data corresponding to the input data and the weight data read from the at least one memory segment through the at least one bit line, and
the computation circuit is configured to, based on the intermediate data, generate output data corresponding to a computation performed on the input data and the weight data read from the at least one memory segment.

### Claim 2 (depends on 1)

The memory device of claim 1, wherein
the memory array, the at least one weight buffer, the at least one logic circuit and the computation circuit are included in a same memory macro.

### Claim 3 (depends on 1)

The memory device of claim 1, wherein
the at least one logic circuit comprises a NOR gate or an AND gate.

### Claim 4 (depends on 1)

The memory device of claim 1, wherein
the computation circuit comprises a Multiply Accumulate (MAC) circuit.

### Claim 5 (depends on 4)

The memory device of claim 4, wherein
the MAC circuit comprises an adder tree having a plurality of adder stages.

### Claim 6 (depends on 1)

The memory device of claim 1, further comprising:
at least one register coupled to the at least one bit line, between the at least one memory segment and the first input of the at least one logic circuit.

### Claim 7 (depends on 6)

The memory device of claim 6, wherein
the at least one memory segment comprises single-port memory cells coupled to the at least one bit line.

### Claim 8 (depends on 1)

The memory device of claim 1, wherein
the at least one memory segment comprises a plurality of memory cells each having
a storage circuit configured to store a corresponding piece of the weight data, and
an output buffer coupled between the storage circuit and the at least one bit line.

### Claim 9 (depends on 8)

The memory device of claim 8, wherein
the output buffer comprises an inverter and a transmission gate,
the inverter is coupled between the storage circuit and the transmission gate, and
the transmission gate is coupled between the inverter and the at least one bit line.

### Claim 10 (depends on 1)

The memory device of claim 1, wherein
the at least one bit line comprises a first bit line and a second bit line,
each of the plurality of memory cells is a multiport memory cell having
a first read port coupled to the first bit line, and
a second read port coupled to the second bit line,
the at least one logic circuit comprises
a first logic circuit having a first input coupled to the first bit line, and a second input configured to receive a first part of the input data, and
a second logic circuit having a first input coupled to the second bit line, and a second input configured to receive a second part of the input data.

### Claim 11 (depends on 10)

The memory device of claim 10, further comprising:
a first register coupled to the first bit line, between the at least one memory segment and the first logic circuit; and
a second register coupled to the second bit line, between the at least one memory segment and the second logic circuit.

### Claim 12

A method of operating a memory device, the method comprising:
simultaneously,
performing a computing-in-memory (CIM) operation using a first piece of weight data read from a first memory cell among a plurality of memory cells in a memory segment of the memory device, and
updating a second piece of weight data in a second memory cell among the plurality of memory cells in the memory segment, the second memory cell different from the first memory cell.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
simultaneously with said performing the CIM operation using the first piece of weight data read from the first memory cell,
updating the first piece of weight data in the first memory cell with a new first piece of weight data.

### Claim 14 (depends on 13)

The method of claim 13, wherein
said updating the first piece of weight data in the first memory cell and said updating the second piece of weight data in the second memory cell comprise correspondingly obtaining the new first piece of weight data and a new second piece of weight data from a same weight buffer coupled to the memory segment.

### Claim 15 (depends on 12)

The method of claim 12, further comprising:
simultaneously with said performing the CIM operation using the first piece of weight data read from the first memory cell,
updating at least one third piece of weight data in at least one third memory cell among the plurality of memory cells in the memory segment, the at least one third memory cell different from the first memory cell and the second memory cell.

### Claim 16 (depends on 12)

The method of claim 12, further comprising:
latching the first piece of weight data read from the first memory cell at an output of a register,
wherein said performing the CIM operation using the first piece of weight data comprises performing the CIM operation using the latched first piece of weight data at the output of the register.

### Claim 17 (depends on 16)

The method of claim 16, wherein
the plurality of memory cells in the memory segment comprises single-port memory cells coupled to a same bit line, and
the bit line is coupled to an input of the register.

### Claim 18 (depends on 12)

The method of claim 12, wherein
said performing the CIM operation using the first piece of weight data comprises:
performing, at a logic circuit, a multiplication of the first piece of weight data with input data, and
outputting a result of the multiplication to an adder tree.

### Claim 19

A memory device, comprising:
a memory array comprising
a plurality of memory segments configured to store weight data for a computing-in-memory (CIM) operation,
a plurality of write bit lines coupled to the plurality of memory segments to update the weight data stored in the plurality of memory segments, and
a plurality of read bit lines coupled to the plurality of memory segments to read out the weight data stored in the plurality of memory segments for the CIM operation;
an input driver coupled to a plurality of input data lines, and configured to supply input data over the plurality of input data lines; and
a Multiply Accumulate (MAC) circuit coupled to the plurality of read bit lines and the plurality of input data lines, and configured to perform the CIM operation based on the weight data read out from the plurality of memory segments and the input data supplied from the input driver.

### Claim 20 (depends on 19)

The memory device of claim 19, further comprising:
a weight buffer common for the plurality of memory segments and coupled to the plurality of write bit lines,
wherein the weight buffer is configured to provide new weight data to a memory segment among the plurality of memory segments while a further memory segment among the plurality of memory segments is being read to supply the corresponding weight data stored in the further memory segment to the MAC circuit for the CIM operation.
