# US 2023/0069786 A1 · In-memory computing with cache coherent protocol

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0069786 A1
- Document ID: US20230069786A1
- Status: Published application
- Kind: A1
- Application number: 18/045,332
- Filed: 2022-10-10
- Published: 2023-03-02
- Earliest claimed: 2020-04-01
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Krishna T. Malladi; Andrew Chang
- Web page: https://patentgrep.com/patent/US20230069786A1

## CPC

- G06F 9/30047: {Prefetch instructions; cache control instructions}
- G06F 13/42: Bus transfer protocol, e.g. handshake; Synchronisation
- G06F 9/30029: {Logical and Boolean instructions, e.g. XOR, NOT}
- G06F 9/3887: {controlled by a single instruction for multiple data lanes [SIMD]}
- G06F 12/0828: {with concurrent directory accessing, i.e. handling multiple concurrent coherency transactions}
- G06F 12/0831: using a bus scheme, e.g. with bus monitoring or watching means
- G06F 13/1694: {Configuration of memory controller to different memory types}
- G06F 13/4221: {being an input/output bus, e.g. ISA bus, EISA bus, PCI bus, SCSI bus}
- G06F 12/0607: {Interleaved addressing}
- G06F 2212/1016: Performance improvement
- G06F 2213/0026: PCI express
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A system for computing. In some embodiments, the system includes: a memory, the memory including one or more function-in-memory circuits; and a cache coherent protocol interface circuit having a first interface and a second interface. A function-in-memory circuit of the one or more function-in-memory circuits may be configured to perform an operation on operands including a first operand retrieved from the memory, to form a result. The first interface of the cache coherent protocol interface circuit may be connected to the memory, and the second interface of the cache coherent protocol interface circuit may be configured as a cache coherent protocol interface on a bus interface.

## Claims

### Claim 1

A system for computing, the system comprising:
a memory, the memory comprising one or more function-in-memory circuits; and
a cache coherent protocol interface circuit having a first interface and a second interface,
a function-in-memory circuit of the one or more function-in-memory circuits being configured to perform an operation on operands including a first operand retrieved from the memory, to form a result,
the first interface of the cache coherent protocol interface circuit being connected to the memory, and
the second interface of the cache coherent protocol interface circuit being configured as a cache coherent protocol interface on a bus interface.

### Claim 2 (depends on 1)

The system of claim 1, wherein:
the function-in-memory circuits are arranged in a single instruction, multiple data configuration; or
the function-in-memory circuits are arranged in a systolic configuration.

### Claim 3 (depends on 1)

The system of claim 1, wherein:
the cache coherent protocol interface circuit is a Compute Express Link (CXL) interface circuit, and
the bus interface is a Peripheral Component Interconnect express (PCIe) endpoint interface.

### Claim 4 (depends on 1)

The system of claim 1, wherein a function-in-memory circuit of the one or more function-in-memory circuits is on a semiconductor chip with a dynamic random-access memory.

### Claim 5 (depends on 1)

The system of claim 1, wherein the first interface is configured to operate according to a protocol selected from the group consisting of DDR2, DDR3, DDR4, and DDR5.

### Claim 6 (depends on 1)

The system of claim 1, wherein a function-in-memory circuit of the one or more function-in-memory circuits comprises:
a plurality of registers,
a plurality of multiplexers, and
an arithmetic logic unit.

### Claim 7 (depends on 1)

The system of claim 1, wherein a function-in-memory circuit of the one or more function-in-memory circuits is configured to perform an arithmetic operation selected from the group consisting of addition, subtraction, multiplication, and division.

### Claim 8 (depends on 1)

The system of claim 1, wherein a function-in-memory circuit of the one or more function-in-memory circuits is configured to perform an arithmetic operation selected from the group consisting of floating-point addition, floating-point subtraction, floating-point multiplication, and floating-point division.

### Claim 9 (depends on 1)

The system of claim 1, wherein a function-in-memory circuit of the one or more function-in-memory circuits is configured to perform a logical operation selected from the group consisting of bitwise AND, bitwise OR, bitwise exclusive OR, and bitwise ones complement.

### Claim 10 (depends on 1)

The system of claim 1, wherein a function-in-memory circuit of the one or more function-in-memory circuits is configured, in a first state, to store the result in the memory, and, in a second state, to send the result to the cache coherent protocol interface circuit.

### Claim 11 (depends on 1)

The system of claim 1, further comprising a host processing circuit connected to the second interface.

### Claim 12 (depends on 11)

The system of claim 11, wherein the host processing circuit comprises a PCIe root complex having a root port connected to the second interface.

### Claim 13

A system for computing, the system comprising:
a memory; and
a cache coherent protocol interface circuit having a first interface and a second interface,
the cache coherent protocol interface circuit being configured to perform an arithmetic operation on data stored in the memory,
the first interface of the cache coherent protocol interface circuit being connected to the memory, and
the second interface being configured as a cache coherent protocol interface on a bus interface.

### Claim 14 (depends on 13)

The system of claim 13, wherein:
the memory comprises one or more function-in-memory circuits, and
a function-in-memory circuit of the one or more function-in-memory circuits is configured to perform an operation on operands including a first operand retrieved from the memory, to form a result.

### Claim 15 (depends on 14)

The system of claim 14, wherein:
the function-in-memory circuits are arranged in a single instruction, multiple data configuration; or
the function-in-memory circuits are arranged in a systolic configuration.

### Claim 16 (depends on 14)

The system of claim 14, wherein:
the cache coherent protocol interface circuit is a Compute Express Link (CXL) interface circuit, and
the bus interface is a Peripheral Component Interconnect express (PCIe) endpoint interface.

### Claim 17 (depends on 14)

The system of claim 14, wherein a function-in-memory circuit of the one or more function-in-memory circuits is on a semiconductor chip with a dynamic random-access memory.

### Claim 18 (depends on 14)

The system of claim 14, wherein the first interface is configured to operate according to a protocol selected from the group consisting of DDR2, DDR3, DDR4, DDR5, GDDR, HBM, and LPDDR.

### Claim 19 (depends on 14)

The system of claim 14, wherein a function-in-memory circuit of the one or more function-in-memory circuits is configured, in a first state, to store the result in the memory, and, in a second state, to send the result to the cache coherent protocol interface circuit.

### Claim 20

A method for computing, the method comprising:
sending, by a host processing circuit, to a CXL interface circuit, one or more CXL packets;
sending, by the CXL interface circuit, in response to receiving the CXL packets, to a function-in-memory circuit in a memory connected to the CXL interface circuit, an instruction; and
performing, by the function-in-memory circuit, an operation, in accordance with the instruction, on operands including a first operand retrieved from the memory, to form a result.
