# US 2024/0004786 A1 · Allocating memory for processing-in-memory (pim) devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004786 A1
- Document ID: US20240004786A1
- Status: Published application
- Kind: A1
- Application number: 17/855,157
- Filed: 2022-06-30
- Published: 2024-01-04
- Earliest claimed: 2022-06-30
- Assignees: Advanced Micro Devices, Inc.
- Applicants: Advanced Micro Devices, Inc.
- Inventors: VIGNESH ADHINARAYANAN; MAHZABEEN ISLAM; JAGADISH B. KOTRA; SERGEY BLAGODUROV
- Web page: https://patentgrep.com/patent/US20240004786A1

## CPC

- G06F 12/0207: {with multidimensional access, e.g. row/column, matrix}
- G11C 8/12: Group selection circuits, e.g. for memory block selection, chip selection, array selection
- G11C 5/025: {Geometric lay-out considerations of storage- and peripheral-blocks in a semiconductor storage device (geometrical lay-out of the components in integrated circuits, geometrical lay-out of the components in integrated circuits H10D89/10)}
- G11C 7/1006: {Data managing, e.g. manipulating data before writing or reading out, data bus switches or control circuits therefor}
- G11C 11/408: Address circuits
- G11C 11/4096: Input/output [I/O] data management or control circuits, e.g. reading or writing circuits, I/O drivers or bit-line switches
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11C: STATIC STORES (semiconductor memory devices H10B)

## Abstract

Allocating memory for processing-in-memory (PIM) devices, including: allocating, in a first Dynamic Random Access Memory (DRAM) sub-array, a first data structure beginning in a first grain of the DRAM; allocating, in a second DRAM sub-array, a second data structure beginning in a second grain of the DRAM; and wherein the second DRAM sub-array is different from the first DRAM sub-array and the second grain is different from the first grain.

## Claims

### Claim 1

A method of allocating memory for processing-in-memory (PIM) devices, the method comprising:
allocating, in a first Dynamic Random Access Memory (DRAM) sub-array, a first data structure beginning in a first grain of the DRAM;
allocating, in a second DRAM sub-array, a second data structure beginning in a second grain of the DRAM; and
wherein the second DRAM sub-array is different from the first DRAM sub-array and the second grain is different from to the first grain, and wherein each of the first grain and the second grain are individually selectable via a corresponding selection line.

### Claim 2 (depends on 1)

The method of claim 1, wherein the second DRAM sub-array is adjacent to the first DRAM sub-array and the second grain is adjacent to the first grain.

### Claim 3 (depends on 1)

The method of claim 1, wherein each entry of the second data structure is stored in a DRAM grain adjacent to another DRAM grain storing a corresponding entry of the first data structure having a same index.

### Claim 4 (depends on 1)

The method of claim 1, further comprising performing a processing-in-memory (PIM) operation based on the first data structure and the second data structure.

### Claim 5 (depends on 4)

The method of claim 4, wherein performing the PIM operation comprises opening two or more DRAM rows in different grains concurrently.

### Claim 6 (depends on 1)

The method of claim 1, further comprising performing a reduction operation based on the first data structure.

### Claim 7 (depends on 1)

The method of claim 1, wherein allocating the first data structure comprises storing in a table, a first table entry comprising a first identifier for the first data structure and wherein allocating the second data structure comprises storing, in the table, a second table entry comprising a second identifier for the second data structure.

### Claim 8 (depends on 7)

The method of claim 7, wherein the table comprises a page table or a page attribute table.

### Claim 9

An apparatus for allocating memory for processing-in-memory (PIM) devices, comprising:
Dynamic Random Access Memory (DRAM);
a DRAM controller operatively coupled to the DRAM; and
a processor operatively coupled to the DRAM controller, the processor configured to:
allocate, in a first Dynamic Random Access Memory (DRAM) sub-array, a first data structure beginning in a first grain of the DRAM;
allocate, in a second DRAM sub-array, a second data structure beginning in a second grain of the DRAM; and
wherein the second DRAM sub-array is different from the first DRAM sub-array and the second grain is different from the first grain, and wherein each of the first grain and the second grain are individually selectable via a corresponding selection line.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the second DRAM sub-array is adjacent to the first DRAM sub-array and the second grain is adjacent to the first grain.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein each entry of the second data structure is stored in a DRAM grain adjacent to another DRAM grain storing a corresponding entry of the first data structure having a same index.

### Claim 12 (depends on 9)

The apparatus of claim 9, wherein the DRAM controller is configured to perform a processing-in-memory (PIM) operation based on the first data structure and the second data structure.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein performing the PIM operation comprises opening two or more DRAM rows in different grains concurrently.

### Claim 14 (depends on 9)

The apparatus of claim 9, wherein the DRAM controller is configured to perform a reduction operation based on the first data structure.

### Claim 15 (depends on 9)

The apparatus of claim 9, wherein allocating the first data structure comprises storing, in a table, a first table entry comprising a first identifier for the first data structure and wherein allocating the second data structure comprises storing, in the table, a second table entry comprising a second identifier for the second data structure.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the table comprises a page table or a page attribute table.

### Claim 17

A computer program product disposed upon a non-transitory computer readable medium, the computer program product comprising computer program instructions for allocating memory for processing-in-memory (PIM) devices that, when executed, cause a computer system to:
allocate, in a first Dynamic Random Access Memory (DRAM) sub-array, a first data structure beginning in a first grain of the DRAM;
allocate, in a second DRAM sub-array, a second data structure beginning in a second grain of the DRAM; and
wherein the second DRAM sub-array is different from the first DRAM sub-array and the second grain is different from the first grain, and wherein each of the first grain and the second grain are individually selectable via a corresponding selection line.

### Claim 18 (depends on 17)

The computer program product of claim 17, wherein each entry of the second data structure is stored in a DRAM grain adjacent to another DRAM grain storing a corresponding entry of the first data structure having a same index.

### Claim 19 (depends on 17)

The computer program product of claim 17, wherein the computer program instructions, when executed further cause the computer system to perform a processing-in-memory (PIM) operation based on the first data structure and the second data structure.

### Claim 20 (depends on 19)

The computer program product of claim 19, wherein performing the PIM operation comprises opening two or more DRAM rows in different grains concurrently.
