# US 2026/0300168 A1 · Method of flexible address mapping for utilizing processing-in-memory and apparatus therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0300168 A1
- Document ID: US20260300168A1
- Status: Published application
- Kind: A1
- Application number: 19/336,675
- Filed: 2025-09-23
- Published: 2026-10-01
- Earliest claimed: 2025-03-31
- Assignees: Seoul National University R&Db Foundation
- Applicants: Seoul National University R&Db Foundation
- Inventors: Jae Wook LEE; Seong Hoon Seo; Junghoon Kim; Donghyun Lee; Seonah Yoo; Seokwon Moon; Yeonhong Park
- Web page: https://patentgrep.com/patent/US20260300168A1

## CPC

- G06F 12/0292: {using tables or multilevel address translation means (G06F12/023 takes precedence; address translation in virtual memory systems G06F12/10)}
- G06F 12/0207: {with multidimensional access, e.g. row/column, matrix}
- G06F 12/0607: {Interleaved addressing}
- G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)}
- G06N 3/0475: Generative networks
- G06F 2212/657: Virtual address space management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method of performing matrix operations including a plurality of parameters by a system-on-chip (SoC) processor and a processing-in-memory (PIM) processor inside a memory according to an embodiment may comprise the steps of: calculating a map ID on the basis of at least one among information on the matrix, information on the memory, and information on the PIM processor; allocating a huge page for representing some of the plurality of parameters; and adding the map ID to a page table entry of the huge page for the matrix operation in the SoC processor.

## Claims

### Claim 1

A method of performing matrix operations including a plurality of parameters by a system-on-chip (SoC) processor and a processing-in-memory (PIM) processor inside a memory, the method comprising the steps of:
calculating a map ID on the basis of at least one among information on the matrix, information on the memory, and information on the PIM processor;
allocating a huge page for representing some of the plurality of parameters; and
adding the map ID to a page table entry of the huge page for the matrix operation in the SoC processor.

### Claim 2 (depends on 1)

The method according to claim 1, wherein information on the matrix includes information on a dimension of the matrix, and the map ID is a value representing how much a bit in charge of bank interleaving inside the memory is apart from a chunk column.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the step of calculating a map ID is performed by a mapping selector, and the step of allocating a huge page and the step of adding the map ID to a page table entry of the huge page are performed by a memory allocator.

### Claim 4 (depends on 3)

The method according to claim 3, further comprising, before the step of calculating a map ID, the step of transmitting a memory allocation request by a user program to the mapping selector, together with information on the matrix.

### Claim 5 (depends on 3)

The method according to claim 3, further comprising, after the step of adding the map ID to a page table entry of the huge page, the step of returning a virtual address of the huge page allocated by the memory allocator to a user program.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the matrix operation includes matrix-matrix multiplication and matrix-vector multiplication, wherein the matrix-matrix multiplication is performed by the SoC processor, and the matrix-vector multiplication is performed by the PIM processor.

### Claim 7 (depends on 6)

The method according to claim 6, wherein the matrix operation is a weight matrix operation used for large language model (LLM) inference.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the LLM inference includes a prefill phase and a decode phase, wherein the prefill phase includes the matrix-matrix multiplication performed by the SOC processor, and the decode phase includes the matrix-vector multiplication performed by the PIM processor.

### Claim 9 (depends on 8)

The method according to claim 8, wherein the LLM inference is performed by a single edge device.

### Claim 10 (depends on 1)

The method according to claim 1, wherein information on the matrix includes at least one among information on a dimension of the matrix and information on a data type of the matrix.

### Claim 11 (depends on 10)

The method according to claim 10, wherein information on the memory includes at least one among information on a size of the huge page of the memory, information on the number of channels of the memory, information on the number of ranks of the memory, and information on the number of banks of the memory.

### Claim 12 (depends on 11)

The method according to claim 11, wherein information on the PIM processor includes information on a chunk column.

### Claim 13 (depends on 12)

The method according to claim 12, wherein the map ID is determined to be different according to whether partitioning is needed, by comparing the size of the huge page with respect to a total number of banks in the memory with a row size of the matrix.

### Claim 14 (depends on 1)

The method according to claim 1, further comprising the steps of:
receiving a virtual address for storing or loading the matrix from a user program, after the step of adding the map ID to a page table entry of the huge page;
determining a physical address corresponding to the virtual address; and
determining a DRAM address of the memory corresponding to the physical address on the basis of the physical address and the map ID.

### Claim 15 (depends on 14)

The method according to claim 14, wherein the step of determining a DRAM address of the memory corresponding to the physical address is performed by a memory controller, a multiplexer of the memory controller receives the map ID as an input, and the memory controller includes a register for storing the map ID.

### Claim 16 (depends on 14)

The method according to claim 14, wherein mapping between the DRAM address of the memory and the physical address is abstracted to the user program.

### Claim 17

A computing device comprising:
a system-on-chip (SoC) processor; and
a memory including a processing-in-memory (PIM) processor, wherein
when a command related to a matrix operation stored in the memory is performed by the SoC processor and the PIM processor, the computing device performs:
an operation of calculating a map ID on the basis of at least one among information on the matrix, information on the memory, and information on the PIM processor;
an operation of allocating a huge page for representing some of the plurality of parameters; and
an operation of adding the map ID to a page table entry of the huge page for the matrix operation in the SoC processor.

### Claim 18

A computer program stored in a non-transitory computer-readable recording medium, wherein the program executes operations of performing a matrix a operation including plurality of parameters by a system-on-chip (SoC) processor and a processing-in-memory (PIM) processor in the memory when the computer program is performed by a computing device, and the operations include:
an operation of calculating a map ID on the basis of at least one among information on the matrix, information on the memory, and information on the PIM processor;
an operation of allocating a huge page for representing some of the plurality of parameters; and
an operation of adding the map ID to a page table entry of the huge page for the matrix operation in the SoC processor.
