# US 2026/0064413 A1 · Storage instruction for matrix multiply-accumulate operations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0064413 A1
- Document ID: US20260064413A1
- Status: Published application
- Kind: A1
- Application number: 18/819,931
- Filed: 2024-08-29
- Published: 2026-03-05
- Earliest claimed: 2024-08-29
- Assignees: NVIDIA Corporation
- Applicants: NVIDIA Corporation
- Inventors: Harold Carter Edwards; Vijay Harshad Thakkar; Gokul Ramaswamy Hirisave Chandra Shekhara; Edward H. Gornish; Rishkul Kulkarni; Maciej Piotr Tyrlik; Sean Jeffrey Treichler; Chao Li
- Web page: https://patentgrep.com/patent/US20260064413A1

## CPC

- G06F 9/30036: {Instructions to perform operations on packed data, e.g. vector, tile or matrix operations}
- G06F 9/3001: {Arithmetic instructions}
- G06F 9/3885: {using a plurality of independent parallel functional units}
- G06F 13/1663: {Access to shared memory}
- G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Apparatuses, systems, and techniques to perform an instruction to use storage to store information to be used exclusively by one or more tensor operations. In at least one embodiment, a processor retrieves information from storage that exclusively stores matrix information in response to an instruction and performs a multiplication computation using said matrix information.

## Claims

### Claim 1

One or more processors comprising:
circuitry to:
perform a matrix multiply accumulate (MMA) instruction, the MMA instruction to use memory storage exclusively allocated to the MMA instruction to store information to be used by the MMA instruction, wherein the information comprises one or more operands and one or more accumulated results from performing the MMA instruction.

### Claim 2 (depends on 1)

The one or more processors of claim 1, wherein the information stored in the memory storage comprises matrix information generated in response to the MMA instruction.

### Claim 3 (depends on 1)

The one or more processors of claim 1, wherein the memory storage comprises at least one of a tensor memory and a shared memory of the processor.

### Claim 4 (depends on 1)

The one or more processors of claim 1, wherein the MMA instruction comprises a single instruction that controls a plurality of processor cores.

### Claim 5 (depends on 1)

The one or more processors of claim 1, wherein the memory storage comprises a first memory and a second memory; and the information to be used comprises a first portion of an operand stored in the first memory and a second portion of the operand stored in the second memory.

### Claim 6 (depends on 1)

The one or more processors of claim 1, wherein the MMA instruction causes the processor to perform a matrix multiplication computation that generates the information stored in the storage.

### Claim 7 (depends on 1)

The one or more processors of claim 1, further comprising a plurality of processor cores, wherein the memory storage is accessible by the plurality of processor cores.

### Claim 8

A system comprising: one or more processors having circuitry to:
perform a matrix multiply accumulate (MMA) instruction, the MMA instruction to use memory storage exclusively allocated to the MMA instruction to store information to be used by the MMA instruction, wherein the information comprises one or more operands and one or more accumulated results from performing the MMA instruction.

### Claim 9 (depends on 8)

The system of claim 8, wherein the one or more processors are further to perform a thread comprising the MMA instruction that causes the information to be stored in the memory storage.

### Claim 10 (depends on 8)

The system of claim 8, wherein the information stored in the memory storage comprises accumulated results of one or more matrix multiplication computations.

### Claim 11 (depends on 8)

The system of claim 8, wherein the one or more processors are further to perform an MMA operation in response to the MMA instruction concurrently with one or more second operations.

### Claim 12 (depends on 8)

The system of claim 8, wherein the information stored in the memory storage comprises matrix information generated in response to the MMA instruction.

### Claim 13 (depends on 8)

The system of claim 8, further comprising: a first memory and a second memory; and the information stored comprises a first portion of an operand stored in the first memory and a second portion of the operand stored in the second memory.

### Claim 14 (depends on 8)

The system of claim 8, further comprising: a first memory and a second memory; and the information stored comprises a first operand stored in the first memory and a second operand stored in the second memory.

### Claim 15

A method comprising: performing a matrix multiply accumulate (MMA) instruction, the MMA instruction to use memory storage exclusively allocated to the MMA instruction to store information to be used by the MMA instruction, wherein the information comprises one or more operands and one or more accumulated results from performing the MMA instruction.

### Claim 16 (depends on 15)

The method of claim 15, wherein the memory storage comprises a first memory and a second memory; and the information to be used comprises a first portion of an operand stored in the first memory and a second portion of the operand stored in the second memory.

### Claim 17 (depends on 15)

The method of claim 15, wherein the memory storage comprises a first memory and a second memory; and the information to be used comprises a first operand stored in the first memory and a second operand stored in the second memory.

### Claim 18 (depends on 15)

The method of claim 15, further comprising: performing one or more second instructions concurrently with the MMA instruction.

### Claim 19 (depends on 15)

The method of claim 15, wherein the memory storage comprises at least one of a tensor memory and a shared memory of a processor.

### Claim 20 (depends on 15)

The method of claim 15, wherein the MMA instruction comprises a single instruction that controls a single processor core.
