# US 2026/0073181 A1 · Palettization of kernel vector in neural network processor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073181 A1
- Document ID: US20260073181A1
- Status: Published application
- Kind: A1
- Application number: 18/827,358
- Filed: 2024-09-06
- Published: 2026-03-12
- Earliest claimed: 2024-09-06
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Sung Hee PARK; Ji Liang Song
- Web page: https://patentgrep.com/patent/US20260073181A1

## CPC

- G06N 3/02: Neural networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Embodiments of the present disclosure relate to decompressing a kernel for neural network operations in a neural processor circuit using a look-up table (LUT) with each of its entries associated with kernel coefficients. Index data in compressed kernel data includes indices, such as a first index and a second index that identify entries in the LUT. A kernel extract circuit is configured to extract the LUT and index data from the kernel data, and assemble an uncompressed kernel data by combining first kernel coefficients identified by the first index with second kernel coefficients identified by the second index.

## Claims

### Claim 1

A neural processor circuit, comprising:
a kernel access circuit configured to access kernel data comprising:
a look-up table (LUT) having a plurality of entries, wherein a first entry of the plurality of entries is identified by a first index and comprises a first plurality of kernel coefficients and a second entry of the plurality of entries is identified by a second index and comprises a second plurality of kernel coefficients; and
index data comprising a plurality of indices including the first index and the second index; and
a neural engine circuit configured to receive the kernel data from the kernel access circuit, the neural engine circuit comprising:
a kernel extract circuit configured to:
extract the LUT and index data from the kernel data; and
assemble an uncompressed kernel data by combining the first plurality of kernel coefficients with the second plurality of kernel coefficients; and
a multiply-add (MAD) circuit coupled to the kernel extract circuit and configured to:
receive the uncompressed kernel data; and
perform neural network operations on a portion of input data using the uncompressed kernel data.

### Claim 2 (depends on 1)

The neural processor circuit of claim 1, wherein each entry of the plurality of entries in the LUT comprises a same number of kernel coefficients.

### Claim 3 (depends on 1)

The neural processor circuit of claim 1, wherein the first plurality of kernel coefficients in the first entry identified by the first index comprises a zero.

### Claim 4 (depends on 1)

The neural processor circuit of claim 1, wherein each kernel coefficient of the first plurality of kernel coefficients in the first entry identified by the first index comprises a zero.

### Claim 5 (depends on 1)

The neural processor circuit of claim 1, wherein the kernel extract circuit comprises a kernel look-ahead buffer configured to store information on one or more locations associated with one or more kernel coefficients in the uncompressed kernel data being zero, and wherein the MAD circuit is further configured to receive the information on the one or more locations to skip multiply-add operations associated with the one or more kernel coefficients that are zero.

### Claim 6 (depends on 1)

The neural processor circuit of claim 1, wherein the kernel data comprises:
a MAD parameter for configuring operations of the MAD circuit; and
a post-processor parameter for configuring a post-processor circuit in the neural engine circuit.

### Claim 7 (depends on 6)

The neural processor circuit of claim 6, wherein the kernel extract circuit is further configured to:
extract the MAD parameter and the post-processor parameter from the kernel data;
send the MAD parameter to the MAD circuit; and
send the post-processor parameter to the post-processor circuit.

### Claim 8 (depends on 1)

The neural processor circuit of claim 1, wherein the kernel data further comprises a block sparse mask comprising a string of zeros and ones, and wherein the kernel extract circuit is further configured to:
extract the block sparse mask; and
assemble the uncompressed kernel data by combining a set of zeros indicated by a ‘0’ in the block sparse mask into the uncompressed kernel data.

### Claim 9 (depends on 8)

The neural processor circuit of claim 8, wherein the block sparse mask is generated during a compilation process prior to the kernel data being accessed by the kernel access circuit.

### Claim 10

A method of operating a neural processor circuit, comprising:
accessing, by a kernel access circuit, kernel data comprising:
a look-up table (LUT) having a plurality of entries, wherein a first entry of the plurality of entries is identified by a first index and comprises a first plurality of kernel coefficients and a second entry of the plurality of entries is identified by a second index and comprises a second plurality of kernel coefficients; and
index data comprising a plurality of indices including the first index and the second index;
extracting, by the kernel extract circuit, the LUT and index data from the kernel data;
assembling an uncompressed kernel data by combining the first plurality of kernel coefficients with the second plurality of kernel coefficients; and
performing, by a multiply-add (MAD) circuit coupled to the kernel extract circuit, neural network operations on a portion of input data using the uncompressed kernel data.

### Claim 11 (depends on 10)

The method of claim 10, wherein each of the plurality of entries in the LUT comprises a same number of kernel coefficients.

### Claim 12 (depends on 10)

The method of claim 10, wherein the first plurality of kernel coefficients in the first entry identified by the first index comprises a zero.

### Claim 13 (depends on 10)

The method of claim 10, wherein each kernel coefficient of the first plurality of kernel coefficients in the first entry identified by the first index comprises a zero.

### Claim 14 (depends on 10)

The method of claim 10, wherein the kernel data comprises:
a MAD parameter for configuring operations of the MAD circuit; and
a post-processor parameter for configuring a post-processor circuit in the neural engine circuit.

### Claim 15 (depends on 10)

The method of claim 10, wherein the kernel data further comprises a block sparse mask comprising a string of zeros and ones, and wherein the method further comprises:
extracting the block sparse mask; and
assembling the uncompressed kernel data by combining a set of zeros indicated by a ‘0’ in the block sparse mask into the uncompressed kernel data.

### Claim 16

An electronic device, comprising:
a system memory storing input data; and
a kernel access circuit configured to access kernel data comprising:
a look-up table (LUT) having a plurality of entries, wherein a first entry of the plurality of entries is identified by a first index and comprises a first plurality of kernel coefficients and a second entry of the plurality of entries is identified by a second index and comprises a second plurality of kernel coefficients; and
index data comprising a plurality of indices including the first index and the second index; and
a neural engine circuit configured to receive the kernel data from the kernel access circuit, the neural engine circuit comprising:
a kernel extract circuit configured to:
extract the LUT and index data from the kernel data; and
assemble an uncompressed kernel data by combining the first plurality of kernel coefficients with the second plurality of kernel coefficients; and
a multiply-add (MAD) circuit coupled to the kernel extract circuit and configured to:
receive the uncompressed kernel data; and
perform neural network operations on a portion of the input data using the uncompressed kernel data.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein the first plurality of kernel coefficients in the first entry identified by the first index comprises a zero.

### Claim 18 (depends on 16)

The electronic device of claim 16, wherein each kernel coefficient of the first plurality of kernel coefficients in the first entry identified by the first index comprises a zero.

### Claim 19 (depends on 16)

The electronic device of claim 16, wherein the kernel extract circuit comprises a kernel look-ahead buffer configured to store information on one or more locations associated with one or more kernel coefficients in the uncompressed kernel data being zero, and wherein the MAD circuit is further configured to receive the information on the one or more locations to skip multiply-add operations associated with the one or more kernel coefficients that are zero.

### Claim 20 (depends on 16)

The electronic device of claim 16, wherein the kernel data comprises:
a MAD parameter for configuring operations of the MAD circuit; and
a post-processor parameter for configuring a post-processor circuit in the neural engine circuit.
