# US 2026/0065043 A1 · Heterogeneous Neural Processing System with Line-Based Depth-First Scheduling for Generative AI Models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065043 A1
- Document ID: US20260065043A1
- Status: Published application
- Kind: A1
- Application number: 19/291,571
- Filed: 2025-08-05
- Published: 2026-03-05
- Earliest claimed: 2024-08-30
- Assignees: Mediatek Inc.
- Applicants: Mediatek Inc.
- Inventors: Shih-Wei Hsieh; Ming-En Shih; Ming-Hung Lin; Ping-Yuan Tsai
- Web page: https://patentgrep.com/patent/US20260065043A1

## CPC

- G06N 3/063: using electronic means
- G06N 3/045: Combinations of networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0475: Generative networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A heterogeneous neural processing system includes a first processor configured to execute encoding and decoding operations of an autoencoder, and a second processor configured to execute task-specific neural network operations with iterative processing. The processors execute computational tasks with synchronized data exchange to implement generative AI models. The first processor processes feature maps divided into lines of data with line-based depth-first scheduling, caches data in activation memory, and selects operations deeper in network hierarchy while handling branched inputs, outputs, and residual connections. An H-reuse cache stores boundary pixels between spatial segments, enabling concurrent execution of convolution and element-wise operations. A neural network conditioning device analyzes models to identify layer dependencies, applies search space constraints, performs iterative searches to generate fusion schedules, and selects optimal schedules based on external memory access and execution latency.

## Claims

### Claim 1

A heterogeneous neural processing system comprising:
a first processor configured to execute an encoding operation and a decoding operation of an autoencoder; and
a second processor configured to execute a task-specific neural network operation that performs iterative processing;
wherein the first processor and the second processor execute computational tasks with synchronized data exchange to implement a generative AI model.

### Claim 2 (depends on 1)

The system of claim 1, wherein the encoding operation transforms input data into latent representations and the decoding operation reconstructs latent representations back into output data.

### Claim 3 (depends on 1)

The system of claim 1, wherein the first processor executes the encoding operation and the decoding operation while the second processor concurrently executes the task-specific neural network operation on data of the same generative AI model.

### Claim 4 (depends on 1)

The system of claim 1, wherein the first processor is further configured to:
process feature maps of a neural network divided into a plurality of lines of data;
cache the plurality of lines of data in an activation memory; and
determine whether a required portion of the plurality of lines of data are cache in the activation memory and select operations that are deeper in a network hierarchy.

### Claim 5 (depends on 4)

The system of claim 4, wherein the neural network comprises branched inputs, branched outputs, and residual connections processed within a fused layer stack.

### Claim 6 (depends on 4)

The system of claim 4, wherein the first processor is further configured to assign memory addresses for cached lines of data having different heights and overlapping live ranges.

### Claim 7 (depends on 1)

The system of claim 1, wherein the first processor comprises an H-reuse cache configured to store boundary pixels between adjacent spatial segments.

### Claim 8 (depends on 7)

The system of claim 7, wherein the first processor is further configured to execute a convolution and an element-wise operation concurrently, and the element-wise operation comprise addition and/or concatenation.

### Claim 9 (depends on 7)

The system of claim 7, wherein the first processor further comprises ping-pong buffers configured to fetch a next data segment while a current segment is being processed.

### Claim 10 (depends on 7)

The system of claim 7, wherein the H-reuse cache stores boundary pixels between spatial segments having kernel dimensions, dilation rate, and stride.

### Claim 11 (depends on 1)

The system of claim 1, further comprising a neural network conditioning device configured to:
analyze a neural network model to identify layer dependencies and fusion boundaries;
apply constraints to a search space based on memory capacity and processing capacity to define fusion configurations;
perform an iterative search within the search space to generate a plurality of fusion schedules; and
select a fusion schedule from the plurality of fusion schedules based on external memory access and execution latency.

### Claim 12 (depends on 11)

The system of claim 11, wherein the neural network conditioning device is further configured to limit branching factors and fusion depth.

### Claim 13 (depends on 11)

The system of claim 11, wherein the neural network conditioning device is further configured to generate a plurality of fusion configurations and select a configuration of the plurality of fusion configurations based on external memory access and execution latency.

### Claim 14 (depends on 11)

The system of claim 11, wherein the neural network conditioning device is further configured to assign activation memory addresses for operations having different data heights and non-overlapping temporal execution windows.

### Claim 15 (depends on 11)

The system of claim 11, wherein the neural network conditioning device is further configured to process neural network topologies having skip connections and residual connections.

### Claim 16 (depends on 1)

The system of claim 1, wherein the task-specific neural network operation comprises denoising operations performed by a U-Net architecture.

### Claim 17 (depends on 1)

The system of claim 1, wherein the task-specific neural network operation comprises a conditioning operation that encodes semantic vectors or textual token embeddings into latent space representations.

### Claim 18 (depends on 1)

The system of claim 1, wherein the task-specific neural network operation comprises attention mechanisms having query, key, and value components.

### Claim 19 (depends on 1)

The system of claim 1, wherein the generative AI model comprises a latent diffusion model for text-to-image generation.

### Claim 20 (depends on 1)

The system of claim 1, wherein the generative AI model comprises an image restoration model for super-resolution or face restoration.
