Heterogeneous Neural Processing System with Line-Based Depth-First Scheduling for Generative AI Models
AssigneeMediatek Inc.
InventorsShih-Wei Hsieh, Ming-En Shih, Ming-Hung Lin, Ping-Yuan Tsai
Life of this patent
Estimating the term…
Loading patent…
AssigneeMediatek Inc.
InventorsShih-Wei Hsieh, Ming-En Shih, Ming-Hung Lin, Ping-Yuan Tsai
Estimating the term…
A heterogeneous neural processing system includes a first processor configured to execute encoding and decoding operations of an autoencoder, and a second processor configured to execute task-specific neural network operations with iterative processing. The processors execute computational tasks with synchronized data exchange to implement generative AI models. The first processor processes feature maps divided into lines of data with line-based depth-first scheduling, caches data in activation memory, and selects operations deeper in network hierarchy while handling branched inputs, outputs, and residual connections. An H-reuse cache stores boundary pixels between spatial segments, enabling concurrent execution of convolution and element-wise operations. A neural network conditioning device analyzes models to identify layer dependencies, applies search space constraints, performs iterative searches to generate fusion schedules, and selects optimal schedules based on external memory access and execution latency.
A heterogeneous neural processing system comprising:
Dependencies are inferred from the claim text.