US 2025/0147740 A1 · Method of Compiling Neural Network Model, Compiler, and Storage Medium

Method of Compiling Neural Network Model, Compiler, and Storage Medium

AssigneesVerisilicon Microelectronics (Beijing) Co., Ltd., VeriSilicon Microelectronics (Shanghai) Co., Ltd., VeriSilicon Microelectronics (Nanjing) Co., Ltd., Verisilicon Technology (Shanghai) Co., Ltd., Verisilicon Microelectronics (Hainan) Co., Ltd., Verisilicon Microelectronics (Chengdu) Co., Ltd.

InventorYang Zhang

Life of this patent

Estimating the term…

Abstract

Provided are a method of compiling a neural network model, a compiler, and a computer-readable storage medium. The method of compiling a neural network model includes reading a target neural network model and obtaining the target accelerator info; generating a first directed graph corresponding to the target neural network by using operation elements as nodes and dependencies between the operation elements as edges, wherein the operation elements include operation types and accompanying parameters of the operation types; revising the first directed graph based on a software and hardware information supported by the target accelerator to generate a second directed graph; and generating a compilation result of the target neural network model based on the second directed graph.

Claims20

Dependent claims

A method of compiling a neural network model, comprising:

reading a target neural network model and obtaining a target accelerator info;
generating a first directed graph corresponding to the target neural network by using operation elements as nodes and dependencies between the operation elements as edges,
wherein the operation elements comprise operation types and accompanying parameters of the operation types;
revising the first directed graph based on a software and hardware information supported by the target accelerator to generate a second directed graph;
and
generating a compilation result of the target neural network model based on the second directed graph.

3 more elements

A compiler of a neural network model, comprising:

an input module, wherein the input module is configured for reading a target neural network model and obtaining the target accelerator info;
a conversion module, wherein the conversion module is configured for generating a first directed graph corresponding to the target neural network by using operation elements as nodes and dependencies between the operation elements as edges, wherein the operation elements comprise operation types and accompanying parameters of the operation types;
a revision module, wherein the revision module is configured for revising the first directed graph based on a software and hardware information supported by the target accelerator to generate a second directed graph;
and
a compilation module, wherein the compilation module is configured for generating a compilation result of the target neural network model based on the second directed graph.

2 more elements

Dependencies are inferred from the claim text.