Multi-level intermediate representation decoder for heterogeneous platforms

A computing device comprising:

• one or more processors;
• and
• a non-transitory computer-readable memory storing instructions executable by the one or more processors, wherein the one or more processors are configured to:
• obtain a neural network model, wherein the neural network model is programed to run on at least one platform;
• obtain an initial intermediate representation (IR) code by encoding the neural network model, and obtaining a target IR code by adding decorations to the initial IR code based on a target platform;
• and
• output an executable code optimized to run on the target platform by decoding the target IR code.

A non-transitory computer-readable storage medium storing a plurality of programs for execution by a computing device having one or more processors, wherein the plurality of programs, when executed by the one or more processors, cause the computing device to perform acts comprising:

• obtaining a neural network model, wherein the neural network model is programed to run on at least one platform;
• obtaining an initial intermediate representation (IR) code by encoding the neural network model, and obtaining a target IR code by adding decorations to the initial IR code based on a target platform;
• and
• outputting an executable code optimized to run on the target platform by decoding the target IR code.