Method and Device for Memory Planning for Code Generation to Create Program Code for Computing an Artificial Neural Network in a Hardware Environment

A computer-implemented method for performing memory planning for code generation to generate a code for computing a neural network in a hardware environment, comprising:

• providing successive calculation steps of network layers of the neural network, wherein for each calculation step the size of an input data block, an output data block and, depending on the type of calculation step, one or more model parameter blocks is determined, wherein the one or more model parameter blocks have model parameters for a respective calculation step;
• determining a rule for memory planning for a specific calculation step, the model parameters are used and for which a tiling calculation step is to be provided, which provides that the tiling calculation step provides for performing a tiling for the specific calculation step in a plurality of individual calculation steps for processing the input data of a respective section of the input data block (EB), wherein the rule specifies that the model parameters for all individual calculation steps are stored in a specified memory space;
• performing memory planning, in which the memory space of the respective input data block, output data block, and model parameter block is determined in the working memory for each calculation step, taking into account the determined rules;
• and
• performing code generation, wherein the model parameter block is copied into the working memory only before executing the first individual calculation step, and the calculations of the remaining individual calculation steps are performed using the model parameters in the model parameter block.