Determining target calculation models that need memory allocation

An electronic apparatus, comprising a processor and a memory, the memory having a computer program stored therein, wherein when the computer program executed by the processor it performs a memory allocation method, the memory allocation method comprises:

• determining a plurality of target calculation models that need memory allocation;
• determining a target tensor of each of the target calculation models which a memory occupancy is needed during a calculation process;
• determining, according to lifecycles of the target tensors, a target memory space occupied by each of the target calculation models during the calculation process;
• determining, according to the target memory spaces occupied by the target calculation models, a total memory space occupied by the target calculation models during the calculation process;
• and
• allocating, according to the total memory space, a portion of memory of the electronic apparatus to execute the target calculation models,
• wherein the determining a target tensor of each of the target calculation models which a memory occupancy is needed during a calculation process comprises:
• performing a topology analysis on each of the target calculation models to obtain a topology of operators in each of the target calculation models;
• sorting depth priorities of the operators in each of the target calculation models according to the topology to obtain sorting information;
• grouping each of the target calculation models into a plurality of operator sets according to the sorting information of each of the target calculation models;
• and
• determining the target tensor of the operator sets included in each of the target calculation models which the memory occupancy is needed during the calculation process;
• wherein, the operator sets comprise at least one predetermined type of operator, and a shape of an input tensor and a shape of an output tensor of the predetermined type of operator are different.

A memory allocation method, applied to an electronic apparatus, the method comprising:

• determining a plurality of target calculation models that need memory allocation;
• determining a target tensor of each of the target calculation models which a memory occupancy is needed during a calculation process;
• determining, according to lifecycles of the target tensors, a target memory space occupied by each of the target calculation models during the calculation process;
• determining, according to the target memory spaces occupied by the target calculation models, a total memory space occupied by the target calculation models during the calculation process;
• and
• allocating, according to the total memory space, a portion of memory of the electronic apparatus to execute the target calculation models,
• wherein the determining, according to the lifecycles of the target tensors, the target memory space occupied by each of the target calculation models during the calculation process comprises:
• pre-allocating, according to the lifecycles of the target tensors and constraints that a target tensor in a living state occupies a memory space and a memory space for a target tensor in a non-living state is released, the memory space to each of the target calculation models;
• and
• determining the memory space pre-allocated to each of the target calculation models as the target memory space of the memory occupied by each of the target calculation models during the calculation process.