Methods, systems, and non-transitory storage media for graphics memory allocation

A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform one or more operations, comprising:

• in response to a graphics memory allocation request for graphics memory needed during running of a target task comprising multiple sub-tasks that are serial, classifying target data generated during running of each sub-task of the multiple sub-tasks, wherein the graphics memory allocation request is generated during the running of the target task, wherein a type of the target data comprises at least first data, and wherein the first data is not used by a subsequent sub-task;
• allocating multiple target graphics memory pools to the multiple sub-tasks, wherein the multiple sub-tasks are in a one-to-one correspondence with the multiple target graphics memory pools, and wherein a capacity of each target graphics memory pool of the multiple target graphics memory pools is determined using at least one forward inference;
• dividing each target graphics memory pool of the multiple target graphics memory pools into at least one graphics memory block based on a type of the target data, wherein the at least one graphics memory block comprises at least a first graphics memory block corresponding to the first data, and wherein multiple first graphics memory blocks corresponding to the multiple sub-tasks are mapped to a same target physical memory address, wherein only one of the multiple first graphics memory blocks occupies the same target physical memory address at a time;
• and
• upon completion of a current sub-task, clearing graphics memory space corresponding to the same target physical memory address that stored the first data of the current sub-task, wherein the graphics memory space is available for storing the first data of a next sub-task.

A computer-implemented system, comprising:

• one or more computers;
• and
• one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform one or more operations, comprising:
• in response to a graphics memory allocation request for graphics memory needed during running of a target task comprising multiple sub-tasks that are serial, classifying target data generated during running of each sub-task of the multiple sub-tasks, wherein the graphics memory allocation request is generated during the running of the target task, wherein a type of the target data comprises at least first data, and wherein the first data is not used by a subsequent sub-task;
• allocating multiple target graphics memory pools to the multiple sub-tasks, wherein the multiple sub-tasks are in a one-to-one correspondence with the multiple target graphics memory pools, and wherein a capacity of each target graphics memory pool of the multiple target graphics memory pools is determined using at least one forward inference;
• dividing each target graphics memory pool of the multiple target graphics memory pools into at least one graphics memory block based on a type of the target data, wherein the at least one graphics memory block comprises at least a first graphics memory block corresponding to the first data, and wherein multiple first graphics memory blocks corresponding to the multiple sub-tasks are mapped to a same target physical memory address, wherein only one of the multiple first graphics memory blocks occupies the same target physical memory address at a time;
• and
• upon completion of a current sub-task, clearing graphics memory space corresponding to the same target physical memory address that stored the first data of the current sub-task, wherein the graphics memory space is available for storing the first data of a next sub-task.