Recovering and restoring dma buffers in a genai model by an electronic device

An electronic device for recovering and restoring DMA buffers associated with a GenAI model, comprising:

• at least one processor;
• memory coupled to the at least one processor;
• and
• a DMA buffer controller communicatively coupled to the at least one processor and the memory, wherein the DMA buffer controller is configured to:
• obtain a state of the GenAI model based on one or more parameters;
• determine a trigger for a GenAI model memory shrinker (GAMS) based on the state of the GenAI model;
• determine at least one buffer from a plurality of DMA buffers associated with the GenAI model that are safe for recovering based on triggering the GAMS;
• execute a GAMS memory recovery operation for the at least one DMA buffer from the plurality of DMA buffers;
• and
• execute a GAMS buffer restore operation for the at least one DMA buffer from the plurality of DMA buffers, wherein the GAMS buffer restore operation comprises an explicit restore operation and an implicit restore operation.

A non-transitory computer readable medium storing instructions for recovering and restoring direct memory access (DMA) buffers associated with a generative artificial intelligence (GenAI) model, the instructions that when executed by at least one processor of an electronic device cause the electronic device to:

• obtain a state of the GenAI model based on one or more parameters;
• determine a trigger for a GenAI model memory shrinker (GAMS) based on the state of the GenAI model;
• determine at least one buffer from a plurality of DMA buffers associated with the GenAI model that are safe for recovering based on triggering the GAMS;
• execute a GAMS memory recovery operation for the at least one DMA buffer from the plurality of DMA buffers;
• and
• execute a GAMS buffer restore operation for the at least one DMA buffer from the plurality of DMA buffers.