Dynamic memory sharing between xpus based on system heuristics and real time adjustments

A system, comprising:

• a dynamic memory management circuit, comprising
• one or more interfaces configured to receive data from a memory subsystem, the data describing memory allocation requests from one or more accelerator processing units during a predefined first time period;
• and one or more processors coupled to the one or more interfaces and configured to:
• dynamically determine memory space to be allocated to a central processing unit and the one or more accelerator processing units in accordance with a memory allocation policy, the memory allocation policy comprising:
• allocating a minimum memory space required for an operating system executed by the central processing unit;
• allocating a minimum memory space required by the central processing unit to fulfill a predefined quality of service requirement;
• one or more rules to amend memory space to be allocated to the central processing unit and the one or more accelerator processing units based on the data received from the memory subsystem;
• wherein the one or more processors are further configured to instruct to allocate memory for the central processing unit and the one or more accelerator processing units in accordance with the determined memory space to be allocated;
• the system further comprising system memory coupled to the dynamic memory management circuit.

A dynamic memory management circuit, comprising:

• means for receiving data from a memory subsystem, the data describing memory allocation requests from one or more accelerator processing units during a predefined first time period;
• means for dynamically determining memory space to be allocated to a central processing unit and the one or more accelerator processing units in accordance with a memory allocation policy
• wherein the memory allocation policy comprises:
• allocating a minimum memory space required for an operating system executed by the central processing units;
• allocating a minimum memory space required by the one or more central processing units to fulfil a predefined quality of service requirement;
• one or more rules to amend memory space to be allocated to the central processing unit and the one or more accelerator processing units based on the data received from the memory subsystem;
• means for instructing to allocate memory for the one or more CPU and the one or more accelerator processing units in accordance with the determined memory space to be allocated.