Arbitration across shared memory pools of disaggregated memory devices

A data center system, comprising:

• a shared memory pool;
• a plurality of compute resources communicatively coupled to the shared memory pool;
• a memory pool controller (MPC) communicatively coupled between the shared memory pool and the plurality of compute resources to control data access, the MPC to:
• assign a bandwidth allocation to each compute resource according to a corresponding compute resource priority;
• receive a plurality data requests from the plurality of compute resources;
• assign a priority indicator to each of the plurality of data requests;
• and
• send memory access commands to the shared memory pool to fill each data request according to the priority indicator;
• and
• a priority arbitration unit (PAU) communicatively coupled to the MPC, the PAU to generate the priority indicator for each data request based on a compute resource priority assigned to each compute resource;
• and
• wherein the MPC further comprises a resource monitor unit to:
• monitor a bandwidth usage for each compute resource;
• and
• send the bandwidth usage for each compute resource to the PAU, wherein the PAU is further to:
• determine an available bandwidth of the shared memory pool;
• and
• if the available bandwidth is below an available bandwidth threshold, regulate the bandwidth allocations of at least a portion of the plurality of compute resources to maximize an overall bandwidth usage of the shared memory pool as a weighted function of the corresponding compute resource priority.

A method for memory pool arbitration, comprising:

• receiving, at a memory pool controller (MPC) communicatively coupled between a shared memory pool of disaggregated memory devices and a plurality of compute resources in a data center system, a plurality of data requests from the plurality of compute resources;
• assigning each compute resource to one of a set of compute resource priorities;
• sending memory access commands to the shared memory pool to perform each data request prioritized according to the set of compute resource priorities, wherein the plurality of data requests are arbitrated as a function of corresponding compute resource priorities;
• determining an available bandwidth of the shared memory pool;
• and
• regulating, when the available bandwidth is below an available bandwidth threshold, bandwidth allocations of at least a portion of the plurality of compute resources to maximize an overall bandwidth usage of the shared memory pool as a weighted function of the set of compute resource priorities.