Systems and methods for modeling a deployment of heterogeneous memory on a server network

A method for modeling a deployment of heterogeneous memory on a server network, the method comprising:

• receiving a user input of parameters including a memory ratio of local memory to heterogeneous memory in each server computing device, a first relative throughput when an entire dataset is in local memory on a server computing device, and a second relative throughput when the entire dataset is in heterogeneous memory on the server computing device;
• based on the parameters, determining a server ratio of a number of server computing devices, each server computing device executing data-processing workloads, in an enhanced cluster with heterogeneous memory to a number of server computing devices in a baseline cluster without heterogeneous memory, wherein the enhanced cluster and the baseline cluster deliver equivalent data throughput performance for the data-processing workloads;
• based on the parameters and the server ratio, generating a server network design;
• and
• outputting the server network design, wherein
• the local memory is local DRAM;
• and
• the heterogeneous memory is Compute Express Link (CXL)-attached DRAM.

A computing system for modeling a deployment of heterogeneous memory on a server network, the system comprising:

• processing circuitry and memory storing instructions which are executed by the processing circuitry to:
• receive a user input of parameters including a memory ratio of local memory to heterogeneous memory in each server computing device, a first relative throughput when an entire dataset is in local memory on a server computing device, and a second relative throughput when the entire dataset is in heterogeneous memory on the server computing device;
• based on the parameters, determine a server ratio of a number of server computing devices, each server computing device executing data-processing workloads, in an enhanced cluster with heterogeneous memory to a number of server computing devices in a baseline cluster without heterogeneous memory, wherein the enhanced cluster and the baseline cluster deliver equivalent data throughput performance for the data-processing workloads;
• based on the server ratio and a relative Total Cost of Ownership (TCO) comparing a TCO of an enhanced server computing device equipped with heterogeneous memory relative to a TCO of a baseline server computing device without heterogeneous memory, calculate a TCO savings value indicating a percentage reduction of TCO that is predicted by deploying heterogeneous memory in the server computing devices in accordance with the inputted parameters;
• and
• output the TCO savings value and the server ratio, wherein
• the local memory is local DRAM;
• and
• the heterogeneous memory is Compute Express Link (CXL)-attached DRAM.