Managing a data structure for allocating graphics processing unit resources to virtual machines

A non-transitory computer-readable medium stored in a server computing system containing content for managing a graphics processing unit (GPU) allocation data structure for allocating physical GPU resources, including processing bandwidth, to one or more virtual machines, the data structure comprising a plurality of virtual machine entries each containing a designation of a virtual machine, an indication of a GPU benefit factor associated with the designated virtual machine, and an indication of processing bandwidth requirements associated with the designated virtual machine, by performing a method comprising:

• ordering the plurality of virtual machine entries based at least upon the GPU benefit factor associated with each designated virtual machine;
• determining the processing capacity of one or more physical GPUs associated with the server computing system;
• determining one or more entries of the GPU allocation data structure to which to assign to the corresponding designated virtual machines a portion of the processing bandwidth resources of the one or more physical GPUs, the determining based upon matching the indicated processing bandwidth requirements associated with each corresponding designated virtual machine to the determined processing capacities of the one or more physical GPUs;
• and
• causing processing bandwidth resources of the one or more physical GPUs to be allocated to the designated one or more virtual machines corresponding to the determined one or more entries of the GPU allocation data structure.

A computing system, comprising:

• a memory;
• a computer processor;
• and
• a GPU allocation data structure specifying a plurality of virtual machine entries each containing a designation of a virtual machine, an indication of a GPU benefit factor associated with the designated virtual machine, and an indication of processing bandwidth requirements associated with the designated virtual machine;
• virtualization logic, stored in the memory, and configured, when executed on the computer processor, to:
• dynamically allocate physical GPU resources of one or more physical GPUs among the plurality of virtual machines by:
• rank ordering the plurality of virtual machine entries of the GPU allocation data structure according to the GPU benefit factor associated with each designated virtual machine;
• determining the processing capacity of the one or more physical GPU resources;
• determining a subset of the rank ordered entries of the GPU allocation data structure having designated virtual machines that can use the one or more physical GPU resources based upon the determined processing capacities of the one or more physical GPU resources as compared to the indicated processing requirements of virtual machines designated by some of the plurality of virtual machine entries in rank order;
• and
• allocating a virtual GPU to each virtual machine designated by the determined subset of GPU allocation data structure entries.