Processing unit virtualization with scalable over-provisioning in an information processing system

A method comprising:

• obtaining a request from a client for allocation of one or more virtualized processing units to execute at least a portion of a given application, wherein the one or more virtualized processing units are part of a plurality of virtualized processing units implemented on one or more servers;
• accessing a data structure that maps a correspondence between the plurality of virtualized processing units and a plurality of abstracted processing units, wherein the plurality of abstracted processing units are configured to decouple an allocation decision from the plurality of virtualized processing units, and further wherein at least one of the virtualized processing units is mapped to multiple ones of the abstracted processing units;
• and
• allocating one or more virtualized processing units to execute the portion of the given application by allocating one or more abstracted processing units identified from the data structure;
• wherein the obtaining, accessing, and allocating steps are performed by a processing platform comprising at least one processor coupled to at least one memory executing program code.

A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device cause the at least one processing device to:

• obtain a request from a client for allocation of one or more virtualized processing units to execute at least a portion of a given application, wherein the one or more virtualized processing units are part of a plurality of virtualized processing units implemented on one or more servers;
• access a data structure that maps a correspondence between the plurality of virtualized processing units and a plurality of abstracted processing units, wherein the plurality of abstracted processing units are configured to decouple an allocation decision from the plurality of virtualized processing units, and further wherein at least one of the virtualized processing units is mapped to multiple ones of the abstracted processing units;
• and
• allocate one or more virtualized processing units to execute the portion of the given application by allocating one or more abstracted processing units identified from the data structure.