Smart round robin delivery for hardware security module host requests

A computer program product comprising a computer readable storage medium having computer readable instructions stored therein, wherein the computer readable instructions for handling host requests on a hardware security module (HSM), when executed on a computing device, causes the computing device to:

• select a domain with a longest wait time with a host request for the HSM;
• select an oldest host request requested by the domain;
• determine a hardware engine type in the HSM required to process the oldest host request;
• determine a saturation level of the hardware engine type exceeds a saturation threshold for the hardware engine type, wherein the saturation level indicates a usage of the hardware engine type;
• select a second host request requested by the domain that uses a different hardware engine type based on the saturation level exceeding the saturation threshold;
• and
• process, by the HSM, the second host request using the different hardware engine type of the HSM.

A system for handling host requests on a hardware security module (HSM), the system comprising:

• a memory;
• a processor;
• local data storage having stored thereon computer executable code, wherein the computer executable code includes program instruction executable by a processor to cause the processor to perform a method;
• a central processing unit (CPU) receiving buffer configured to store incoming host request blocks from tenants sending requests to the HSM;
• a set of domains configured to correspond to the tenants accessing the HSM;
• a system in-use engine table configured to store engine types in use by the HSM;
• a system engine threshold table configured to store engine types provided by the HSM and a number of engines for each of the engine types within the HSM, wherein the system engine threshold table is maintained for the HSM indicating a threshold for the engine types;
• and
• a selector configured to select the host request blocks based on their position in an active domain linked list and a saturation level of an engine type required to process the host request blocks.