Dynamic virtual resource request rate control for utilizing physical resources

A method, comprising:

• performing, by one or more computing devices that together implement a virtualization host for a plurality of virtual compute instances:
• placing a work request for a virtual computer resource from an individual virtual resource request queue maintained for a virtual compute instance into a physical resource request queue to perform the work request at a physical computer resource, wherein the virtual compute instance is one of the plurality virtual compute instances, wherein the individual virtual resource request queue is one of a plurality of respective individual virtual resource request queues for respective virtual computer resources including the virtual computer resource of the plurality of virtual compute instances;
• in response to placing the work request:
• dynamically determining a delay based, at least in part, on a workload of the physical resource request queue;
• and
• after imposing the delay, placing a next work request from the individual virtual resource request queue into the physical resource request queue;
• wherein a work request from at least one other individual virtual resource request queue of the plurality of individual virtual resource request queues is placed in the physical resource request queue during the delay.

A non-transitory, computer-readable storage medium, storing program instructions that when executed by one or more computing devices cause the one or more computing devices to implement a virtualization host for a plurality of compute instances, wherein the virtualization host implements:

• placing a work request for a virtual computer resource from an individual virtual resource request queue maintained for a virtual compute instance into a physical resource request queue to perform the work request at a physical computer resource, wherein the virtual compute instance is one of the plurality virtual compute instances, wherein the individual virtual resource request queue is one of a plurality of respective individual virtual resource request queues for respective virtual computer resources including the virtual computer resource of the plurality of virtual compute instances;
• in response to placing the work request:
• dynamically determining a delay based, at least in part, on a workload of the physical resource request queue;
• and
• after imposing the delay, placing a next work request from the individual virtual resource request queue into the physical resource request queue;
• wherein a work request from at least one other individual virtual resource request queue of the plurality of individual virtual resource request queues is placed in the physical resource request queue during the delay.