Variable timeslices for processing latency-dependent workloads
AssigneeAmazon Technologies, Inc.
InventorsWILLIAM JOHN EARL, JOHN MERRILL PHILLIPS
Life of this patent
Estimating the term…
Loading patent…
AssigneeAmazon Technologies, Inc.
InventorsWILLIAM JOHN EARL, JOHN MERRILL PHILLIPS
Estimating the term…
A virtualization host may implement variable timeslices for processing latency dependent workloads. Multiple virtual compute instances on a virtualization host may utilize virtual central processing units (vCPUs) to obtain physical processing resources, such as one or more central processing units (CPUs). A vCPU currently utilizing a CPU to performing processing work according to a scheduled timeslice may be preempted by a latency dependent vCPU before completion of the scheduled timeslice. The latency-dependent vCPU may complete processing work, and utilization of the CPU may be returned to the vCPU. A preemption compensation may be determined for the scheduled timeslice to increase the scheduled timeslice for the vCPU such that utilization for the vCPU is performed according to the increased scheduled timeslice.
A system, comprising:
A method, comprising:
A non-transitory, computer-readable storage medium, storing program instructions that when executed by one or more computing devices cause the one or more computing devices to implement a virtualization host for a plurality of compute instances, wherein the virtualization host implements:
Dependencies are inferred from the claim text.