US 10,241,674 B2Granted

Workload aware NUMA scheduling

AssigneeVMware, Inc.

InventorsKiran Eshwarappa, Vinaya Hanumantharaya, Selventhiran Elangovan, Gangam Kushalappa

Life of this patent

Estimating the term…

Loading patent…

Abstract

Disclosed herein are techniques for performing workflow-aware NUMA (non-uniform memory access) optimizations. “Execution contexts” such as virtual machines or Docker containers are managed within a computer system that includes multiple NUMA nodes, each including a processor socket and memory local to that socket. NUMA optimization techniques are performed whereby execution contexts and/or data for such contexts are migrated between NUMA nodes. Migration may occur for various reasons, including for load balancing, to achieve fairness, or to increase the amount of data that is stored in memory local to a particular execution context. When it is known that an execution context will soon stop executing in a particular computer system, optimizations may provide little or no benefit. In such situations, the computer system performs modified NUMA optimizations, in which certain optimizations that would normally be performed are instead not performed.

Claims20

Dependent claims

A method for managing execution contexts in a non-uniform memory access (NUMA) architecture, the method comprising:

identifying a first execution context for optimization analysis;
determining that no workflow aware-related trigger condition of a set of workflow aware-related trigger conditions has occurred for the first execution context;
performing a NUMA optimization operation for the first execution context;
identifying a second execution context for optimization analysis;
determining that a workflow aware-related trigger condition of the set of workflow aware-related trigger conditions has occurred for the second execution context;
and
responsive to determining that the workflow aware-related trigger condition has occurred, performing a modified NUMA optimization operation for the second execution context,
wherein the NUMA optimization operation includes at least one operation not included in the modified NUMA optimization operation, and further wherein:
(1) the NUMA optimization operation includes (a) migrating the first execution context from a first NUMA node of the NUMA architecture to a second NUMA node of the NUMA architecture, or (b) migrating first data associated with the first execution context from the first NUMA node to the second NUMA node;
or
(2) the modified NUMA optimization operation includes migrating the second execution context from a first NUMA node of the NUMA architecture to a second NUMA node of the NUMA architecture, but does not include migrating first data associated with the second execution context from the first NUMA node to the second NUMA node.

8 more elements

A system for managing execution contexts in a non-uniform memory access (NUMA) architecture, the system comprising:

a host;
a first NUMA node included in the host;
and
a second NUMA node included in the host,
wherein the host is configured to:
identify a first execution context for optimization analysis;
determine that no workflow aware-related trigger condition of a set of workflow aware-related trigger conditions has occurred for the first execution context;
perform a NUMA optimization operation for the first execution context;
identify a second execution context for optimization analysis;
determine that a workflow aware-related trigger condition of the set of workflow aware-related trigger conditions has occurred for the second execution context;
and
responsive to determining that the workflow aware-related trigger condition has occurred, perform a modified NUMA optimization operation for the second execution context,
wherein the NUMA optimization operation includes at least one operation not included in the modified NUMA optimization operation, and
wherein both the NUMA optimization operation and the modified NUMA optimization operation comprise operations associated with execution of execution contexts on the first NUMA node or the second NUMA node, and further wherein:
(1) the NUMA optimization operation includes (a) migrating the first execution context from a first NUMA node of the NUMA architecture to a second NUMA node of the NUMA architecture, or (b) migrating first data associated with the first execution context from the first NUMA node to the second NUMA node;
or
(2) the modified NUMA optimization operation includes migrating the second execution context from a first NUMA node of the NUMA architecture to a second NUMA node of the NUMA architecture, but does not include migrating first data associated with the second execution context from the first NUMA node to the second NUMA node.

14 more elements

A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform a method for managing execution contexts in a non-uniform memory access (NUMA) architecture, the method comprising:

identifying a first execution context for optimization analysis;
determining that no workflow aware-related trigger condition of a set of workflow aware-related trigger conditions has occurred for the first execution context;
performing a NUMA optimization operation for the first execution context;
identifying a second execution context for optimization analysis;
determining that a workflow aware-related trigger condition of the set of workflow aware-related trigger conditions has occurred for the second execution context;
and
responsive to determining that the workflow aware-related trigger condition has occurred, performing a modified NUMA optimization operation for the second execution context,
wherein the NUMA optimization operation includes at least one operation not included in the modified NUMA optimization operation, and further wherein:
(1) the NUMA optimization operation includes (a) migrating the first execution context from a first NUMA node of the NUMA architecture to a second NUMA node of the NUMA architecture, or (b) migrating first data associated with the first execution context from the first NUMA node to the second NUMA node;
or
(2) the modified NUMA optimization operation includes migrating the second execution context from a first NUMA node of the NUMA architecture to a second NUMA node of the NUMA architecture, but does not include migrating first data associated with the second execution context from the first NUMA node to the second NUMA node.

8 more elements

Dependencies are inferred from the claim text.