NUMA awareness architecture for VM-based container in Kubernetes environment

A system comprising:

• at least one processor configured to execute instructions;
• at least one memory comprising stored instructions, the instructions when executed cause the at least one processor to:
• initialize a set of micro-virtual machines (VMs) within a macro-VM environment;
• generate a sandbox and a container for each micro-VM of the set of micro-VMs;
• assign a virtual central processing unit (vCPU) to a container of a respective micro-VM in the set of micro-VMs, the respective micro-VM is within a tenant specific pod in the macro-VM environment, the vCPU assigned is determined based on (i) an estimated memory required by the respective micro-VM and (ii) an estimated available memory associated with the vCPU;
• select a physical CPU from a plurality of physical CPUs wherein the plurality of physical CPUs are within the tenant specific pod and comprised pinned vCPUs assigned to containers of micro-VMs of the tenant specific pod, and an available local memory of the selected physical CPU being equal to or greater than the estimated available memory associated with the vCPU;
• pin the vCPU with the selected physical CPU of the plurality of physical CPUs, wherein the instructions to pin includes instructions to execute workloads associated with the vCPU on the selected physical CPU within the tenant specific pod;
• and
• maintain a state of the vCPU and the physical CPU in a resource manager.

A non-transitory computer readable medium having instructions encoded thereon that, when executed by a processor, cause the processor to:

• initialize a set of micro-virtual machines (VMs) within a macro-VM environment;
• generate a sandbox and a container for each micro-VM of the set of micro-VMs;
• assign a virtual central processing unit (vCPU) to a container of a respective micro-VM in the set of micro-VMs, the respective micro-VM is within a tenant specific pod in the macro-VM environment, the vCPU assigned is determined based on (i) an estimated memory required by the respective micro-VM and (ii) an estimated available memory associated with the vCPU;
• select a physical CPU from a plurality of physical CPUs wherein the plurality of physical CPUs are within the tenant specific pod and comprised pinned vCPUs assigned to containers of micro-VMs of the tenant specific pod, and an available local memory of the selected physical CPU being equal to or greater than the estimated available memory associated with the vCPU;
• pin the vCPU with the selected physical CPU of the plurality of physical CPUs, wherein the instruction to pin includes instructions to execute workloads associated with the vCPU on the selected physical CPU within the tenant specific pod;
• and
• maintain a state of the vCPU and the physical CPU in a resource manager.