Control plane techniques for substrate managed containers

A cloud computing system comprising

• one or more memories storing computer-executable instructions that, when executed by one or more processors of the cloud computing system, cause the cloud computing system to:
• provide a control plane of a computing cluster, the control plane comprising a deployment orchestrator configured to provision infrastructure and deploy applications within a cloud-computing environment using 1) virtual-machine-based virtualization with a static pool of computing nodes and 2) container-based virtualization with a dynamic pool of computing nodes of the computing cluster, the control plane further providing a set of applications that are configured to communicate with a plurality of core services of the cloud computing environment, the control plane further providing control plane components of a container orchestration platform;
• receive a deployment request initiated by the deployment orchestrator;
• determine, by the deployment orchestrator and based at least in part on a predefined rule set, whether to fulfill the deployment request using the virtual-machine-based virtualization with the static pool of computing nodes or using the container-based virtualization and the dynamic pool of computing nodes, the predefined rule set instructing the control plane to incrementally increase use of the container-based virtualization and the dynamic pool of computing nodes to fulfill deployment requests while incrementally decreasing use of the virtual-machine-based virtualization and the static pool of computing nodes until the cloud computing environment utilizes only container-based virtualization;
• generate, based at least in part on a determination that the deployment request is to be fulfilled using the container-based virtualization and the dynamic pool of computing nodes, a pod comprising one or more containers corresponding to the deployment request;
• assign the pod comprising the one or more containers to a computing node of the dynamic pool of computing nodes;
• generate an Internet Protocol (IP) address for the one or more containers of the pod;
• and
• update a load balancer with the IP address causing the one or more containers to be available for receiving subsequent network traffic.

A non-transitory computer readable medium storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to:

• provide a control plane of a computing cluster, the control plane comprising a deployment orchestrator configured to provision infrastructure and deploy applications within a cloud-computing environment using 1) virtual-machine-based virtualization with a static pool of computing nodes and 2) container-based virtualization with a dynamic pool of computing nodes of the computing cluster, the control plane further providing a set of applications that are configured to communicate with a plurality of core services of the cloud computing environment, the control plane further providing control plane components of a container orchestration platform;
• receive a deployment request initiated by the deployment orchestrator;
• determine, by the deployment orchestrator and based at least in part on a predefined rule set, whether to fulfill the deployment request using the virtual-machine-based virtualization with the static pool of computing nodes or using the container-based virtualization and the dynamic pool of computing nodes, the predefined rule set instructing the control plane to incrementally increase use of the container-based virtualization and the dynamic pool of computing nodes to fulfill deployment requests while incrementally decreasing use of the virtual-machine-based virtualization and the static pool of computing nodes until the cloud computing environment utilizes only container-based virtualization;
• generate, based at least in part on a determination that the deployment request is to be fulfilled using the container-based virtualization and the dynamic pool of computing nodes, a pod comprising one or more containers corresponding to the deployment request;
• assign the pod comprising the one or more containers to a computing node of the dynamic pool of computing nodes;
• generate an Internet Protocol (IP) address for the one or more containers of the pod;
• and
• update a load balancer with the IP address causing the one or more containers to be available for receiving subsequent network traffic.