Apparatus, method, and system for dynamic pod autoscaling in a serverless computing environment

A dynamic pod autoscaling system in a serverless computing environment comprising:

• Knative Service for receiving traffic data according to a service request from Knative Revision;
• KnativePodAutoscaler (KPA) for calculating the number of replica sets by performing pod autoscaling according to a predefined first target value in the Knative Service;
• and
• a custom controller for collecting concurrency/rps (request per second) information of a first number of pods corresponding to the number of replica sets, and calculating the first target value as a second target value using the concurrency/rps information and average resource usage of the pod,
• wherein the KPA dynamically changes the number of replica sets from the first number to a second number through the second target value.

A dynamic pod autoscaling method in a serverless computing environment comprising:

• registering, if there is a service request, a predefined first target value;
• collecting concurrency/rps (request per second) information of a first number of pods corresponding to the number of replica sets that is pod autoscaled according to the first target value;
• calculating the first target value as a second target value using the concurrency/rps information and average resource usage of the pod;
• and
• dynamically changing the number of replicasets from the first number to a second number through the second target value.