Resource scaling of microservice containers

A non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device:

• to determine at least one scaling value for at least one microservice of a plurality of microservices for a given cluster of a container-based computing environment, wherein the at least one scaling value is based at least in part on resource utilization information associated with incoming requests to the plurality of microservices and an amount of resources allocated to the given cluster;
• in response to the at least one microservice exceeding the at least one scaling value, to reduce a number of resources utilized by the at least one microservice by storing one or more further incoming requests associated with the at least one microservice in a queue;
• and
• to release one or more of the further incoming requests stored in the queue in response to determining that the one or more further incoming requests can be processed without the at least one microservice exceeding the at least one scaling value.

An apparatus comprising:

• at least one processing device comprising a processor coupled to a memory;
• the at least one processing device being configured:
• to determine at least one scaling value for at least one microservice of a plurality of microservices for a given cluster of a container-based computing environment, wherein the at least one scaling value is based at least in part on resource utilization information associated with incoming requests to the plurality of microservices and an amount of resources allocated to the given cluster;
• in response to the at least one microservice exceeding the at least one scaling value, to reduce a number of resources utilized by the at least one microservice by storing one or more further incoming requests associated with the at least one microservice in a queue;
• and
• to release one or more of the further incoming requests stored in the queue in response to determining that the one or more further incoming requests can be processed without the at least one microservice exceeding the at least one scaling value.