Contextual bandits for replica autoscaling

A computer system, comprising:

• a processor set;
• one or more computer-readable storage media;
• and
• program instructions stored on the one or more computer-readable storage media, the program instructions executable by the processor set to cause the processor set to:
• receive a scaling request associated with a microservices-based application,
• the microservices-based application comprising a set of component microservices operational on a computing system;
• receive context information comprising workload level information for a plurality of transactions of the microservices-based application based on the scaling request;
• apply a plurality of transaction-level predictors on the context information;
• generate a plurality of prediction values for a performance indicator associated with the microservices-based application based on the applying;
• solve a constrained optimization formulation based on the plurality of prediction values to generate a solution pool comprising a set of scaling actions;
• sample a scaling action from the set of scaling actions, the scaling action comprising a respective service replica count for at least one component microservice of the set of component microservices;
• and
• generate a scaling recommendation comprising the respective service replica count for the at least one component microservice of the set of component microservices.

A computer-program product for optimizing service replicas of a microservices-based application, the computer-program product comprising:

• one or more computer-readable storage media;
• and
• program instructions stored on the one or more computer-readable storage media to perform operations comprising:
• receiving a scaling request associated with a microservices-based application,
• the microservices-based application comprising a set of component microservices operational on a computing system;
• receiving context information comprising workload level information for a plurality of transactions of the microservices-based application based on the scaling request;
• applying a plurality of transaction-level predictors on the context information;
• generating a plurality of prediction values for a performance indicator associated with the microservices-based application based on the applying;
• solving a constrained optimization formulation based on the plurality of prediction values to generate a solution pool comprising a set of scaling actions;
• sampling a scaling action from the set of scaling actions, the scaling action comprising a respective service replica count for at least one component microservice of the set of component microservices;
• and
• generating a scaling recommendation comprising the respective service replica count for the at least one component microservice of the set of component microservices.