Microservice termination while maintaining high availability

A system for reducing a time required for terminating a plurality of microservices while preventing request processing failures comprising:

• one or more processing units;
• a computer readable medium having encoded thereon, computer-readable instructions that when executed by the one or more processing units causes the system to perform operations comprising:
• retrieving a plurality of request queues from the plurality of microservices, wherein a request queue of the plurality request queues contains one or more outstanding requests for one or more microservices;
• constructing a plurality of call graphs based on the one or more outstanding requests contained in each request queue of the plurality of request queues;
• updating the plurality of call graphs by monitoring the plurality of request queues in response to a completion of an outstanding request, wherein the completion of the outstanding request causes a removal of the outstanding request from a corresponding request queue;
• determining that a microservice of the plurality of microservices does not appear in any of the updated plurality of call graphs following the completion of the outstanding request;
• and
• terminating the microservice in response to determining that the microservice of the plurality of microservices does not appear in any of the updated plurality of call graphs.

A computer readable storage medium having encoded thereon, computer-readable instructions that when executed by a system causes the system to perform operations comprising:

• retrieving a plurality of request queues from a plurality of microservices, wherein a request queue of the plurality request queues contains one or more outstanding requests for one or more microservices;
• constructing a plurality of call graphs based on the one or more outstanding requests contained in each request queue of the plurality of request queues;
• updating the plurality of call graphs by monitoring the plurality of request queues in response to a completion of an outstanding request, wherein the completion of the outstanding request causes a removal of the outstanding request from a corresponding request queue;
• determining that a microservice of the plurality of microservices does not appear in any of the updated plurality of call graphs following the completion of the outstanding request;
• and
• terminating the microservice in response to determining that the microservice of the plurality of microservices does not appear in any of the updated plurality of call graphs.