Latency based circuit breaker for a service process

A computing device, comprising:

• a memory;
• and
• one or more processor devices coupled to the memory operable to:
• determine a plurality of request latencies for a service process by, for each of a plurality of iterations:
• receiving, by a proxy process, a request destined for the service process;
• determining, by the proxy process, that a state of a first circuit breaker associated with the service process is a closed state such that the request can be sent to the service process;
• sending, by the proxy process, the request to the service process;
• and
• storing, by the proxy process, a request latency of the plurality of request latencies in a data structure, wherein the request latency is representative of a period of time that elapsed between sending the request to the service process and determining that the service process has generated a response to the request;
• and
• responsive to determining, based on the data structure, that an unfavorable request latency condition exists, set the state of the first circuit breaker to an opened state, such that subsequent requests received by the proxy process cannot be sent to the service process.

A non-transitory computer-readable storage medium that includes executable instructions operable to cause one or more processor devices to:

• determine a plurality of request latencies for a service process by, for each of a plurality of iterations:
• receiving, by a proxy process, a request destined for the service process;
• determining, by the proxy process, that a state of a first circuit breaker associated with the service process is a closed state such that the request can be sent to the service process;
• sending, by the proxy process, the request to the service process;
• and
• storing, by the proxy process, a request latency of the plurality of request latencies in a data structure, wherein the request latency is representative of a period of time that elapsed between sending the request to the service process and determining that the service process has generated a response to the request;
• and
• responsive to determining, based on the data structure, that an unfavorable request latency condition exists, set the state of the first circuit breaker to an opened state, such that subsequent requests received by the proxy process cannot be sent to the service process.