Speech-to-text auto-scaling for live use cases

A computer system, the computer system comprising:

• one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:
• computing a delta for each word in a transcript between a wall clock time and a time when the word is delivered to a client;
• submitting the deltas to a group of metrics servers, the group of metrics servers being configured to collect the deltas;
• requesting from the group of metrics servers current values of the deltas;
• determining whether the current values of the deltas exceed a pre-defined max-latency threshold;
• and
• in response to determining that the current values of the deltas exceed the pre-defined max-latency threshold, adjusting the allocated computational resources based on a frequency of the current values of the deltas that exceed the pre-defined max-latency threshold.

A computer program product, the computer program product comprising:

• one or more computer-readable tangible storage medium and program instructions stored on at least one of the one or more tangible storage medium, the program instructions executable by a processor capable of performing a method, the method comprising:
• computing a delta for each word in a transcript between a wall clock time and a time when the word is delivered to a client;
• submitting the deltas to a group of metrics servers, the group of metrics servers being configured to collect the deltas;
• requesting from the group of metrics servers current values of the deltas;
• determining whether the current values of the deltas exceed a pre-defined max-latency threshold;
• and
• in response to determining that the current values of the deltas exceed the pre-defined max-latency threshold, adjusting the allocated computational resources based on a frequency of the current values of the deltas that exceed the pre-defined max-latency threshold.