Quantization of data streams of instrumented software and handling of delayed data by adjustment of a maximum delay

A data quantizer system for dynamically adjusting a maximum delay in publishing data points of a time series of data points, the data quantizer system comprising:

• a processor;
• and
• a computer readable non-transitory storage medium storing instructions that, when executed by the processor, cause the processor to:
• receive a first data point of a time series of data points, the first data point comprising a first data point raw time indicating a time of creation of the first data point and a first receipt time indicating a time for which the first data point is obtained at the data quantizer system;
• derive a first receipt delay time for the first data point, the first receipt delay time comprising a delay between the first receipt time and a first time associated with a first applicable window;
• responsive to determining that the first receipt delay time is greater than any of a set of maximum delay values for the time series of data points:
• derive a first time to live value specifying a time for the first receipt delay time to be included in the set of maximum delay values, where a greater deviance between the first receipt delay time and a weighted moving average delay for the time series of data points reduces the first time to live value, and where the first receipt delay time is removed from the set of maximum delay values after expiry of the time to live value;
• and
• update the set of maximum delay values to include the first receipt delay time and the first time to live value;
• and
• publish, at a time after an end of the first applicable window, the first data point to a streaming analytics engine.

A computer readable non-transitory storage medium storing instructions for processing data generated by instrumented software, the instructions when executed by a processor cause the processor to perform a process comprising:

• receiving a first data point of a time series of data points, the first data point comprising a first data point raw time indicating a time of creation of the first data point and a first receipt time indicating a time for which the first data point is obtained;
• deriving a first receipt delay time for the first data point, the first receipt delay time comprising a delay between the first receipt time and a first time associated with a first applicable window;
• responsive to determining that the first receipt delay time is greater than any of a set of maximum delay values for the time series of data points:
• deriving a first time to live value specifying a time for the first receipt delay time to be included in the set of maximum delay values;
• and
• updating the set of maximum delay values to include the first receipt delay time and the first time to live value;
• publishing, at a time after an end of the first applicable window, the first data point to a streaming analytics engine;
• receiving a second data point, the second data point comprising a second data point raw time indicating a time of creation of the second data point and a second receipt time indicating a time for which the second data point is obtained;
• deriving a second receipt delay time for the second data point, the second receipt delay time comprising a delay between the second receipt time and a second time associated with a second applicable window;
• responsive to determining that the first time to live value associated with the first receipt delay time has expired:
• deriving a second time to live value based on the second receipt delay time;
• and
• updating the set of maximum delay values to add the second receipt delay time and the second time to live value to the set of maximum delay values and remove the first receipt delay time included in the set of maximum delay values;
• and
• publishing, at a time after an end of the second applicable window, the second data point to the streaming analytics engine.