Distributed processing system throttling using a timestamp

A system comprising:

• a data processing apparatus;
• and
• a data store storing instructions that, when executed by the data processing apparatus, cause the data processing apparatus to perform operations comprising:
• determining a first agent progress in processing a set of records, wherein the first agent progress is based on a first timestamp of an oldest record of the set of records processed by a first agent process and entered into a queue for a second agent process, and a current system time, wherein the second agent process is a dependent agent process of the first agent process and processes records that have first been processed by the first agent process;
• determining a second agent progress in processing the set of records, wherein the second agent progress is based on a second time difference between a second timestamp of an oldest record of the set of records processed by the second agent process and the current system time, wherein the first timestamp of the oldest record of the set of records processed by the first agent process and the second timestamp of the oldest record of the set of records processed by the second agent process each correspond to a time the respective record was received by the processing apparatus;
• determining a difference between the first agent progress and the second agent progress;
• and
• throttling performance of the first agent process based on the difference between the first agent progress and the second agent progress meeting a threshold measure.

A non-transitory computer readable medium storing instructions that, when executed by a data processing apparatus, cause the data processing apparatus to perform operations comprising:

• determining a first agent progress in processing a set of records, wherein the first agent progress is based on a first time difference between a first timestamp of an oldest record of the set of records processed by a first agent process and entered into a queue for a second agent process and a current system time, wherein the second agent process is a dependent agent process of the first agent process and processes records that have first been processed by the first agent process;
• determining a second agent progress in processing the set of records, wherein the second agent progress is based on a second time difference between a second timestamp of an oldest record of the set of records processed by the second agent process and the current system time, wherein the first timestamp of the oldest record of the set of records processed by the first agent process and the second timestamp of the oldest record of the set of records processed by the second agent process each correspond a time the respective oldest record was received by the data processing apparatus;
• determining, by the one or more processors, a difference between the first agent progress and the second agent progress;
• and
• throttling performance of the first agent process based on the difference between the first agent progress and the second agent progress meeting a threshold measure.