Determining load state of remote systems using delay and packet loss rate

A computer-implemented method for managing workloads across multiple resources in a distributed computing system, the method comprising:

• monitoring a data flow between a source device and each of a plurality of target devices via a packet-switched network, wherein each of the plurality of target devices includes a linear data buffer for temporarily storing data packets received from the source device prior to processing, each of the plurality of target devices automatically drops a data packet selected from a starting position of the linear data buffer when the linear data buffer is full, and each of the plurality of target devices automatically drops a data packet selected from a starting position of the linear data buffer after a predetermined time period has elapsed and when the linear data buffer is not full, the starting position corresponds to the earliest of the data packets received from the source device and stored within the linear data buffer:
• responsive to receiving an indication of a resource constraint for a first target device in the plurality of target devices, determining whether a load state of the first target device exceeds a predetermined threshold/maximum capacity based on the monitored data flow between the source device and the first target device;
• upon determining that the load state of the first target device exceeds the predetermined threshold capacity, adjusting at least a portion of the data flow between the source device and the first target device so as to reduce the load state of the first target device;
• determining a new load state of the first target device based on the adjusted data traffic flow;
• and
• upon determining that the new load state indicates that the first target device no longer has the resource constraint, readjusting the data traffic flow between the source device and the first target device so as to increase the load state of the first target device to at least a predetermined operating/minimum capacity.

A system for balancing workloads across multiple resources in a distributed computing environment, the system comprising:

• a memory having processor-readable instructions stored therein;
• and a processor configured to access the memory and execute the processor-readable instructions, which when executed by the processor configures the processor to perform a plurality of functions, including functions to:
• monitor a data traffic flow between a source device and each of a plurality of target devices via a packet-switched network, wherein each of the plurality of target devices includes a linear data buffer for temporarily storing data packets received from the source device prior to processing, each of the plurality of target devices automatically drops a data packet selected from a starting position of the linear data buffer when the linear data buffer is full, and each of the plurality of target devices automatically drops a data packet selected from a starting position of the linear data buffer after a predetermined time period has elapsed and when the linear data buffer is not full, the starting position corresponds to the earliest of the data packets received from the source device and stored within the linear data buffer;
• determine a load state of each of the plurality of target devices based on the monitored data traffic flow;
• detect a resource constraint for a first target device in the plurality of target devices, based on the load state determined for the first target device;
• adjust at least a portion of the data traffic flow between the source device and the first target device such that the first target device operates at a reduced load state;
• determine that the first target device no longer has the resource constraint while operating at the reduced load state;
• and
• readjust the data traffic flow between the source device and the first target device so as to restore the load state of the first target device to a default or predetermined operating level that is above the reduced load state, based upon the determination.

A non-transitory computer readable medium storing instructions that, when executed by a computer, cause the computer to perform functions to:

• monitor a data traffic flow between a source device and each of a plurality of target devices via a packet-switched network, wherein each of the plurality of target devices includes a linear data buffer for temporarily storing data packets received from the source device prior to processing, each of the plurality of target devices automatically drops a data packet selected from a starting position of the linear data buffer when the linear data buffer is full, and each of the plurality of target devices automatically drops a data packet selected from a starting position of the linear data buffer after a predetermined time period has elapsed and when the linear data buffer is not full, the starting position corresponds to the earliest of the data packets received from the source device and stored within the linear data buffer:
• determine a load state of each of the plurality of target devices based on the monitored data traffic flow;
• detect a resource constraint for a first target device in the plurality of target devices, based on the load state determined for the first target device;
• adjust at least a portion of the data traffic flow between the source device and the first target device such that the first target device operates at a reduced load state;
• determine that the first target device no longer has the resource constraint while operating at the reduced load state;
• and
• readjust the data traffic flow between the source device and the first target device so as to restore the load state of the first target device to a default or predetermined operating level that is above the reduced load state, based upon the determination.