Layer 4 load aware load balancing
AssigneeCisco Technology, Inc.
InventorsZhiyuan Yao, Yoann Louis Simon Desmouceaux, Pierre Pfister, William Mark Townsley
Life of this patent
Estimating the term…
Abstract
Load aware load balancing may be provided. Flow duration data associated with a plurality of flows associated with a plurality of servers may be obtained. Then a plurality of queue lengths respectively associated with the plurality of servers may be obtained. Next, a Shortest Expected Delay (SED) score may be determined for each of the plurality of servers based on the flow duration data and the plurality of queue lengths. A flow may then be assigned to a one of the plurality of servers having the lowest SED score.
Claims20
A method comprising:
- inferring, by a computing device, server processing speed data associated with a plurality of servers from flow level telemetry data associated with a plurality of flows associated with the plurality of servers, wherein inferring the server processing speed data comprises using a normalization function on the flow level telemetry data associated with the plurality of flows associated with the plurality of servers;
- obtaining a plurality of queue lengths respectively associated with the plurality of servers;
- determining a Shortest Expected Delay (SED) score for each of the plurality of servers based on the server processing speed data and the plurality of queue lengths;
- and
- assigning a flow to a one of the plurality of servers having a lowest SED score.
A system comprising:
- a memory storage;
- and
- a processing unit coupled to the memory storage, wherein the processing unit is operative to:
- inferring, by a computing device, server processing speed data associated with a plurality of servers from flow level telemetry data associated with a plurality of flows associated with the plurality of servers, wherein inferring the server processing speed data comprises using a normalization function on the flow level telemetry data associated with the plurality of flows associated with the plurality of servers;
- obtain a plurality of queue lengths respectively associated with the plurality of servers;
- determine a Shortest Expected Delay (SED) score for each of the plurality of servers from the inferred server processing speed data and the plurality of queue lengths;
- and
- assign a flow to a one of the plurality of servers having a lowest SED score.
A computer-readable medium that stores a set of instructions which when executed by a processor perform a method executed by the set of instructions comprising:
- inferring, by a computing device, server processing speed data associated with a plurality of servers from flow level telemetry data associated with a plurality of flows associated with the plurality of servers, wherein inferring the server processing speed data comprises using a normalization function on the flow level telemetry data associated with the plurality of flows associated with the plurality of servers;
- obtaining a plurality of queue lengths respectively associated with the plurality of servers;
- determining a Shortest Expected Delay (SED) score for each of the plurality of servers from the inferred server processing speed data and the plurality of queue lengths;
- and
- assigning a flow to a one of the plurality of servers having a lowest SED score.
Dependencies are inferred from the claim text.