Layer 4 load aware load balancing
AssigneeCisco Technology, Inc.
InventorsZhiyuan Yao, Yoann Louis Simon Desmouceaux, Pierre Pfister, William Mark Townsley
Life of this patent
Estimating the term…
Abstract
Load aware load balancing may be provided. Flow duration data associated with a plurality of flows associated with a plurality of servers may be obtained. Then a plurality of queue lengths respectively associated with the plurality of servers may be obtained. Next, a Shortest Expected Delay (SED) score may be determined for each of the plurality of servers based on the flow duration data and the plurality of queue lengths. A flow may then be assigned to a one of the plurality of servers having the lowest SED score.
Claims20
A method comprising:
- inferring, by a computing device, server processing speed data associated with a plurality of servers from flow duration data associated with a plurality of flows associated with the plurality of servers, wherein inferring the server processing speed data comprises using a Softmax normalization function on the flow duration data associated with the plurality of flows associated with the plurality of servers;
- obtaining a plurality of queue lengths respectively associated with the plurality of servers;
- determining a Shortest Expected Delay (SED) score for each of the plurality of servers from the inferred server processing speed data and the plurality of queue lengths;
- and
- assigning a flow to the one of the plurality of servers having a lowest SED score.
A system comprising:
- a memory storage;
- and
- a processing unit coupled to the memory storage, wherein the processing unit is operative to:
- infer server processing speed data associated with a plurality of servers from flow duration data associated with a plurality of flows associated with the plurality of servers, wherein the processing unit being operative to infer the server processing speed data comprises the processing unit being operative to use a Softmax normalization function on the flow duration data associated with the plurality of flows associated with the plurality of servers;
- obtain a plurality of queue lengths respectively associated with the plurality of servers;
- determine a Shortest Expected Delay (SED) score for each of the plurality of servers from the inferred server processing speed data and the plurality of queue lengths;
- and
- assign a flow to the one of the plurality of servers having a lowest SED score.
A non-transitory computer-readable medium that stores a set of instructions which when executed by a processor perform a method executed by the set of instructions comprising:
- inferring, by a computing device, server processing speed data associated with a plurality of servers from flow duration data associated with a plurality of flows associated with the plurality of servers, wherein inferring the server processing speed data comprises using a Softmax normalization function on the flow duration data associated with the plurality of flows associated with the plurality of servers;
- obtaining a plurality of queue lengths respectively associated with the plurality of servers;
- determining a Shortest Expected Delay (SED) score for each of the plurality of servers from the inferred server processing speed data and the plurality of queue lengths;
- and
- assigning a flow to the one of the plurality of servers having a lowest SED score.
Dependencies are inferred from the claim text.