US 9,432,305 B1Granted

Connection redistribution in load-balanced systems

AssigneeAmazon Technologies, Inc.

InventorsPejus Manoj Das, David Craig Yanacek

Life of this patent

Estimating the term…

Loading patent…

Abstract

Methods and apparatus for connection redistribution in load-balanced systems that include multiple load balancers each serving multiple nodes. In the connection redistribution method, each node estimates a connection close rate, which may be based on an estimation of the percentage of the overall client traffic received by the respective load balancer that is being handled by the node. The node generates close requests for connections between the respective load balancer and clients according to the connection close rate. The node sends the close requests to its load balancer, which forwards the close requests to the appropriate clients. Upon receiving a close request, a client may close the connection(s) indicated by the request, obtain a public IP address for a load balancer, and initiate new connection(s) to the respective load balancer via the public IP address.

Claims20

Dependent claims

A network-based system, comprising:

a plurality of computing devices implementing a plurality of nodes each configured to provide one or more functionalities of the network-based system, wherein the plurality of nodes are grouped into a plurality of node groups each comprising two or more of the nodes;
and
a plurality of load balancers each fronting at least one of the plurality of node groups, each load balancer configured to:
receive client requests from a plurality of client devices via connections over a network between the client devices and the load balancer;
and
distribute the received client requests among the nodes in a node group corresponding to the load balancer according to a load balancing technique;
wherein each of the plurality of nodes is further configured to:
generate connection close requests for connections between the client devices and a corresponding one of the plurality of load balancers according to a connection close rate for the node, each connection close request indicating one or more connections;
and
send the connection close requests to the corresponding load balancer;
wherein each load balancer is further configured to forward connection close requests received from the nodes in its corresponding node group to appropriate ones of the plurality of client devices via respective connections;
and
wherein a connection close request received from one of the plurality of load balancers causes a client device to close one or more indicated connections to the load balancer and open one or more new connections to at least one of the plurality of load balancers.

10 more elements

A method, comprising:

receiving, at each node in a node group from a load balancer of a plurality of load balancers, a plurality of client requests, wherein the load balancer distributes client requests received via connections between the load balancer and clients among a plurality of nodes in the node group;
generating, at each node in the node group, connection close requests for connections between the clients and the load balancer, each connection close request indicating one or more connections;
and
sending the connection close requests to the respective clients via the load balancer;
wherein, in response to at least one connection close request, a respective client closes one or more indicated connections to the load balancer and opens one or more new connections to at least one of the plurality of load balancers.

2 more elements

A non-transitory computer-accessible storage medium storing program instructions computer-executable to implement:

estimating a connection close rate for each node in a node group fronted by one of a plurality of load balancers, wherein the connection close rate for a given node provides an indication of a number of connections between the respective load balancer and client devices the given node should request to be closed in a specified time period;
generating, by each node in the node group, connection close requests for connections between the client devices and the respective load balancer according to the connection close rate for the node, each connection close request indicating one or more connections;
and
sending the connection close requests to the respective client devices via the load balancer;
wherein, in response to at least one connection close request, a respective client device closes one or more indicated connections to the load balancer and opens one or more new connections to at least one of the plurality of load balancers.

2 more elements

Dependencies are inferred from the claim text.

Facts

Application: 13/927,851Filed 26 Jun 2013
Granted: 30 Aug 2016
Term ends: Not estimatedThe source records don’t support an estimate.

Classification8 codes

H04L 61/4511
Using standardised directories; using standardised directory access protocols: using domain name system [DNS]
H04L 61/5007
Address allocation: internet protocol [IP] addresses
H04L 67/1001
In which an application is distributed across nodes in the network: for accessing one among a plurality of replicated servers
H04L 67/1008
Server selection for load balancing: based on parameters of servers, e.g. available memory or workload