US 10,951,690 B2 · Near real-time computation of scaling unit's load and availability state

Abstract

Various embodiments of the present technology generally relate to systems and methods for intelligent load shedding. More specifically, various embodiments of the present technology generally relate to intelligent load shedding of traffic based on current load state of target capacity. In some embodiments, a first server can send a capacity request indicating that the first server is nearing capacity and needs assistance with load. In response to the capacity request, an assistance request can be published to additional nearby servers. The servers can respond with a status update providing load and availability information. Based on the load and availability information (or other information such as latency), a second server from the additional servers can be selected and traffic can be routed away from the first server to the second server.

Claims20

Dependent claims

A method for operating a domain name system (DNS) server, the method comprising:

receiving, at a central controller from a first set of servers, a capacity request indicating that the first set of servers is nearing capacity, wherein the indication that the first set of servers is nearing capacity indicates that the first set of servers is using an available capacity that exceeds a threshold capacity needed to serve a current rate of incoming traffic to the first set of servers plus a buffer capacity;
publishing, by the central controller in response to receiving the capacity request, an assistance request to additional sets of servers;
receiving, by the central controller in response to the assistance request, a status update providing load and availability information from each of the additional sets of servers;
selecting, by the central controller based on the load and availability information, a second set of servers from the additional sets of servers;
and
gradually routing, by the central controller, traffic away from the first set of servers to the second set of servers.

3 more elements

A computer-readable storage medium comprising a set of instructions that, upon execution by one or more processors, cause the one or more processors to:

receive, from a first set of servers, a capacity request indicating that the first set of servers is nearing capacity, wherein the indication that the first set of servers is nearing capacity indicates that the first set of servers is using an available capacity that exceeds a threshold capacity needed to serve a current rate of incoming traffic to the first set of servers plus a buffer capacity;
publish, in response to receiving the capacity request, an assistance request to additional sets of servers;
receive, in response to the assistance request, a status update providing load and availability information from each of the additional sets of servers;
select, based on the load and availability information, a second set of servers from the additional sets of servers;
and
gradually route traffic away from the first set of servers to the second set of servers.

3 more elements

Dependencies are inferred from the claim text.

Near real-time computation of scaling unit's load and availability state

Life of this patent

Near real-time computation of scaling unit's load and availability state

Life of this patent

Abstract

Claims20