# US 2020/0267114 A1 · Load-balanced endpoints selection for client devices accessing the endpoints via a network

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0267114 A1
- Document ID: US20200267114A1
- Status: Published application
- Kind: A1
- Application number: 16/277,714
- Filed: 2019-02-15
- Published: 2020-08-20
- Earliest claimed: 2019-02-15
- Assignees: Juniper Networks, Inc.
- Applicants: Juniper Networks, Inc.
- Inventors: Sai Sundar Ramamurthy; Rajneesh Kumar; Bhaskar Jain; Ravi Kumar G V Subrahmanya; Sanjay Kumar Gupta; Unni Dilip; Vijay Sai Ram Paruchuri
- Web page: https://patentgrep.com/patent/US20200267114A1

## CPC

- H04L 47/125: by balancing the load, e.g. traffic engineering
- H04L 61/4511: using domain name system [DNS]
- H04L 41/5019: Ensuring fulfilment of SLA
- H04L 43/12: Network monitoring probes
- H04L 61/5007: Internet protocol [IP] addresses
- H04L 61/5053: Lease time; Renewal aspects
- H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L 67/1001: for accessing one among a plurality of replicated servers
- H04L 67/1004: Server selection for load balancing
- H04L 67/1008: based on parameters of servers, e.g. available memory or workload (monitoring of computer activity G06F11/30)
- H04L 67/101: based on network conditions
- H04L 67/1012: based on compliance of requirements or conditions with available server resources
- H04L 67/1029: using data related to the state of servers by a load balancer
- H04L 67/1036: Load balancing of requests to servers for services different from user content provisioning, e.g. load balancing across domain name servers
- H04L 67/125: involving control of end-device applications over a network
- H04L 67/61: taking into account QoS or priority requirements
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Techniques are described for selecting, with an intermediate device, a preferred remote endpoint from a plurality of remote endpoints accessible to a client computing device via a network and indicating the preferred remote endpoint to the client computing device. For example, an intermediate device may intercept a DNS response from a DNS load balancer that load balances service requests across multiple remote endpoints that provide the requested service. Based on values for one or more network performance metrics for network traffic from each of the multiple endpoints to the intermediate device, the intermediate device may modify the priority of IP addresses included in the DNS response. The intermediate device may, for instance, replace an original primary IP address in the DNS response with an IP address for another one of the remote endpoints for which the intermediate device measured better network performance metrics.

## Claims

### Claim 1

A method comprising:
receiving, by an intermediate device situated on respective network paths that traverse a network connecting a client device and a plurality of endpoints that each offers a same service and are mapped to a same hostname, a Domain Name System (DNS) message that indicates the plurality of endpoints;
determining, by the intermediate device, based on respective sets of network performance metrics for the plurality of endpoints, that a first endpoint of the plurality of endpoints is preferable for offering the service to the client device;
generating, by the intermediate device, in response to the DNS message and based on determining that the first endpoint is preferable for offering the service to the client device, a DNS response that specifies an Internet Protocol (IP) address of the first endpoint as a primary IP address; and
sending, by the intermediate device, the DNS response to the client device to cause the client device to send a service request to the IP address of the first endpoint.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining that the first endpoint of the plurality of endpoints is preferable comprises:
sending, by the intermediate device, a corresponding probe packet to each of the plurality of endpoints;
receiving, by the intermediate device and from each of the plurality of endpoints, a probe packet reply corresponding to the respective probe packet for the endpoint; and
determining, by the intermediate device and based on information from the probe packets and the probe packet replies, a set of network performance metrics for each of the plurality of endpoints.

### Claim 3 (depends on 2)

The method of claim 2, wherein each of the probe packets conforms to at least one of Internet Control Message Protocol (ICMP), Two-Way Active Measurement Protocol (TWAMP), or Hypertext Transfer Protocol (HTTP).

### Claim 4 (depends on 1)

The method of claim 1,
wherein the DNS message comprises a first DNS response that indicates the plurality of endpoints as respective IP addresses, and
wherein the DNS response to the client device is a second DNS response.

### Claim 5 (depends on 1)

The method of claim 1, wherein sets of network performance metrics for the endpoints each comprises at least one of latency, delay (inter frame gap), jitter, packet loss, and throughput.

### Claim 6 (depends on 1)

The method of claim 1, wherein the DNS message comprises a DNS query including the hostname mapped to each of the plurality of endpoints.

### Claim 7 (depends on 1)

The method of claim 1,
wherein the DNS message comprises a first DNS response that indicates the plurality of endpoints as respective IP addresses, and
wherein the DNS response to the client device is a second DNS response, and
wherein determining that the first endpoint of the plurality of endpoints is preferable comprises:
sending, by the intermediate device in response to receiving the first DNS response, a corresponding probe packet to each of the IP addresses;
receiving, by the intermediate device and from each of the IP addresses, a probe packet reply corresponding to the respective probe packet for the IP address;
determining, by the intermediate device and based on information from the probe packets and the probe packet replies, a set of network performance metrics for each of the IP addresses; and
determining, based on the sets of the network performance metrics, the IP address for the first endpoint is preferable.

### Claim 8 (depends on 1)

The method of claim 1, wherein determining that the first endpoint of the plurality of endpoints is preferable comprises:
sending, by the intermediate device, at a periodic interval, a corresponding probe packet to each of the plurality of endpoints;
receiving, by the intermediate device and from each of the plurality of endpoints, a probe packet reply corresponding to the respective probe packet for the endpoint; and
determining, by the intermediate device and based on information from the probe packets and the probe packet replies, a set of network performance metrics for each of the plurality of endpoints.

### Claim 9 (depends on 1)

The method of claim 1, wherein determining that the first endpoint of the plurality of endpoints is preferable comprises:
sending, by the intermediate device, based on application traffic parameters, a corresponding probe packet to each of the plurality of endpoints, wherein the application traffic parameters comprises at least one of Differentiated Services Code Point (DSCP) values, forwarding class, packet size, and burst of traffic from the endpoints;
receiving, by the intermediate device and from each of the endpoints, a probe packet reply corresponding to the respective probe packet for the endpoint; and
determining, by the intermediate device and based on information from the probe packets and the probe packet replies, a set of network performance metrics for each of the endpoints.

### Claim 10 (depends on 1)

The method of claim 1, wherein determining that the first endpoint of the plurality of endpoints is preferable comprises:
sending, by the intermediate device, based on a determination that traffic from the endpoints has a constant traffic rate, a corresponding probe packet to each of the endpoints at a constant interval;
receiving, by the intermediate device and from each of the plurality of endpoints, a probe packet reply corresponding to the respective probe packet for the endpoint; and
determining, by the intermediate device and based on information from the probe packets and the probe packet replies, a set of network performance metrics for each of the plurality of endpoints.

### Claim 11 (depends on 1)

The method of claim 1, wherein determining that the first endpoint of the plurality of endpoints is preferable comprises:
sending, by the intermediate device, based on a determination that traffic from the plurality of endpoints does not have a constant traffic rate, a corresponding probe packet to each of the endpoints at an interval proportional to the traffic from the endpoints;
receiving, by the intermediate device and from each of the endpoints, a probe packet reply corresponding to the respective probe packet for the endpoint; and
determining, by the intermediate device and based on information from the probe packets and the probe packet replies, a set of network performance metrics for each of the endpoints.

### Claim 12

A network device, wherein the network device is situated on respective network paths that traverse a network connecting a client device and a plurality of endpoints that each offers a same service and are mapped to a same hostname, the network device comprising:
a memory; and
one or more processors in communication with the memory, the one or more processors configured to:
receive a Domain Name System (DNS) message that indicates the plurality of endpoints;
determine, based on respective sets of network performance metrics for the plurality of endpoints, that a first endpoint of the plurality of endpoints is preferable for offering the service to the client device;
generate, in response to the DNS message and based on determining that the first endpoint is preferable for offering the service to the client device, a DNS response that specifies an Internet Protocol (IP) address of the first endpoint as a primary IP address; and
send, the DNS response to the client device to cause the client device to send a service request to the IP address of the first endpoint.

### Claim 13 (depends on 12)

The network device of claim 12, wherein, to determine that the first endpoint of the plurality of endpoints is preferable, the one or more processors are configured to:
send a corresponding probe packet to each of the plurality of endpoints;
receive, from each of the plurality of endpoints, a probe packet reply corresponding to the respective probe packet for the endpoint; and
determine, based on information from the probe packets and the probe packet replies, a set of network performance metrics for each of the plurality of endpoints.

### Claim 14 (depends on 13)

The network device of claim 13, wherein each of the probe packets conforms to at least one of Internet Control Message Protocol (ICMP), Two-Way Active Measurement Protocol (TWAMP), or Hypertext Transfer Protocol (HTTP).

### Claim 15 (depends on 12)

The network device of claim 12,
wherein the DNS message comprises a first DNS response that indicates the plurality of endpoints as respective IP addresses, and
wherein the DNS response to the client device is a second DNS response, and
wherein, to determine that the first endpoint of the plurality of endpoints is preferable, the one or more processors are further configured to:
send, in response to receiving the first DNS response, a corresponding probe packet to each of the IP addresses;
receive, from each of the IP addresses, a probe packet reply corresponding to the respective probe packet for the IP address;
determine, based on information from the probe packets and the probe packet replies, a set of network performance metrics for each of the IP addresses; and
determine, based on the sets of the network performance metrics, the IP address for the first endpoint is preferable.

### Claim 16 (depends on 12)

The network device of claim 12, wherein, to determine that the first endpoint of the plurality of endpoints is preferable, the one or more processors are configured to:
send, at a periodic interval, a corresponding probe packet to each of the plurality of endpoints;
receive, from each of the plurality of endpoints, a probe packet reply corresponding to the respective probe packet for the endpoint; and
determine, based on information from the probe packets and the probe packet replies, a set of network performance metrics for each of the plurality of endpoints.

### Claim 17 (depends on 12)

The network device of claim 12, wherein, to determine that the first endpoint of the plurality of endpoints is preferable, the one or more processors are configured to:
send, based on application traffic parameters, a corresponding probe packet to each of the plurality of endpoints, wherein the application traffic parameters comprises at least one of Differentiated Services Code Point (DSCP) values, forwarding class, packet size, and burst of traffic from the endpoints;
receive, from each of the endpoints, a probe packet reply corresponding to the respective probe packet for the endpoint; and
determine, based on information from the probe packets and the probe packet replies, a set of network performance metrics for each of the endpoints.

### Claim 18 (depends on 12)

The network device of claim 12, wherein, to determine that the first endpoint of the plurality of endpoints is preferable, the one or more processors are configured to:
send, based on a determination that traffic from the endpoints has a constant traffic rate, a corresponding probe packet to each of the endpoints at a constant interval;
receive, from each of the plurality of endpoints, a probe packet reply corresponding to the respective probe packet for the endpoint; and
determine, based on information from the probe packets and the probe packet replies, a set of network performance metrics for each of the plurality of endpoints.

### Claim 19 (depends on 12)

The network device of claim 12, wherein, to determine that the first endpoint of the plurality of endpoints is preferable, the one or more processors are configured to:
send based on a determination that traffic from the plurality of endpoints does not have a constant traffic rate, a corresponding probe packet to each of the endpoints at an interval proportional to the traffic from the endpoints;
receive, from each of the endpoints, a probe packet reply corresponding to the respective probe packet for the endpoint; and
determine, based on information from the probe packets and the probe packet replies, a set of network performance metrics for each of the endpoints.

### Claim 20

A computer-readable storage medium of a network device situated on respective network paths that traverse a network connecting a client device and a plurality of endpoints that each offers a same service and are mapped to a same hostname, the network device storing instructions that cause a processor to:
receive a Domain Name System (DNS) message that indicates the plurality of endpoints;
determine, based on respective sets of network performance metrics for the plurality of endpoints, that a first endpoint of the plurality of endpoints is preferable for offering the service to the client device;
generate, in response to the DNS message and based on determining that the first endpoint is preferable for offering the service to the client device, a DNS response that specifies an Internet Protocol (IP) address of the first endpoint as a primary IP address; and
send, the DNS response to the client device to cause the client device to send a service request to the IP address of the first endpoint.
