# US 2015/0106424 A1 · Methods and systems for load balancing using forecasting and overbooking techniques

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0106424 A1
- Document ID: US20150106424A1
- Status: Published application
- Kind: A1
- Application number: 14/571,081
- Filed: 2014-12-15
- Published: 2015-04-16
- Earliest claimed: 2009-06-30
- Assignees: Citrix Systems, Inc.
- Applicants: Citrix Systems, Inc.
- Inventors: Nitin Desai; Steve Dillon; David Stone
- Web page: https://patentgrep.com/patent/US20150106424A1

## CPC

- G06F 9/5083: {Techniques for rebalancing the load in a distributed system}
- H04L 47/76: using dynamic resource allocation, e.g. in-call renegotiation requested by the user or requested by the network in response to changing network conditions
- H04L 67/1001: for accessing one among a plurality of replicated servers
- H04L 67/1008: based on parameters of servers, e.g. available memory or workload (monitoring of computer activity G06F11/30)
- H04L 67/1012: based on compliance of requirements or conditions with available server resources
- H04L 67/1029: using data related to the state of servers by a load balancer
- H04L 67/568: Storing data temporarily at an intermediate stage, e.g. caching
- G06F 9/505: {considering the load}
- H04L 67/1004: Server selection for load balancing
- H04L 67/1027: Persistence of sessions during load balancing
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Methods and systems for establishing user sessions between a client and a server or server farm can be carried out by a load balancing agent executing on a computer in communication with the client, server or server farm. The load balancing agent can intercept a connection request generated by an application executing on a client and responsively select a server on which to establish a user session. Selecting the server can be based on overbooking a particular server and choosing a server with a predetermined amount of forecasted load. Forecasted load can be determined by summing the current load on a server with a current load calculated by multiplying: the average load on the user sessions hosted by the server; by the number of cached user sessions stored on the server; and by the probability that a cached user session reconnects.

## Claims

### Claim 1

A method comprising
(a) receiving, by an agent, a request to establish a session with an application available via a plurality of servers;
(b) determining, by the agent, a load for each server of the plurality of servers using a number of cached sessions on each server and a load of a plurality of sessions on each server;
(c) selecting, by the agent, a server from the plurality of servers using a comparison of the load of each server; and
(d) facilitating, by the agent, establishing the session with the application on the selected server.

### Claim 2 (depends on 1)

The method of claim 1, further comprising executing the agent on a server of the plurality of servers.

### Claim 3 (depends on 1)

The method of claim 1, wherein (a) further comprises receiving, by the agent, the request generated by a client.

### Claim 4 (depends on 1)

The method of claim 1, wherein (b) further comprising determining the load of the plurality of sessions on each server by computing an average of loads of the plurality of sessions on each server.

### Claim 5 (depends on 1)

The method of claim 1, wherein (b) further comprising determining the load using a probability that a cached session will reconnect.

### Claim 6 (depends on 5)

The method of claim 5, further comprising determining the probability by tracking a number of cached sessions that reconnect.

### Claim 7 (depends on 1)

The method of claim 1, wherein (b) further comprises determining the number of cached session on each server by determining one of a number of inactive sessions stored in a cache of each server or a number of user session credentials stored in the cache.

### Claim 8 (depends on 1)

The method of claim 1, wherein (c) further comprises selecting, by the agent, the server responsive to determining that the session of the request does not have a corresponding cached session.

### Claim 9 (depends on 1)

The method of claim 1, wherein (c) further comprises selecting, by the agent, the server responsive to determining that the load of the server is less an amount of resources on the server.

### Claim 10 (depends on 9)

The method of claim 9, wherein the amount of resources on the server includes one or more of determining a size of a processor of the server, a number of available processors, an amount of memory and an amount of bandwidth.

### Claim 11

A system comprising
an agent configured on a device and to receive a request to establish a session with an application available via a plurality of servers;
wherein the agent is configured to determine a load for each server of the plurality of servers using a number of cached sessions on each server and a load of a plurality of sessions on each server;
select a server from the plurality of servers using a comparison of the load of each server; and
facilitate establishing the session with the application on the selected server.

### Claim 12 (depends on 11)

The system of claim 11, wherein the device is a server of the plurality of servers.

### Claim 13 (depends on 11)

The system of claim 11, wherein the agent is further configured to receive the request generated by a client.

### Claim 14 (depends on 11)

The system of claim 11, wherein the agent is further configured to determine the load of the plurality of sessions on each server by computing an average of loads of the plurality of sessions on each server.

### Claim 15 (depends on 11)

The system of claim 11, wherein the agent is further configured determine the load using a probability that a cached session will reconnect.

### Claim 16 (depends on 15)

The system of claim 15, wherein the agent is further configured to determine the probability by tracking a number of cached sessions that reconnect.

### Claim 17 (depends on 11)

The system of claim 11, wherein the agent is further configured to determine the number of cached session on each server by determining one of a number of inactive sessions stored in a cache of each server or a number of user session credentials stored in the cache.

### Claim 18 (depends on 11)

The system of claim 11, wherein the agent is further configured to select the server responsive to determining that the session of the request does not have a corresponding cached session.

### Claim 19 (depends on 11)

The system of claim 11, wherein the agent is further configured to select the server responsive to determining that the load of the server is less an amount of resources on the server.

### Claim 20 (depends on 19)

The system of claim 19, wherein the amount of resources on the server includes one or more of determining a size of a processor of the server, a number of available processors, an amount of memory and an amount of bandwidth.
