# US 2020/0404047 A1 · Configurable connection reset for customized load balancing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404047 A1
- Document ID: US20200404047A1
- Status: Published application
- Kind: A1
- Application number: 16/547,038
- Filed: 2019-08-21
- Published: 2020-12-24
- Earliest claimed: 2019-06-24
- Assignees: Walmart Apollo, LLC
- Applicants: Walmart Apollo, LLC
- Inventors: Laxmikant Kurhe; Suraj Menon
- Web page: https://patentgrep.com/patent/US20200404047A1

## CPC

- H04L 67/1004: Server selection for load balancing
- H04L 67/1008: based on parameters of servers, e.g. available memory or workload (monitoring of computer activity G06F11/30)
- H04L 41/06: Management of faults, events, alarms or notifications
- H04L 41/0681: Configuration of triggering conditions
- H04L 43/0817: by checking functioning
- H04L 43/16: Threshold monitoring
- H04L 67/1012: based on compliance of requirements or conditions with available server resources
- H04L 67/1017: based on a round robin mechanism
- H04L 67/14: Session management (for real-time applications in data packet communications networks H04L65/1066)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Examples provide a configurable connection reset system for customized distribution of incoming traffic to a plurality of servers. The connection reset component routes incoming service requests to active servers based on server performance, configurable server failure criteria, user-selected inactive threshold wait time-period for each server and per-client distribution configurations, including server priorities and user-selected distribution methodology or combination of distribution methodologies. A configurable wait time-period is assigned to each inactive server removed from a distribution rotation for the incoming traffic. A next received request to the next available server for the identified client. An inactive server is updated to active status and returned to the distribution rotation after expiration of the configurable wait time-period.

## Claims

### Claim 1

A system for customized distribution of incoming traffic to a plurality of servers, the system comprising:
a memory;
at least one processor communicatively coupled to the memory;
a communications interface component, implemented on the at least one processor, receives a plurality of service requests from a plurality of client devices via a network;
a status component, implemented on the at least one processor, analyzes dynamic server performance data associated with each server in the plurality of servers in real-time with a set of user-configured threshold failure criteria to identify a status of each server;
a data storage device stores the status of each server in the plurality of servers, the status comprising an active status or an inactive status;
a connection manager, implemented on the at least one processor, assigns a configurable wait time-period to each server in the plurality of servers having the inactive status, wherein each server having the inactive status is removed from a distribution rotation for the configurable wait time-period;
a selection component, implemented on the at least one processor, identifies a next available server in a set of active servers in the plurality of servers based on a per-client set of user-selected distribution configurations associated with an identified client and the status of each server in the plurality of servers on condition a request is received from the identified client, the per-client set of user-selected distribution configurations including a set of server priorities assigned to the plurality of servers and a selected distribution rotation methodology associated with the identified client; and
a routing component, implemented on the at least one processor, sends a next received request to the next available server for the identified client.

### Claim 2 (depends on 1)

The system of claim 1, further comprising:
a timing component, implemented on the at least one processor, monitors a duration of time a selected inactive server has the inactive status, wherein the status of the server changes from the inactive status to the active status on expiration of the configurable wait time-period.

### Claim 3 (depends on 1)

The system of claim 1, further comprising:
an update component, implemented on the at least one processor, updates the status of a selected server from the inactive status to the active status on condition the server has remained inactive for the configurable wait time-period.

### Claim 4 (depends on 1)

The system of claim 1, further comprising:
a set of connection reset methodologies associated with the identified client, wherein the set of connection reset methodologies further comprises at least one of a round robin distribution, a priority-based distribution, weighted distribution, least connection first, a request-type distribution or a combination distribution method.

### Claim 5 (depends on 1)

The system of claim 1, wherein the set of user-configured threshold failure criteria further comprises at least one of a server performance threshold, a speed threshold, a lag-time threshold, a number of connections threshold or a percentage resource usage threshold.

### Claim 6 (depends on 1)

The system of claim 1, further comprising:
a database associated with the data storage device, the database storing a list of active servers and a list of inactive servers, wherein the list of active servers and the list of inactive servers are updated dynamically based on real-time server performance data.

### Claim 7 (depends on 1)

The system of claim 1, further comprising:
a first set of user-selected distribution configurations associated with a first client and a second set of user-selected distribution configurations associated with a second client, wherein a first request received from the first client is routed in accordance with a distribution rotation methodology identified based on the first set of user-selected distribution configurations and a second request received from the second client is routed in accordance with a different distribution rotation methodology identified based on the second set of user-selected distribution configurations.

### Claim 8 (depends on 1)

The system of claim 1, wherein the set of user-configured threshold failure criteria further comprises:
a first set of threshold failure criteria associated with a first server in the plurality of servers; and
a second set of threshold failure criteria associated with a second server in the plurality of servers, wherein the second set of threshold failure criteria applied to determine whether the first server has the active status comprises at least one different criterion than the criteria applied to determine whether the second server has the active status.

### Claim 9 (depends on 1)

The system of claim 1, wherein the configurable wait time-period further comprises:
a first wait time-period assigned to a first server in the plurality of servers; and
a second wait time-period assigned to a second server in the plurality of servers, wherein the first wait time-period is a different amount of time than the second wait time-period, wherein the first server remains on a list of inactive servers for a different duration of time than the second server.

### Claim 10

A computer-implemented method for customized distribution of incoming traffic to a plurality of servers, the method comprising:
receiving, via a communications interface component, a service request from an identified client device via a network;
analyzing, by a status component, dynamic server performance data associated with each server in the plurality of servers in real-time with a set of user-configured threshold failure criteria to update a set of available servers based on the status of each server;
identifying, by a selection component, a next available server in a set of active servers based on a set of user-selected distribution configurations associated with the identified client, the set of user-selected distribution configurations including a selected distribution rotation methodology associated with the identified client; and
sending, by a routing component, the service request to the next available server.

### Claim 11 (depends on 10)

The computer-implemented method of claim 10, further comprising:
assigning, by a connection manager, a configurable wait time-period to each server in the plurality of servers having an inactive status, wherein each server having the inactive status is removed from a distribution rotation for the configurable wait time-period.

### Claim 12 (depends on 10)

The computer-implemented method of claim 10, further comprising:
monitoring, by a timing component, a duration of time on a selected inactive server has had an inactive status, wherein the status of the server changes from the inactive status to the active status on expiration of a configurable wait time-period.

### Claim 13 (depends on 10)

The computer-implemented method of claim 10, wherein the selected distribution rotation methodology further comprises at least one of a round robin distribution, a priority-based distribution, weighted distribution, least connection first or request-type distribution.

### Claim 14 (depends on 10)

The computer-implemented method of claim 10, further comprising:
routing a first request received from a first client in accordance with a first set of user-selected distribution configurations associated with the first client; and
routing a second request received from a second client in accordance with a second set of user-selected distribution configurations associated with the second client, wherein the first request received from the first client is routed in accordance with a first distribution rotation methodology identified based on the first set of user-selected distribution configurations and the second request received from the second client is routed in accordance with a different second distribution rotation methodology identified based on the second set of user-selected distribution configurations.

### Claim 15 (depends on 10)

The computer-implemented method of claim 10, further comprising:
changing the status of a first server from active status to inactive status based on a first set of threshold failure criteria associated with the first server in the plurality of servers; and
changing the status of a second server from the active status to the inactive status based on a second set of threshold failure criteria associated with the second server in the plurality of servers, wherein criteria applied to determine whether the first server has the active status comprises at least one different criterion than the criteria applied to determine whether the second server has the active status.

### Claim 16 (depends on 10)

The computer-implemented method of claim 10, further comprising:
placing a first server on a list of inactive servers for a first wait time-period; and
placing a second server on the list of inactive servers for a second wait time-period, wherein the first wait time-period is a different amount of time than the second wait time-period, wherein the first server remains on the list of inactive servers for a different duration of time than the second server.

### Claim 17

One or more computer storage devices, having computer-executable instructions for customized distribution of incoming traffic to a plurality of servers by a connection reset component, that, when executed by a computer cause a computer to perform operations comprising:
receiving a plurality of service requests from a plurality of client devices via a network;
analyzing dynamic server performance data associated with each server in the plurality of servers in real-time using a set of user-configured threshold failure criteria to identify a status of each server;
removing a set of inactive servers from a list of active servers based on the server status of each server in the plurality of servers;
assigning a configurable wait time-period to each server in the plurality of servers having an inactive status, wherein each server having the inactive status is removed from a distribution rotation for the configurable wait time-period;
selecting a next available server from a set of active servers on the list of active servers based on the distribution rotation and a per-client set of user-selected distribution configurations associated with an identified client on condition a request is received from the identified client; and
sending the request to the next available server.

### Claim 18 (depends on 17)

The one or more computer storage devices of claim 17, wherein the connection reset component, when further executed by the computer, cause the computer to perform operations comprising:
routing a first request received from a first client in accordance with a first set of user-selected distribution configurations associated with the first client; and
routing a second request received from a second client in accordance with a second set of user-selected distribution configurations associated with the second client, wherein the first request received from the first client is routed in accordance with a first distribution rotation methodology identified based on the first set of user-selected distribution configurations and the second request received from the second client is routed in accordance with a different second distribution rotation methodology identified based on the second set of user-selected distribution configurations.

### Claim 19 (depends on 17)

The one or more computer storage devices of claim 17, wherein the connection reset component, when further executed by the computer, cause the computer to perform operations comprising:
changing the status of a first server from the active status to the inactive status based on a first set of threshold failure criteria associated with the first server in the plurality of servers; and
changing the status of a second server from the active status to the inactive status based on a second set of threshold failure criteria associated with the second server in the plurality of servers, wherein criteria applied to determine whether the first server has the active status comprises at least one different criterion than the criteria applied to determine whether the second server has the active status.

### Claim 20 (depends on 17)

The one or more computer storage devices of claim 17, wherein the connection reset component, when further executed by the computer, cause the computer to perform operations comprising:
placing a first server on a list of inactive servers for a first wait time-period; and
placing a second server on the list of inactive servers for a second wait time-period, wherein the first wait time-period is a different amount of time than the second wait time-period, wherein the first server remains on the list of inactive servers for a different duration of time than the second server.
