US 11,457,064 B2 · Connection service discovery and load rebalancing

Abstract

In a networked data system, a discovery protocol enables clients to establish connections to one a plurality of database servers to utilize a distributed connection service. The service manages connections between application servers, i.e. clients, and databases. An initial request from the client is received by a load balancer. The load balancer responds to the client by identifying an assigned connection to one of the database servers based on load considerations. The client sends a secondary request directly to the assigned connection, bypassing the load balancer. The service establishes a persistent link on the assigned connection and assigns a time-to-live (TTL), during which the service connects data requests to the databases. Upon expiration of the TTL, the service completes a next data request received, then notifies the client that the connection is no longer valid, thereby requiring a new connection through the load balancer and rebalancing system traffic.

Claims20

Dependent claims

A computer-implemented method to enable discovery of a connection service by clients communicating data requests, the computer-implemented method comprising:

maintaining, on a plurality of nodes, a plurality of client connections available for connection to a plurality of clients;
receiving from a client among the plurality of clients, at a load balancer, an initial request to be assigned a connection to one node of the plurality of nodes, the plurality of nodes operating a connection service managing connections between the plurality of clients and a plurality of databases;
accessing, by the load balancer, metrics data reflecting load conditions on the plurality of nodes;
determining, by the load balancer, an assigned connection to a node based on the load conditions;
sending, from the node having the assigned connection, identification of the assigned connection to the client;
receiving at the assigned connection on the node, directly from the client, a secondary request;
establishing, responsive to receiving the secondary request directly from the client and on the assigned connection on the node, a persistent link between the client and the node, bypassing the load balancer;
and
receiving at least one data request from the client on the persistent link.

6 more elements

A system comprising:

a load balancer;
and
a plurality of nodes;
wherein the load balancer includes one or more processors and a memory in communication with the one or more processors, the memory having first computer-readable instructions stored thereon which, when executed by the one or more processors, cause the load balancer to:
receive from a client among a plurality of clients an initial request to be assigned a connection to one node of the plurality of nodes;
access metrics data reflecting load conditions on the plurality of nodes;
and
determine, from among a plurality of client connections at the plurality of nodes, an assigned connection to a node based on the load conditions of the plurality of nodes;
wherein each node of the plurality of nodes includes one or more node processors and a node memory in communication with the one or more node processors, the node memory having second computer-readable instructions stored thereon which, when executed by the one or more node processors, cause the node to:
maintain the plurality of client connections available for connection to the plurality of clients;
send identification of the assigned connection to the client as determined by the load balancer;
receive, directly from the client, a secondary request at the assigned connection;
establish, responsive to receiving the secondary request directly from the client and on the assigned connection, a persistent link between the client and the node, bypassing the load balancer;
and
receive at least one data request from the client on the persistent link.

12 more elements

A computer-readable storage medium, not including waves or signals per se, having computer-executable instructions stored thereupon, which, when executed by a processor of a computing device, cause the computing device to:

maintain a plurality of client connections available for connection to a plurality of clients;
report, to a load balancer, metrics data reflecting load conditions on plurality of nodes, such that the load balancer can select, responsive to receiving, from a client among the plurality of clients, an initial request at the load balancer, an assigned connection based on the load conditions;
notify the client requesting a connection via the initial request, of identification of the assigned connection on a node of the plurality of nodes;
receive, on the assigned connection, directly from the client, a secondary request;
establish, responsive to receiving the secondary request directly from the client and on the assigned connection, a persistent link between the client and the node, bypassing the load balancer;
and
receive at least one data request from the client on the persistent link.

4 more elements

Dependencies are inferred from the claim text.

Connection service discovery and load rebalancing

Life of this patent

Connection service discovery and load rebalancing

Life of this patent

Abstract

Claims20