System and method to balance servers based on server load status

A non-transitory computer readable storage medium having embodied thereon instructions, the instructions being executable by a processor to perform a method for balancing servers, the method comprising:

• receiving, by the service gateway, a first service request from a host, the service request including a first Uniform Resource Locator (URL) associated with at least one server of a plurality of servers, each URL of URLs being individually resolved to a primary server configured to process the URL and a secondary server configured to process the URL, each server of the plurality of servers being configured as one of primary servers and one of secondary servers for different URLs such that any given server resolves as a primary server for a first given URL and resolves as a secondary server for a second given URL, the service gateway being configured to automatically select, for each URL of the URLs, the primary server configured to process the URL for processing service requests associated with the URL;
• determining that a first server is the primary server configured to process the first URL and a second server is the secondary server configured to process the first URL;
• based on the determining that the first server is the primary server, selecting the primary server associated with the first URL to process the first service request;
• receiving a service response from the primary server, the service response including a server status indicating a computing load status of the primary server;
• obtaining the server status from the service response;
• and
• using the server status from the service response to determine whether the first server is available to process a second service request including a URL associated with at least one server.

A system comprising:

• a processor;
• and a memory coupled to the processor, the memory storing instructions, the instructions being executable by the processor to perform a method for balancing servers, the method comprising:
• receiving, by the service gateway, a first service request from a host, the service request including a first Uniform Resource Locator (URL) associated with at least one server of a plurality of servers, each URL of URLs being individually resolved to a primary server configured to process the URL and a secondary server configured to process the URL, each server of the plurality of servers being configured as one of primary servers and one of secondary servers for different URLs such that any given server resolves as a primary server for a first given URL and resolves as a secondary server for a second given URL, the service gateway being configured to automatically select, for each URL of the URLs, the primary server configured to process the URL for processing service requests associated with the URL;
• determining that a first server is the primary server configured to process the first URL and a second server is the secondary server configured to process the first URL;
• based on the determining that the first server is the primary server, selecting the primary server associated with the first URL to process the first service request;
• receiving a service response from the primary server, the service response including a server status indicating a computing load status of the primary server;
• obtaining the server status from the service response;
• and
• using the server status from the service response to determine whether the first server is available to process a second service request including a URL associated with at least one server.