Managing load in request processing environments
AssigneeOracle International Corporation
InventorRafiul AHAD
Life of this patent
Estimating the term…
Abstract
Systems, methods, and other embodiments that manage load in request processing environments are described. In one embodiment, a method includes receiving, at a backend of a request processing environment, requests transmitted by frontends. The backend is controlled to process the requests to create responses that are transmitted back to the frontends. Load of the backend processing the requests is monitored. In response to the load exceeding a threshold, a retry interval is calculated as a function of the load. In response to receiving a subsequent request from a frontend, a command is transmitted to the frontend. The command modifies operation of the frontend to wait the retry interval before re-transmitting the subsequent request as a retry request and to avoid generating an error message.
Claims20
A non-transitory computer-readable medium storing computer-executable instructions that when executed by a processor of a computing device causes the processor to:
- receive, at a backend of a request processing environment, requests transmitted by frontends over a network to the backend;
- control the backend to process the requests to create responses that are transmitted over the network to the frontends that sent the requests;
- monitor a load of the backend processing the requests;
- in response to the load exceeding a threshold:
- calculate a retry interval as a function of the load;
- and
- in response to receiving a subsequent request from a frontend, transmit a command to the frontend, wherein the command modifies operation of the frontend to wait the retry interval before re-transmitting the subsequent request as a retry request and avoid generating an error message.
A computing system of a computing node, comprising:
- a processor connected to memory;
- and
- a retry module stored on a non-transitory computer readable medium and configured with instructions that when executed by the processor cause the processor to:
- receive, at a backend of a request processing environment, requests transmitted by frontends over a network to the backend;
- control the backend to process the requests to create responses that are transmitted over the network to the frontends that sent the requests;
- monitor a load of the backend processing the requests;
- in response to the load exceeding a threshold:
- (i) calculate a retry interval as a function of the load;
- and
- (ii) in response to receiving a subsequent request from a frontend, transmit a command to the frontend, wherein the command modifies operation of the frontend to wait the retry interval before re-transmitting the subsequent request as a retry request.
A computer-implemented method, the computer-implemented method involving a computing node comprising a processor, and the computer-implemented method comprising:
- receiving, at a backend of a request processing environment by the processor, requests transmitted by frontends over a network to the backend;
- controlling, by the processor, the backend to process the requests to create responses that are transmitted over the network to the frontends that sent the requests;
- monitoring, by the processor, a load of the backend processing the requests;
- in response to the load exceeding a threshold:
- (i) calculating, by the processor, a retry interval as a function of the load;
- and
- (ii) in response to receiving a subsequent request from a frontend, transmitting, by the processor, a command to the frontend, wherein the command modifies operation of the frontend to wait the retry interval before re-transmitting the subsequent request as a retry request.
Dependencies are inferred from the claim text.