Methods and architecture for load-correcting requests for serverless functions
AssigneeCisco Technology, Inc.
InventorsIan James Wells, Kyle Andrew Donald Mestery
Life of this patent
Estimating the term…
Loading patent…
AssigneeCisco Technology, Inc.
InventorsIan James Wells, Kyle Andrew Donald Mestery
Estimating the term…
Methods and architecture for load-correcting requests for serverless functions to reduce latency of serverless computing are provided. An example technique exploits knowledge that a given server node does not have a serverless function ready to run or is overloaded. Without further processing overhead or communication, the server node shifts the request to a predetermined alternate node without assessing a current state of the alternate node, an efficient decision based on probability that a higher chance of fulfillment exists at the alternate node than at the current server, even with no knowledge of the alternate node. In an implementation, the server node refers the request but also warms up the requested serverless function, due to likelihood of repeated requests or in case the request is directed back. An example device has a front-end redirecting server and a backend serverless system in a single component.
A method for reducing latency of serverless computing in a cloud computing network using one to one-of-many routing, comprising:
A computing network with infrastructure for running serverless functions, comprising:
A server node for a cloud computing network hosting serverless functions, comprising:
Dependencies are inferred from the claim text.