Loading patent…
AssigneeInternational Business Machines Corporation
InventorErez Hadad
Estimating the term…
Provided herein are methods and systems for providing a function as a service in a predictably timed manner, for example within a deadline or in a given frequency. A specialized executor function, namely a custom runner, is called from the function service using a wrapper function on the framework controller. The process allocates some, or all of the required computing resources required to execute a function on the initialization stage, based on foresight. The custom runner function may keep the resources for expected function service requests, or terminate in accordance with prediction rules thereof. The disclosure supports different platforms, and custom scheduling algorithms, for real-time use-cases, demand prediction, custom function execution, and the like. The disclosure mitigates overhead due to startup and shutdown delays, which may be incurred by opening and closing a database connection, loading and unloading a neural network to physical memory, and the likes.
A system, comprising:
A computer implemented method, using at least one computing node comprising one or more processors to provide a plurality of users with a function as a service (FaaS) platform comprising a plurality of software function services, wherein the one or more processors when executed cause the at least one computing node to implement the computer implemented method comprising:
A non-transitory computer readable medium having instructions stored thereon, which, when executed by one or more processors of a computer, cause the computer to provide a plurality of users with a function as a service (FaaS) platform comprising a plurality of software function services, wherein the instructions comprise:
Dependencies are inferred from the claim text.