Scalable Local Cache in Distributed Streaming Platform for Real-Time Applications

Computer readable media having non-transitory programming instructions for processing an application, comprising:

• program instructions for receiving the application that runs on a streaming platform, wherein the application is structured as a directed acyclic graph (DAG) with instances of operators as nodes and streams as edges between nodes and wherein multiple instances of an operator access a shared database;
• program instructions for setting a maximum period of time for a local caching of a result from a query of the database by each of the multiple instances;
• program instructions for launching the application by assigning the instances of operators to one or more containers provided by the streaming platform, wherein each container is a process associated with a local cache that is an allocation of volatile memory created by the streaming platform on an as needed basis and that performs the local caching;
• program instructions for receiving a request from the application through an application programming interface (API) to make a dynamic adjustment that increases the maximum period of time for the local caching of a result from a query of the database;
• and
• program instructions for executing the dynamic adjustment and re-launching the application using a recovery policy, wherein each of the operations is executed by one or more processors in real-time or near real-time rather than offline.