Scalable local cache in distributed streaming platform for real-time applications

One or more computer-readable media that are non-transitory and that store one or more programs, wherein the one or more programs, when executed, instruct one or more processors to perform the following operations:

• receive an application that runs on a streaming platform, wherein the application is structured as a directed acyclic graph (DAG) with instances of operators as nodes and streams as edges between nodes and wherein multiple instances of an operator access a shared database;
• receive a pre-defined hint associated with the application, wherein the pre-defined hint sets a maximum period of time for a local caching of a result from a query of the database by each of the multiple instances;
• launch the application by assigning the instances of operators to one or more containers provided by the streaming platform and initiating the streams, wherein each container is a process associated with a local cache that is an allocation of volatile memory created by the streaming platform on an as needed basis and that performs the local caching;
• monitor a performance statistic for accesses to the database by each of the multiple instances and transmit results of the monitoring to the application through an application programming interface (API) exposed by the streaming platform;
• receive a request from the application through the API to make a dynamic adjustment that increases the maximum period of time for the local caching of a result from a query of the database by each of the multiple instances;
• and
• make the dynamic adjustment and re-launch the application using a recovery policy, wherein each of the operations is executed in real time or near real time rather than offline.

A method, comprising the operations of:

• receiving an application that runs on a streaming platform, wherein the application is structured as a directed acyclic graph (DAG) with instances of operators as nodes and streams as edges between nodes and wherein multiple instances of an operator access a shared database;
• receiving a pre-defined hint associated with the application, wherein the pre-defined hint sets a maximum period of time for a local caching of a result from a query of the database by each of the multiple instances;
• launching the application by assigning the instances of operators to one or more containers provided by the streaming platform and initiating the streams, wherein each container is a process associated with a local cache which is resizable upward or downward, and wherein the local cache performs the local caching and is an allocation of volatile memory created by the streaming platform on an as needed basis;
• monitoring a performance statistic for accesses to the database by each of the multiple instances and transmitting results of the monitoring to the application through an application programming interface (API) exposed by the streaming platform;
• receiving a request from the application through the API to make a dynamic adjustment that increases the maximum period of time for the local caching of a result from a query of the database by each of the multiple instances;
• and
• making the dynamic adjustment and re-launching the application, wherein each of the operations is executed by one or more processors in real time or near real time rather than offline.