Method and system for managing data stream processing

A stream processing system for managing data stream processing tasks of a predefined application topology, the system comprising:

• one or more data producers;
• one or more compute nodes wherein the one or more compute nodes and the one or more data producers are geographically distributed in different physical locations;
• one or more result consumers;
• and
• a task manager,
• wherein the system is configured to assign geographic scope granularities to the data stream processing tasks of the predefined application topology, wherein the geographic scope granularities of the data stream processing tasks are defined based on geographic location attributes, including geographic location attribute values, associated with data streams, wherein each data stream processing task includes one or more unique geographic location attribute values,
• wherein a result consumer of the one or more result consumers is configured to send a subscription to the task manager in order to trigger data processing for computing a result,
• wherein the subscription includes geographic scope related information concerning the triggered data processing,
• wherein the task manager is further configured to generate an execution plan including one or more task instances for performing the triggered data processing based on the geographic scope related information of the subscription and the geographic scope granularities assigned to the data stream processing tasks of the predefined application topology, wherein a number of task instances for each data stream processing task included in the execution plan is based on a number of unique geographic location attribute values for each said data stream processing task
• wherein the task manager is further configured to generate from the execution plan a deployment plan for deploying the task instances of the execution plan on the compute nodes based on physical location information of the compute nodes and location information of the data producers;
• and
• wherein the task manager is further configured to update the deployment plan in real-time based on detected changes of the physical location of the one or more compute nodes.