System and method facilitating reusability of distributed computing pipelines

A system for facilitating reusability of distributed computing pipelines, the system comprising:

• a processor;
• and
• a memory coupled to the processor, wherein the processor is capable of executing a plurality of modules stored in the memory, and wherein the plurality of modules comprising:
• a pipeline designing module is configured for capturing a set of versions pertaining to a distributed computing pipeline designed by a first user, over a Graphical User Interface (GUI) of a first data processing environment associated with a stream analytics platform, wherein each version indicates same or distinct business logic, and wherein the distributed computing pipeline comprises:
• a subset of components, selected by the first user of the data processing environment from a universal set of components of the stream analytics platform, and a set of links corresponding to the subset of components;
• an export module is configured for storing the distributed computing pipeline with the set of versions in a repository, wherein the distributed computing pipeline with the set of versions are stored in a file with a predefined file format pertaining to the stream analytics platform, wherein each version of pipeline is stored along with metadata associated with each version of the pipeline wherein the file is configured to maintain components and configurations of the distributed computing pipeline comprising a name, a structure, messages, message groups, alerts, agent configurations, transformation variables, scope variables, wherein user defined functions and registered components enables the user for designing a new pipeline or modifying an existing pipeline, wherein the registered components have list of all the custom components registered by user;
• an import module is configured for importing the file in a second data processing environment, wherein exporting or importing of the pipelines is done amongst different data processing environment;
• verifying compatibility of the file in the second data processing environment, wherein the compatibility is verified by ensuring the predefined file format is conflict free for the second data processing environment;
• updating the file as per the second data processing environment when the file is in conflict with the second data processing environment;
• and
• a populating module is configured for populating a version of the distributed computing pipeline over the GUI of the second data processing environment, thereby facilitating the second user of the second data processing environment to reuse the distributed computing pipeline.

A non-transitory computer readable medium embodying a program executable in a computing device for facilitating reusability of distributed computing pipelines, the program comprising a program code:

• a program code for capturing a set of versions pertaining to a distributed computing pipeline designed by a first user, over a Graphical User Interface (GUI), of a first data processing environment associated with a stream analytics platform, wherein each version indicates same or distinct business logic, and wherein the distributed computing pipeline comprises:
• a subset of components, selected by the first user of the data processing environment from a universal set of components of the stream analytics platform, and
• a set of links corresponding to the subset of components;
• a program code for storing the distributed computing pipeline with the set of versions in a repository, wherein the distributed computing pipeline with the set of versions are stored in a file with a predefined file format pertaining to the stream analytics platform, wherein each version of pipeline is stored along with metadata associated with each version of the pipeline wherein the file is configured to maintain components and configurations of the distributed computing pipeline comprising a name, a structure, messages, message groups, alerts, agent configurations, transformation variables, scope variables, wherein user defined functions and registered components enables the user for designing a new pipeline or modifying an existing pipeline, wherein the registered components have list of all the custom components registered by user;
• a program code for importing the file in a second data processing environment, wherein exporting or importing of the pipelines is done amongst different data processing environment;
• a program code for verifying compatibility of the file in the second data processing environment, wherein the compatibility is verified by ensuring the predefined file format is conflict free for the second data processing environment;
• a program code for updating the file as per the second data processing environment when the file is in conflict with the second data processing environment;
• and
• a program code for populating a version of the distributed computing pipeline over the GUI of the second data processing environment, thereby facilitating the second user of the second data processing environment to reuse the distributed computing pipeline.