Graphical management of big data pipelines

A non-transitory computer-readable storage medium tangibly encoded with computer-executable instructions, that when executed by a processor of computing device, performs a method, the method comprising:

• generating, in a database, a first configurable namespace to use to group together a first plurality of data processing tasks of a big data processing;
• generating, in the database, a second configurable namespace to use to group together a second plurality of data processing tasks of the big data processing, the second configurable namespace being generated as a child namespace of the first configurable namespace such that the first configurable namespace is a parent namespace of the second configurable namespace;
• generating, in the database, a third configurable namespace to use to group together a third plurality of data processing tasks of the big data processing, the third configurable namespace being generated as a child namespace of the first configurable namespace such that the first configurable namespace is a parent namespace of the third configurable namespace and the second configurable namespace is a sibling namespace of the third configurable namespace;
• configuring a display scheme for displaying error handling and root cause analysis of tasks of the big data processing, wherein the configuring of the display scheme comprises configuring a color scheme for displaying error handling and root cause analysis of tasks;
• generating, using stored information from the database, a graphical user interface (GUI) comprising a navigable hierarchal view displaying the first configurable namespace as a parent namespace of the second and third configurable namespaces, the generation of the GUI based partially on the display scheme, the GUI comprising a plurality of components for graphically monitoring and managing execution of the big data processing tasks at various hierarchical levels;
• displaying, with one of the configurable namespaces displayed in the navigable hierarchal view, error handling and root cause analysis of a task linked to the one of the configurable namespaces, when the task fails to be completed;
• responsive to a change in execution state of big-data processing of at least one task of the big data processing, updating the GUI to indicate the change in execution state;
• displaying a task linked to one of the configurable namespaces with a background of a first selected color and with error handling and root cause analysis of the task, when the task fails to be completed;
• and
• displaying the task with a background of a second selected color and without error handling and root cause analysis, when the task is completed.

A system, comprising:

• a computing device, comprising a processor and a non-transitory computer-readable storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising:
• executable logic for generating, in a database, a first configurable namespace to use to group together a first plurality of data processing tasks of a big data processing;
• executable logic for generating, in the database, a second configurable namespace to use to group together a second plurality of data processing tasks of the big data processing, the second configurable namespace being generated as a child namespace of the first configurable namespace such that the first configurable namespace is a parent namespace of the second configurable namespace;
• executable logic for generating, in the database, a third configurable namespace to use to group together a third plurality of data processing tasks of the big data processing, the third configurable namespace being generated as a child namespace of the first configurable namespace such that the first configurable namespace is a parent namespace of the third configurable namespace and the second configurable namespace is a sibling namespace of the third configurable namespace;
• executable logic for configuring a display scheme for displaying error handling and root cause analysis of tasks of the big data processing, wherein the executable logic for configuring of the display scheme comprises executable logic for configuring a color scheme for displaying error handling and root cause analysis of tasks;
• executable logic for generating, by the application and using stored information from the database, a graphical user interface (GUI) comprising a navigable hierarchal view displaying the first configurable namespace as a parent namespace of the second and third configurable namespaces, the generation of the GUI based partially on the display scheme, the GUI comprising a plurality of components for graphically monitoring and managing execution of the big data processing tasks at various hierarchical levels;
• responsive to a change in execution state of big-data processing of at least one task of the big data processing, executable logic for updating the GUI to indicate the change in execution states
• executable logic for displaying a task linked to one of the configurable namespaces with a background of a first selected color and with error handling and root cause analysis of the task, when the task fails to be completed;
• and
• executable logic for displaying the task with a background of a second selected color and without error handling and root cause analysis, when the task is completed.