Systems and methods for generating dynamic pipeline visualizations

A method being implemented by a computing system including one or more physical processors and a storage media storing machine-readable instructions, the method comprising:

• obtaining a pipeline of operations associated with datasets, the pipeline of operations comprising nodes connected by edges, each of the nodes including one or more modification operations to be performed on the datasets and the edges indicating spatial distances between the nodes, the spatial distances indicating processing times of the one or more modification operations;
• obtaining pipeline schedules, each of the pipeline schedules indicating a time or frequency a respective pipeline associated with the pipeline schedules is to be executed;
• generating a first dynamic visualization of the pipeline of operations, wherein the generating of the first dynamic visualization comprises determining respective granularities of the nodes based on frequencies of access of datasets corresponding to the nodes;
• and populating the nodes at the determined granularities, wherein the determining of the respective granularities comprises determining that a first frequency of access of a first dataset is higher than a second frequency of access of a second dataset, and determining that the first dataset has a lower granularity compared to the second dataset;
• receiving an indication that an access privilege of an entity associated with the pipeline has changed, thereby changing the processing times or dependencies corresponding to the nodes;
• and
• in response to receiving the indication, modifying the first dynamic visualization of the pipeline by changing the spatial distances between the nodes or adjusting the connections between the nodes to signify the changes in the processing times or in the dependencies.

A method being implemented by a computing system including one or more physical processors and a storage media storing machine-readable instructions, the method comprising:

• obtaining a pipeline of operations associated with datasets, the pipeline of operations comprising nodes connected by edges, each of the nodes including one or more modification operations to be performed on the datasets and the edges indicating spatial distances between the nodes, the spatial distances indicating processing times of the one or more modification operations;
• obtaining pipeline schedules, each of the pipeline schedules indicating a time or frequency a respective pipeline associated with the pipeline schedules is to be executed;
• generating a first dynamic visualization of the pipeline of operations;
• receiving an indication that an access privilege of an entity associated with the pipeline has changed, wherein the change of the access privilege comprises an increase or a decrease in the access privilege, thereby changing the processing times or dependencies corresponding to the nodes;
• and
• in response to receiving the indication, modifying the first dynamic visualization of the pipeline by shortening the spatial distances between the nodes in response to the access privilege increasing, increasing the spatial distances between the nodes in response to the access privilege decreasing, or adjusting the connections between the nodes to signify the changes in the processing times, the increase or decrease in the access privilege, or in the dependencies.