User-interface driven creation and distribution of computer applications

A computing apparatus, the computing apparatus comprising:

• one or more processors;
• and
• a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
• accessing, using one or more processors, a data processing pipeline;
• causing presentation of the data processing pipeline on a graphical user interface of a computing device;
• receiving a selection of a first user interface element within the graphical user interface;
• in response to receiving the selection, generating a datafile representing the data processing pipeline, the datafile comprising a series of data operations of the data processing pipeline;
• submitting the datafile and an application to a software framework using an application programming interface (API), the software framework configured to run the application using the datafile and generate datasets describing the series of data operations of the data processing pipeline;
• receiving, from the application via the API, the generated datasets;
• in response to receiving the generated dataset, applying the data operations described by the datasets to the data processing pipeline;
• collecting performance data metrics from the applying the data operations to the data processing pipeline;
• and
• dynamically updating the graphical user interface with the collected performance data metrics.

A machine storage medium storing instructions that when executed by one or more processors of a machine, cause the machine to perform operations comprising:

• accessing, using one or more processors, a data processing pipeline;
• causing presentation of the data processing pipeline on a graphical user interface of a computing device;
• receiving a selection of a first user interface element within the graphical user interface;
• in response to receiving the selection, generating a datafile representing the data processing pipeline, the datafile comprising a series of data operations of the data processing pipeline;
• submitting the datafile and an application to a software framework using an application programming interface (API), the software framework configured to run the application using the datafile and generate datasets describing the series of data operations of the data processing pipeline;
• receiving, from the application via the API, the generated datasets;
• in response to receiving the generated dataset, applying the data operations described by the datasets to the data processing pipeline;
• collecting performance data metrics from the applying the data operations to the data processing pipeline;
• and
• dynamically updating the graphical user interface with the collected performance data metrics.