Data classification workflows implemented with dynamically modifiable directed graphs

A computer readable data storage memory storing computer-executable instructions that, when executed by a computer system, cause the computer system to perform a computer-implemented method, the computer-executable instructions comprising:

• instructions for defining a classification experiment in a classification platform system by at least:
• defining an input data space by selecting at least one of data sources interfaced with the classification platform system;
• and
• defining, via a definition user interface, a directed graph (DG) connecting a plurality of transformation blocks to represent an experiment workflow, wherein the DG specifies how one or more outputs of each of the transformation blocks are fed into one or more other transformation blocks and wherein at least one of the plurality of transformation blocks in the DG includes logic to dynamically modify the DG during execution of the experiment workflow;
• instructions for scheduling a distributed computation platform to execute the classification experiment according to the input data space and the DG;
• and
• instructions for imperatively programming computing nodes of the distributed computation platform to execute the transformation blocks according to the logic that dynamically modifies the DG during the execution of the experiment workflow.

A classification platform system, comprising:

• a memory configured to store executable instructions;
• and
• a processor configured by the executable instructions to implement an experiment management engine and a workflow execution engine;
• wherein the experiment management engine is configured to defining a classification experiment by at least:
• defining an input data space by selecting at least one of data sources interfaced with the classification platform system;
• and
• defining, via a definition user interface, a directed graph (DG) connecting a plurality of transformation blocks to represent an experiment workflow, wherein the DG specifies how one or more outputs of each of the transformation blocks are fed into one or more other transformation blocks and wherein a transformation block in the DG includes logic to dynamically modify the DG during execution of the experiment workflow;
• and
• wherein the workflow execution engine is configured to schedule a distributed computation platform to execute the classification experiment according to the input data space and the DG and to imperatively program computing nodes of the distributed computation platform to execute the transformation blocks according to the logic that dynamically modifies the DG during the execution of the experiment workflow.