Editor for generating computational graphs

A system for transforming a first dataflow graph into a second dataflow graph, wherein the first dataflow graph includes a plurality of first nodes representing a plurality of first computer operations, wherein the second dataflow graph includes a plurality of second nodes representing a plurality of second computer operations, and wherein at least some of the second computer operations are unrepresented by the first nodes in the first dataflow graph, including:

• one or more processors and one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the one or more processors to perform operations comprising:
• generating the first dataflow graph with the plurality of first nodes representing first computer operations in processing data, with at least one of the first computer operations being a declarative operation that specifies one or more characteristics of one or more results of processing of data;
• transforming the first dataflow graph into the second dataflow graph for processing data in accordance with the first computer operations, the second dataflow graph including the plurality of second nodes representing second computer operations, with at least one of the second nodes representing one or more imperative operations that implement the logic specified by the declarative operation, wherein the one or more imperative operations are unrepresented by the first nodes in the first dataflow graph;
• and
• storing, in a data store, the second dataflow graph.

A non-transitory computer readable medium storing instructions for causing a computing system to:

• generate a first dataflow graph with a plurality of first nodes representing first computer operations in processing data, with at least one of the first computer operations being a declarative operation that specifies one or more characteristics of one or more results of processing of data;
• transform the first dataflow graph into a second dataflow graph for processing data in accordance with the first computer operations, the second dataflow graph including a plurality of second nodes representing second computer operations, with at least one of the second nodes representing one or more imperative operations that implement the logic specified by the declarative operation, wherein the one or more imperative operations are unrepresented by the first nodes in the first dataflow graph;
• and
• store, in a data store, the second dataflow graph.

A computer-implemented method for transforming a first dataflow graph into a second dataflow graph, wherein the first dataflow graph includes a plurality of first nodes representing a plurality of first computer operations, wherein the second dataflow graph includes a plurality of second nodes representing a plurality of second computer operations, and wherein at least some of the second computer operations are unrepresented by the first nodes in the first dataflow graph, including:

• generating the first dataflow graph with the plurality of first nodes representing the first computer operations in processing data;
• transforming the first dataflow graph into the second dataflow graph for processing data in accordance with the first computer operations, the second dataflow graph including the plurality of second nodes representing the second computer operations, with at least a given one of the second computer operations being selected from the group consisting of a sort operation, a data type operation, a join operation with a specified key and a partition operation, and with the at least given one of the second computer operations being unrepresented by the first nodes in the first dataflow graph;
• and
• storing, in a data store, the second dataflow graph.

A system for transforming a first dataflow graph into a second dataflow graph, wherein the first dataflow graph includes a plurality of first nodes representing a plurality of first computer operations, wherein the second dataflow graph includes a plurality of second nodes representing a plurality of second computer operations, and wherein at least some of the second computer operations are unrepresented by the first nodes in the first dataflow graph, including:

• one or more processors and one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the one or more processors to perform operations comprising:
• generating the first dataflow graph with the plurality of first nodes representing the first computer operations in processing data;
• transforming the first dataflow graph into the second dataflow graph for processing data in accordance with the first computer operations, the second dataflow graph including the plurality of second nodes representing the second computer operations, with at least a given one of the second computer operations being selected from the group consisting of a sort operation, a data type operation, a join operation with a specified key and a partition operation, and with the at least given one of the second computer operations being unrepresented by the first nodes in the first dataflow graph;
• and
• storing, in a data store, the second dataflow graph.

A non-transitory computer readable medium storing instructions for causing a computing system to:

• generate a first dataflow graph with a plurality of first nodes representing the first computer operations in processing data;
• transform the first dataflow graph into a second dataflow graph for processing data in accordance with the first computer operations, the second dataflow graph including a plurality of second nodes representing the second computer operations, with at least a given one of the second computer operations being selected from the group consisting of a sort operation, a data type operation, a join operation with a specified key and a partition operation, and with the at least given one of the second computer operations being unrepresented by the first nodes in the first dataflow graph;
• and
• store, in a data store, the second dataflow graph.