Automated data flows using flow-based data processor blocks

A method comprising:

• receiving a selection of a plurality of data processor blocks and a configuration mapping, the configuration mapping corresponding to one or more inputs and outputs of each data processor block;
• initiating, at a first compute node associated with a selected data source, an automated data flow, the automated data flow generated from the configuration mapping and comprising a continuous sequence of the selected plurality of data processor blocks arranged in an order specified by the input and output relationships contained in the configuration mapping;
• detecting, using one or more of the selected plurality of data processor blocks, any changes in the data stored in the selected data source;
• ingesting, from the selected data source and into a first data processor block of the automated data flow, the detected changes in the data stored in the selected data source;
• transforming the ingested data with the continuous sequence of data processor blocks, such that:
• the first data processor block applies a first transformation operation to the ingested data, thereby generating and outputting a first transformed data;
• a second data processor block of the continuous sequence receives the first transformed data output by the first data processor block and applies a second transformation operation to the first transformed data, thereby generating and outputting a second transformed data, wherein:
• the second data processor block is coupled to the first data processor block according to the input and output relationships contained in the configuration mapping;
• the second transformation operation is different from the first transformation operation;
• and
• neither the first nor second transformation operation comprises data compression or acceleration;
• transmitting, from the automated data flow via a data accelerator and to a second compute node associated with a selected data destination, the transformed ingested data, wherein the second compute node thereby maintains a synchronized cloud copy of the data stored in the selected data source.