Techniques for accessing on-premise data sources from public cloud for designing data processing pipelines

A system, comprising:

• one or more processors;
• and
• a memory configured to store computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to:
• receive, from a remote client, sample statistics describing data, the data corresponding to an attribute of a database relation;
• generate, based at least in part on the received sample statistics, a simulated dataset corresponding to the attribute of the database relation;
• build a simulated database relation based at least in part on the simulated dataset;
• generate, based at least in part on the simulated dataset, pipeline instructions associated with a database pipeline;
• and
• deploy the generated pipeline instructions to the remote client.

A non-transitory computer-readable medium

• storing computer-executable instructions that, when executed by a processor, cause the processor to perform operations comprising:
• receiving, from a remote client, sample statistics describing data, the data corresponding to an attribute of a database relation;
• generating, based at least in part on the received sample statistics, a simulated dataset corresponding to the attribute of the database relation;
• building a simulated database relation based at least in part on the simulated dataset;
• generating, based at least in part on the simulated dataset, pipeline instructions associated with a database pipeline:
• and
• deploying the generated pipeline instructions to the remote client.