Transparent data transformation and access for workloads in cloud environments

A computing device, comprising:

• a processor;
• a storage device coupled to the processor;
• and
• an engine stored in the storage device, wherein an execution of the engine by the processor configures the computing device to:
• install, prior to processing a computational workload of an end-user on a dataset, data transformation plugins comprising data-caching, data anonymization, and node selection, in the dataset made accessible for processing the computational workload;
• ingest a dataset-specific policy for the accessible dataset and a data governance policy for the accessible dataset, by a policy ingestion component, wherein the data governance policy defines node selection rules for the accessible dataset;
• apply the data transformation plugins to the accessible dataset based on the dataset-specific policy to generate a transformed data source that is anonymized and stored in a local cache of the storage device, for deployment and processing, by a dataset mutator;
• apply, to the dataset, policies related to the data governance policy and a location of the end-user, by an orchestrator;
• determine, based on the data governance policy, one or more authorized computational nodes permitted to process the transformed data source, by the orchestrator;
• update user-defined computational workload definitions transparently for use with the transformed data source;
• and
• deploy the computational workload with access to the transformed data source for processing to the determined one or more authorized computational nodes, by a computational workload mutator.

A computing device providing data transformation, the computing device comprising:

• a processor;
• and
• a memory coupled to the processor, the memory storing instructions to cause the processor to perform operations comprising:
• installing, prior to processing a computational workload of an end-user on a dataset, data transformation plugins comprising data-caching, data anonymization, and node selection, in the dataset made accessible for processing the computational workload;
• ingesting a dataset-specific policy for the accessible dataset and a data governance policy for the accessible dataset, wherein the data governance policy defines node selection rules for the accessible dataset;
• executing the data transformation of the accessible dataset by invoking the data transformation plugins to the accessible dataset based on the dataset-specific policy to generate a transformed dataset using the data transformation plugins, wherein the transformed dataset is anonymized and stored in a local cache of the computing device, for deployment and processing;
• determining, based on the data governance policy, one or more authorized computational nodes permitted for deployment of the computational workload;
• updating user-defined computational workload definitions transparently for use with the transformed dataset;
• and
• deploying the computational workload to the determined one or more authorized computational nodes to provide data access for processing with the transformed dataset.

A non-transitory computer-readable storage medium tangibly embodying a computer-readable program code having computer-readable instructions that, when executed, causes a computer device to perform operations of providing data transformation, the operations comprising:

• installing, prior to processing a computational workload of an end-user on a dataset, data transformation plugins comprising data-caching, data anonymization, and node selection, in the dataset made accessible for processing the computational workload;
• ingesting a dataset-specific policy for the accessible dataset and a data governance policy for the accessible dataset, wherein the data governance policy defines node selection rules for the accessible dataset;
• executing the data transformation of the accessible dataset by invoking the data transformation plugins to the accessible dataset based on the dataset-specific policy to generate a transformed dataset using the data transformation plugins, wherein the transformed dataset is anonymized and stored in a local cache of a computing device, for deployment and processing;
• determining, based on the data governance policy, one or more authorized computational nodes permitted for deployment of the computational workload;
• and
• deploying the computational workload to the determined one or more authorized computational nodes to provide data access for processing with the transformed dataset.

A computer-implemented method for performing data transformation in a Kubernetes framework for a cloud-based application, the computer-implemented method comprising:

• installing, by a computing device, prior to processing a computational workload on a dataset, data transformation plugins comprising data-caching, data anonymization, and node selection, in the dataset made accessible for processing the computational workload;
• receiving, by the computing device, the accessible dataset including a masked ID field and a restriction to one or more authorized computational nodes for processing;
• ingesting, by the computing device, a dataset-specific policy for the accessible dataset and a data governance policy for the accessible dataset, wherein the data governance policy defines node selection rules for the accessible dataset;
• matching, by the computing device, the ingested dataset-specific policy and the data governance policy with available data transformations for the dataset;
• executing, by the computing device, the data transformation of the accessible dataset by invoking the data transformation plugins to the accessible dataset based on the dataset-specific policy to generate a transformed dataset that is anonymized and stored in a local cache of the computing device, for deployment and processing, wherein the invoked data transformation plugins correspond to the available data transformations;
• determining, by the computing device, based on the data governance policy, the one or more authorized computational nodes permitted for deployment of the computational workload;
• and
• deploying, by the computing device, the computational workload to the determined one or more authorized computational nodes to provide data access for processing with the transformed dataset.