System and method for offloading preprocessing of machine learning data to remote storage

A non-transitory computer readable storage medium comprising instructions stored thereon that, when executed by a processor, cause the processor to:

• assign a first compute resource to a storage node of an object storage platform on a first cloud, wherein unstructured data is stored in the storage node, wherein the first compute resource of the storage node preprocesses the unstructured data to generate preprocessed data;
• transfer, via a public network, the preprocessed data to a compute node on a second cloud;
• and
• assign a second compute resource to the compute node of the second cloud, wherein the second compute resource trains a machine learning (ML) model using the preprocessed data.

A computer-implemented method, comprising:

• assigning, by a processor, a first compute resource to a storage node of an object store on a first cloud, wherein unstructured data is stored in the storage node, wherein the first compute resource of the storage node preprocesses the unstructured data stored in the storage node to generate preprocessed data;
• transferring, via a public network, the preprocessed data to a compute node on a second cloud;
• and
• assigning, by the processor, a second compute resource to the compute node of the second cloud, wherein the second compute resource trains a machine learning (ML) model using the preprocessed data.