Distributed data processing in multi-tenant environments

An apparatus for data processing within a multi-tenant distributed data system, comprising:

• a processor,
• memory in electronic communication with the processor;
• and
• instructions stored in the memory and executable by the processor to cause the apparatus to:
• receive, from a tenant user device, tenant-specific processing instructions for a requested set of data, the tenant-specific processing instructions comprising input information, transformation information, and output information, wherein the input information comprises one or more custom fields specific to the tenant user device and a data structure for the requested set of data, and wherein the transformation information is from a pre-defined set of possible transformations;
• identify, from the multi-tenant distributed data system, data that the tenant has access to based at least in part on a tenant identity (ID) associated with the tenant user device, wherein the data that the tenant has access to is used to generate the requested set of data;
• receive, from a provider user device, code that is executable to process the requested set of data using the tenant-specific processing instructions;
• transmit, for execution by a plurality of worker nodes on the data that the tenant has access to within the multi-tenant distributed data system, the tenant-specific processing instructions and the code received from the provider user device to generate the requested set of data;
• and
• transmit, to the tenant user device, the generated requested set of data.

A non-transitory computer-readable medium storing code for data processing within a multi-tenant distributed data system, the code comprising instructions executable by a processor to:

• receive, from a tenant user device, tenant-specific processing instructions for a requested set of data, the tenant-specific processing instructions comprising input information, transformation information, and output information, wherein the input information comprises one or more custom fields specific to the tenant user device and a data structure for the requested set of data, and wherein the transformation information is from a pre-defined set of possible transformations;
• identify, from the multi-tenant distributed data system, data that the tenant has access to based at least in part on a tenant identity (ID) associated with the tenant user device, wherein the data that the tenant has access to is used to generate the requested set of data;
• receive, from a provider user device, code that is executable to process the requested set of data using the tenant-specific processing instructions;
• transmit, for execution by a plurality of worker nodes on the data that the tenant has access to within the multi-tenant distributed data system, the tenant-specific processing instructions and the code received from the provider user device to generate the requested set of data;
• and
• transmit, to the tenant user device, the generated requested set of data.