# US 2020/0004858 A1 · Distributed data processing in multi-tenant environments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0004858 A1
- Document ID: US20200004858A1
- Status: Published application
- Kind: A1
- Application number: 16/024,264
- Filed: 2018-06-29
- Published: 2020-01-02
- Earliest claimed: 2018-06-29
- Assignees: salesforce.com, inc.
- Applicants: salesforce.com, inc.
- Inventors: Alex Gitelman; Stephen Petschulat; Alex Field; Torrey Teats
- Web page: https://patentgrep.com/patent/US20200004858A1

## CPC

- G06F 16/2448: {for particular applications; for extensibility, e.g. user defined types}
- G06F 16/27: Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F 16/24534: {Query rewriting; Transformation}
- G06F 16/2455: Query execution
- G06F 16/2456: {Join operations}
- G06F 16/2471: {Distributed queries}
- G06F 16/252: {between a Database Management System and a front-end application}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods, systems, and devices for data processing within a distributed data system are described. In a multi-tenant distributed data system, a provider may supply executable code for processing data using declarative processing instructions received from a tenant. For example, a tenant may provide tenant-specific processing instructions for a requested set of data. The processing instructions may indicate input information (e.g., a data structure, tenant-specific fields, etc.), transformation information (e.g., from a set of pre-defined transformations), and output information. The provider-supplied code may use the tenant-specific processing instructions to process and generate the requested set of data, where the code may be executed by multiple nodes within the system. As such, the code executed by multiple nodes may utilize the input information, transformation information, and output information from the tenant-specific processing instructions to generate the requested data and provide the data to the tenant.

## Claims

### Claim 1

A method for data processing within a multi-tenant distributed data system, comprising:
receiving, from a tenant user device, tenant-specific processing instructions for a requested set of data, the tenant-specific processing instructions comprising input information, transformation information, and output information, wherein the input information comprises one or more custom fields specific to the tenant user device and a data structure for the requested set of data, and wherein the transformation information is from a pre-defined set of possible transformations;
identifying, from the multi-tenant distributed data system, data that the tenant has access to based at least in part on a tenant identity (ID) associated with the tenant user device, wherein the data that the tenant has access to is used to generate the requested set of data;
receiving, from a provider user device, code that is executable to process the requested set of data using the tenant-specific processing instructions;
transmitting, for execution by a plurality of worker nodes on the data that the tenant has access to within the multi-tenant distributed data system, the tenant-specific processing instructions and the code received from the provider user device to generate the requested set of data; and
transmitting, to the tenant user device, the generated requested set of data.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
generating, in accordance with the tenant-specific processing instructions and the code received from the provider user device, the requested set of data by aggregating two or more datasets from the data that the tenant has access to, wherein the generated requested set of data comprises fields from the aggregate two or more datasets and the one or more custom fields specific to the tenant user device.

### Claim 3 (depends on 2)

The method of claim 2, wherein the two or more data sets are from respective data stores within the multi-tenant distributed data system.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
transforming two or more datasets from the data that the tenant has access to using a set of transformations from the pre-defined set of possible transformations in accordance with the transformation information, wherein the generated requested set of data comprises the transformed two or more datasets.

### Claim 5 (depends on 1)

The method of claim 1, wherein identifying data from the multi-tenant distributed data system that the tenant has access to comprises:
pre-filtering data that the tenant does not have access to based at least in part on the tenant ID.

### Claim 6 (depends on 1)

The method of claim 1, wherein identifying data from the multi-tenant distributed data system that the tenant has access to comprises:
identifying datasets within the data that the tenant has access to based at least in part on the data structure, wherein the data structure comprises a format of the datasets, or a size of the datasets, or a combination thereof.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
monitoring execution of the tenant-specific processing instructions and the code received from the provider user device execution by the plurality of worker nodes.

### Claim 8 (depends on 1)

The method of claim 1, wherein the input information describes one or more input data tables and the output information describes one or more results data tables.

### Claim 9 (depends on 1)

The method of claim 1, wherein the tenant-specific processing instructions comprise a declarative object formatted in accordance with a programming language.

### Claim 10 (depends on 1)

The method of claim 1, wherein the code received from the provider user device comprises executable code written to perform data processing and using a programming language.

### Claim 11

An apparatus for data processing within a multi-tenant distributed data system, comprising:
a processor,
memory in electronic communication with the processor; and
instructions stored in the memory and executable by the processor to cause the apparatus to:
receive, from a tenant user device, tenant-specific processing instructions for a requested set of data, the tenant-specific processing instructions comprising input information, transformation information, and output information, wherein the input information comprises one or more custom fields specific to the tenant user device and a data structure for the requested set of data, and wherein the transformation information is from a pre-defined set of possible transformations;
identify, from the multi-tenant distributed data system, data that the tenant has access to based at least in part on a tenant identity (ID) associated with the tenant user device, wherein the data that the tenant has access to is used to generate the requested set of data;
receive, from a provider user device, code that is executable to process the requested set of data using the tenant-specific processing instructions;
transmit, for execution by a plurality of worker nodes on the data that the tenant has access to within the multi-tenant distributed data system, the tenant-specific processing instructions and the code received from the provider user device to generate the requested set of data; and
transmit, to the tenant user device, the generated requested set of data.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the instructions are further executable by the processor to cause the apparatus to:
generate, in accordance with the tenant-specific processing instructions and the code received from the provider user device, the requested set of data by aggregating two or more datasets from the data that the tenant has access to, wherein the generated requested set of data comprises fields from the aggregate two or more datasets and the one or more custom fields specific to the tenant user device.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the two or more data sets are from respective data stores within the multi-tenant distributed data system.

### Claim 14 (depends on 11)

The apparatus of claim 11, wherein the instructions are further executable by the processor to cause the apparatus to:
transform two or more datasets from the data that the tenant has access to using a set of transformations from the pre-defined set of possible transformations in accordance with the transformation information, wherein the generated requested set of data comprises the transformed two or more datasets.

### Claim 15 (depends on 11)

The apparatus of claim 11, wherein the instructions to identify data from the multi-tenant distributed data system that the tenant has access to are executable by the processor to cause the apparatus to:
pre-filter data that the tenant does not have access to based at least in part on the tenant ID.

### Claim 16 (depends on 11)

The apparatus of claim 11, wherein the instructions to identify data from the multi-tenant distributed data system that the tenant has access to are executable by the processor to cause the apparatus to:
identify datasets within the data that the tenant has access to based at least in part on the data structure, wherein the data structure comprises a format of the datasets, or a size of the datasets, or a combination thereof.

### Claim 17 (depends on 11)

The apparatus of claim 11, wherein the instructions are further executable by the processor to cause the apparatus to:
monitor execution of the tenant-specific processing instructions and the code received from the provider user device execution by the plurality of worker nodes.

### Claim 18 (depends on 11)

The apparatus of claim 11, wherein the input information describes one or more input data tables and the output information describes one or more results data tables.

### Claim 19 (depends on 11)

The apparatus of claim 11, wherein the tenant-specific processing instructions comprise a declarative object formatted in accordance with a programming language.

### Claim 20

A non-transitory computer-readable medium storing code for data processing within a multi-tenant distributed data system, the code comprising instructions executable by a processor to:
receive, from a tenant user device, tenant-specific processing instructions for a requested set of data, the tenant-specific processing instructions comprising input information, transformation information, and output information, wherein the input information comprises one or more custom fields specific to the tenant user device and a data structure for the requested set of data, and wherein the transformation information is from a pre-defined set of possible transformations;
identify, from the multi-tenant distributed data system, data that the tenant has access to based at least in part on a tenant identity (ID) associated with the tenant user device, wherein the data that the tenant has access to is used to generate the requested set of data;
receive, from a provider user device, code that is executable to process the requested set of data using the tenant-specific processing instructions;
transmit, for execution by a plurality of worker nodes on the data that the tenant has access to within the multi-tenant distributed data system, the tenant-specific processing instructions and the code received from the provider user device to generate the requested set of data; and
transmit, to the tenant user device, the generated requested set of data.
