Efficient shared bulk loading into optimized storage

A system comprising:

• one or more computers;
• and
• a non-transitory computer-readable medium coupled to the one or more computers having instructions stored thereon which, when executed by the one or more computers, cause the one or more computers to perform operations comprising:
• identifying, in response to a load request, a data set on a client device to load to a server database of a server database system;
• identifying a set of load-processing steps to perform on the data set prior to the data set being loaded to the server database of the server database system;
• identifying, as a subset of the load-processing steps, at least two location-independent load processing steps to be performed on the data set that can be performed either on the client device or at the server database system;
• determining, at least one load processing location factor, wherein at least one load processing location factor is a dynamic load processing location factor that varies with each load request;
• identifying at least one load processing location rule that identifies a processing location to perform a given location-independent load processing step on the data set before the data set is loaded to the server database, wherein each load processing location rule is based on at least one load processing location factor;
• evaluating the at least one load processing location rule to determine (1) a client score associated with performing each location-independent load processing step at the client device and (2) a server score associated with performing each location-independent load processing step at the server database system;
• determining, based on the client score and server score, a processing location of either the client device or the server database system for performing the location-independent load processing step on the data set before the data set is loaded to the server database, wherein the determination includes dynamically determining a processing location of the client device for a first subset of the location-independent load processing steps and dynamically determining a processing location of the server for a second subset of the location-independent load processing steps;
• performing the first subset of the location-independent load processing steps that have a processing location of the client device, on the data set, on the client device;
• transferring the data set from the client device to the server database system over a network;
• and
• sending information to the database server system to instruct the database server system to perform the second subset of the location-independent load processing steps that have a processing location of the database server system, on the data set, at the database server system, before the data set is loaded to the server database.

A computer program product encoded on a non-transitory storage medium, the product comprising non-transitory, computer readable instructions for causing one or more processors to perform operations comprising:

• identifying, in response to a load request, a data set on a client device to load to a server database of a server database system;
• identifying a set of load-processing steps to perform on the data set prior to the data set being loaded to the server database of the server database system;
• identifying, as a subset of the load-processing steps, at least two location-independent load processing steps to be performed on the data set that can be performed either on the client device or at the server database system;
• determining, at least one load processing location factor, wherein at least one load processing location factor is a dynamic load processing location factor that varies with each load request;
• identifying at least one load processing location rule that identifies a processing location to perform a given location-independent load processing step on the data set before the data set is loaded to the server database, wherein each load processing location rule is based on at least one load processing location factor;
• evaluating the at least one load processing location rule to determine (1) a client score associated with performing each location-independent load processing step at the client device and (2) a server score associated with performing each location-independent load processing step at the server database system;
• determining, based on the client score and server score, a processing location of either the client device or the server database system for performing the location-independent load processing step on the data set before the data set is loaded to the server database, wherein the determination includes dynamically determining a processing location of the client device for a first subset of the location-independent load processing steps and dynamically determining a processing location of the server for a second subset of the location-independent load processing steps;
• performing the first subset of the location-independent load processing steps that have a processing location of the client device, on the data set, on the client device;
• transferring the data set from the client device to the server database system over a network;
• and
• sending information to the database server system to instruct the database server system to perform the second subset of the location-independent load processing steps that have a processing location of the database server system, on the data set, at the database server system, before the data set is loaded to the server database.