Parallel transfers of electronic data

A system, comprising:

• an electronic database to store a target table;
• and
• a computation engine, including a plurality of processing nodes, to:
• receive an electronic data table and an identification of the target table in the electronic database;
• partition the received electronic data table into segments;
• generate a plurality of computation tasks to transfer the segments to the identified target table;
• cause the plurality of processing nodes of the computation engine to execute the computation tasks to transfer the segments to a staging table, wherein the staging table is a table where all of the segments are stored prior to being transferred together to the identified target table in the electronic database;
• upon completing one of the computation tasks to transfer one of the segments, cause a processing node of the processing nodes to check statuses in a task status table to determine whether all of the computation tasks of transferring the segments have completed;
• in response to determining that all of the computation tasks of transferring the segments have completed, update a last committer table with a task identifier associated with the computation task of transferring a last segment;
• in response to determining that the last committer table includes the task identifier associated with the computation task of transferring the last segment, determine whether a number of errors in the staging table is less than a threshold number of errors;
• and
• in response to determining that the number of errors in the staging table is less than the threshold number of errors, transfer the staging table to the identified target table.

A non-transitory machine-readable storage medium storing instructions that, when executed by a processor, cause the processor to:

• receive an electronic data table and an identification of a target table in a database;
• partition the received electronic data table into segments;
• generate, a plurality of computation tasks for transferring segments of the electronic data table to the target table;
• cause a plurality of processing nodes to execute the plurality of computation tasks to transfer the segments to a staging table, wherein the staging table is a table where all of the segments are stored prior to being transferred together to the target table in the database;
• upon completion of one of the computation tasks of transferring one of the segments to the staging table, cause a processing node of the processing nodes that completed the transfer of the segment to determine whether all of the computation tasks of transferring the segments have completed;
• in response to determining that all of the computation tasks of transferring the segments have completed, update a last committer table with a task identifier associated with the computation task of transferring a last segment;
• in response to determining that the last committer table includes the task identifier associated with the computation task of transferring the last segment, determine whether a number of errors in the staging table is less than a threshold number of errors;
• and
• in response to determining that the number of errors in the staging table is less than the threshold number of errors, transfer the staging table to the target table and update a final status table to reflect the transfer of the staging table to the target table is complete.