Resource efficient full bootstrap

A computing system for bootstrapping a destination database, the system comprising:

• one or more processors;
• and
• a memory storing instructions that, when executed by the one or more processors, causes the system to perform operations comprising:
• receiving an initial data collection task of a software platform to retrieve data from one or more source databases in which the data is arranged in an original order, wherein the initial data collection task includes a plurality of identifiers to identify the data to be collected from the one or more source databases;
• dividing the initial data collection task into a plurality of intermediate data collection tasks, including dividing the data into a plurality of subsets of data based on the plurality of identifiers, wherein each intermediate data collection task instructs pulling a subset of the plurality of subsets of data from the one or more source databases;
• executing each intermediate data collection task from the plurality of intermediate data collection tasks, wherein the execution of each respective intermediate data collection task includes:
• pulling the subset of data associated with the respective intermediate data collection task from the one or more source databases;
• writing the subset of data to an intermediate data file associated with the respective intermediate data collection task;
• and
• generating an indication that pulling is complete for the respective intermediate data collection task after writing the subset of data to the intermediate data file;
• and
• after writing all of the data to the plurality of intermediate data files for the plurality of intermediate data collection tasks, writing the data from the plurality of intermediate data files to a destination database, wherein the original order of the data is preserved in the destination database.