Consolidating Multiple Databases into a Single or a Smaller Number of Databases

A system comprising:

• a first source database comprising a first source table;
• a second source database comprising a second source table;
• a target database comprising a target table;
• and
• a server comprising one or more processors and memory, wherein the memory stores instructions that, when executed by the one or more processors, cause the server to:
• identifying a first set of relationships between a first source table of the first source database and the target table of the target database, wherein the first set of relationships include specific columns of the first source table and an identification of the table type of the first source table;
• storing the first set as first source table-specific relationships;
• identifying a second set of relationships between the second source table of the second source database and the table of the target database, wherein the second set of relationships include specific columns of the second source table and an identification of a table type of the second source table;
• storing the second set as second source table-specific relationships;
• assigning an order in the target table in which columns from the first table are to be added;
• arranging, in the assigned order, columns of the target table to be populated with content from the second table;
• generating, based on the assigned order and the first source table-specific relationships, a conversion configuration file;
• recursively generating, based on the assigned order and the second source table-specific relationships, additional conversion information for the conversion configuration file;
• grouping data from the first database into first batch;
• executing the conversion configuration file on the first batch;
• formatting cells in the first batch into a text format;
• formatting cells in a portion of data from the target database into the text format, wherein the portion of data from the target database corresponds to the first batch;
• comparing content of text-formatted cells from the first batch and content of text-formatted cells from the portion of data from the target database;
• modifying, based on an alert that the compared content does not match, the conversion configuration file;
• and
• executing the modified conversion configuration file, based on the batch from the first database, to populate the table of the target database.

One or more non-transitory media storing instructions that, when executed by one or more processors, cause the one or more processors to perform steps comprising:

• identifying a first set of relationships between a first source table of a first source database and a target table of a target database, wherein the first set of relationships include specific columns of the first source table and an identification of a table type of the first source table;
• storing the first set as first source table-specific relationships;
• identifying a second set of relationships between a second source table of a second source database and the table of the target database, wherein the second set of relationships include specific columns of the second source table and an identification of a table type of the second source table;
• storing the second set as second source table-specific relationships;
• assigning an order in the target table in which columns from the first table are to be added;
• arranging, in the assigned order, columns of the target table to be populated with content from the second table;
• generating, based on the assigned order and the first source table-specific relationships, a conversion configuration file;
• recursively generating, based on the assigned order and the second source table-specific relationships, additional conversion information for the conversion configuration file;
• grouping data from the first database into a first batch;
• grouping data from the second database into a second batch;
• executing the conversion configuration file on the first batch;
• formatting cells in the first batch into a text format;
• formatting cells in a portion of data from the target database into the text format, wherein the portion of data from the target database corresponds to the first batch;
• comparing content of text-formatted cells from the first batch of data and content of text-formatted cells from the portion of data from the target database;
• generating an alert, based on the comparison, that the content of at least one text-formatted cell from the first batch and the content of at least one text-formatted corresponding cell from the portion of data from the target database do not match;
• modifying, based on the alert, the conversion configuration file;
• and
• executing the modified conversion configuration file, based on the batches from the first database and the batches from the second database, to populate the table of the target database,
• wherein the alert includes an identification of a difference between the content of the non-matching cells from the first batch and the portion of data from the target database and an identification of a modification to conform the content of the cells to each other.