Optimizing transformation of data

A computer system to generate an execution schedule to optimize transformation of business data, comprising:

• a memory storing computer instructions;
• and
• a processor communicatively coupled with the memory to execute the instructions to perform operations comprising:
• from a plurality of tables residing in a plurality of databases and storing business data associated with a plurality of business management systems, determining one or more dependencies between one or more tables from the plurality of tables based on attributes associated with the plurality of tables, wherein the transformation of the business data includes modification of the business data in order to unify the data between the plurality of business management systems;
• determining that a historical execution time exists, wherein the historical execution time is based on an executed test run that corresponds to simulated or actual operating conditions;
• based on determining that the historical execution time for the transformation of the business data does not exist, executing an estimation algorithm to generate an estimated execution time for the transformation of the business data in a test environment;
• based on execution times including the historical execution time or the estimated execution time for transforming the business data in the one or more tables, executing one of a decrease time algorithm or a critical path algorithm, to generate an execution schedule and calculate one or more processor idle times for the transformation of the business data in the one or more tables, wherein the decrease time algorithm sorts, in descending order, the execution times and upon sorting the execution times, the execution schedule is generated that preserves the determined dependencies between the tables;
• based on the calculated one or more processor idle times:
• determining whether or not to execute a local optimization algorithm;
• and
• based on the determining whether or not to execute the local optimization algorithm, modifying the generated execution schedule for the transformation of the business data;
• and
• executing the transformation of the business data based on the generated execution schedule that optimizes a time consumed for the transformation of the business data in the one or more tables.

A non-transitory computer readable storage medium tangibly storing instructions, which when executed by a computer, cause the computer to execute operations comprising:

• from a plurality of tables residing in a plurality of databases and storing business data associated with a plurality of business management systems, determine dependencies between one or more tables from the plurality of tables based on attributes associated with the plurality of tables, wherein the transformation of the business data includes modification of the business data in order to unify the data between the plurality of business management systems;
• determining that a historical execution time exists, wherein the historical execution time is based on an executed test run that corresponds to simulated or actual operating conditions;
• based on determining that the historical execution time for the transformation of the business data does not exist, executing an estimation algorithm to generate an estimated execution time for the transformation of the business data in a test environment;
• based on execution times including the historical execution time or the estimated execution time for transforming the business data in the one or more tables, execute one of a decrease time algorithm or a critical path algorithm to generate an execution schedule and calculate one or more processor idle times for the transformation of the business data in the one or more tables, wherein the decrease time algorithm sorts, in descending order, the execution times and upon sorting the execution times, the execution schedule is generated that preserves the determined dependencies between the tables;
• based on the calculated one or more processor idle times:
• determining whether or not to execute a local optimization algorithm;
• and
• based on the determining whether or not to execute the local optimization algorithm, modifying the generated execution schedule for the transformation of the business data;
• and
• execute the transformation of the business data based on the generated execution schedule that optimizes a time consumed for the transformation of the business data in the one or more tables.