Automated data analysis and transformation

A data hub comprising a computer processor coupled to a computer-readable memory unit, said memory unit comprising instructions that when executed by the computer processor implements a method comprising:

• generating, by said computer processor, a data hub application configured to embed extract, transform, and load (ETL) processes;
• linking, by said computer processor, source tables and target tables to said data hub application;
• associating, by said computer processor, said source tables and said target tables to a local sensitive hashing (LSH) program comprising target flags;
• transferring, by said computer processor, metadata associated with said source tables and said target tables from virtual views of said data hub application to an ETL work area of said ETL processes, wherein said metadata comprises table definition metadata published to a DS tool comprising said source tables and said target tables;
• generating, by said computer processor, an ETL job;
• linking, by said computer processor, said ETL job to said data hub application;
• executing, by said computer processor executing a data hub scheduler application, said ETL processes;
• determining, by said computer processor, results of said executing, wherein said results indicate that said executing was not successful;
• and
• detecting and syncing, by said computer processor, changes to said metadata associated with job failure sensing, wherein said detecting and syncing comprises:
• analyzing, by said computer processor, a log file pattern indicating a reason that said executing was not successful;
• decoding, by said computer processor, said log file pattern;
• generating, by said computer processor, a change script based on a category of said log file pattern, wherein said change script comprises an exception routine associated with non-classified categories;
• notifying, by said computer processor, users of said changes to said metadata and said change script;
• and
• triggering, by said computer processor executing said change script, enabling updated changes to said metadata.

A computer program product, comprising a computer readable hardware storage device storing a computer readable program code, said computer readable program code comprising an algorithm that when executed by a computer processor of a data hub implements a method, said method comprising:

• generating, by said computer processor, a data hub application configured to embed extract, transform, and load (ETL) processes;
• linking, by said computer processor, source tables and target tables to said data hub application;
• associating, by said computer processor, said source tables and said target tables to a local sensitive hashing (LSH) program comprising target flags;
• transferring, by said computer processor, metadata associated with said source tables and said target tables from virtual views of said data hub application to an ETL work area of said ETL processes, wherein said metadata comprises table definition metadata published to a DS tool comprising said source tables and said target tables;
• generating, by said computer processor, an ETL job;
• linking, by said computer processor, said ETL job to said data hub application;
• executing, by said computer processor executing a data hub scheduler application, said ETL processes;
• determining, by said computer processor, results of said executing, wherein said results indicate that said executing was not successful;
• and
• detecting and syncing, by said computer processor, changes to said metadata associated with job failure sensing, wherein said detecting and syncing comprises:
• analyzing, by said computer processor, a log file pattern indicating a reason that said executing was not successful;
• decoding, by said computer processor, said log file pattern;
• generating, by said computer processor, a change script based on a category of said log file pattern, wherein said change script comprises an exception routine associated with non-classified categories;
• notifying, by said computer processor, users of said changes to said metadata and said change script;
• and
• triggering, by said computer processor executing said change script, enabling updated changes to said metadata.