Machine learning apparatus for data lineage transformation

An article of manufacture comprising a non-transitory computer usable medium having computer readable program code embodied therein, the code when executed by a processor leveraging machine learning (“ML”) causes a computer to perform data lineage analysis within a self-service search portal, the computer readable program code in said article of manufacture comprising:

• computer readable program code for causing the computer to store a plurality of technical data element identifiers (“TDEIs”);
• computer readable program code for causing the computer to receive a query for data lineage information corresponding to a first TDEI associated with a first data lineage source;
• computer readable program code for causing the computer to leverage ML to identify a level of commonality between the first TDEI and a second TDEI, wherein the level of commonality is greater than both a threshold length percentage and a threshold alpha-numerical matching percentage;
• computer readable program code for causing the computer to identify data lineage information for the second TDEI corresponding to a second data lineage source;
• computer readable program code for causing the computer to determine whether the first TDEI and the second TDEI share a threshold level of commonality, wherein the threshold level of commonality is greater than a threshold number of alpha-numerical matches associated with both the first TDEI and the second TDEI;
• computer readable program code for causing the computer to, following a determination that the first TDEI and the second TDEI share a threshold level of commonality, identify any mismatches between the first TDEI and the second TDEI, a mismatch being a difference in an alpha-numerical symbol in both the first TDEI and the second TDEI, and determine whether a threshold number of mismatches exists between the first TDEI and the second TDEI;
• and
• computer readable program code for causing the computer to configure an electronic switch to:
• in response to a determination that a threshold number of mismatches does not exist between the first TDEI and the second TDEI, running a script to access a plurality of data files and to overwrite data lineage information in the data files, and generating a display on a graphical user interface (“GUI”) to prompt a user to overwrite the first TDEI with the second TDEI in a storage location containing the first TDEI, wherein the overwriting accelerates the running of the script and reduces a bandwidth of the computer;
• in response to a determination that a threshold number of mismatches exists between the first TDEI and the second TDEI, maintain the second TDEI in the storage location containing the first TDEI;
• and
• in response to a failure of the electronic switch to output a determination regarding a threshold number of mismatches existing between the first TDEI and the second TDEI, taking remedial action by generating a display on the GUI to prompt the user to input a new search query.