Computing data lineage across a network of heterogeneous systems

A computer system to provide lineage information in a heterogeneous network, the system comprising:

• a processor;
• and
• a memory in association with the processor storing instructions related to:
• generating a dataset by applying one or more transformation operations to the dataset of a plurality of datasets stored at a data source system (DSS);
• generating a plurality of lineage graphs corresponding to a plurality of data objects, wherein data at a data object of the plurality of data objects is included in a source dataset table of a plurality of source dataset tables stored at a data lineage server (DLS), and wherein the data object represents the dataset of the plurality of datasets;
• determining, from the plurality of lineage graphs, a lineage graph corresponding to the dataset;
• and
• based on the lineage graph, generating one or more data lineage structures that define relationships between the data object and one or more data objects corresponding to one or more parent and child datasets of the dataset, wherein the one or more data lineage structures comprise data from the dataset and from the one or more parent and child datasets, wherein metadata defines how the dataset is computed from the parent dataset and how the child dataset is computed from the dataset.

A non-transitory computer readable medium storing instructions which when executed by at least processor cause a computer system to perform operations comprising:

• generate a dataset by applying one or more transformation operations to the dataset of a plurality of datasets stored at a data source system (DSS);
• generate a plurality of lineage graphs corresponding to a plurality of data objects, wherein data at a data object of the plurality of data objects is included in a source dataset table of a plurality of source dataset tables stored at a data lineage server (DLS), and wherein the data object represents the dataset of the plurality of datasets;
• determine, from the plurality of lineage graphs, a lineage graph corresponding to the dataset;
• and
• based on the lineage graph, generate one or more data lineage structures that define relationships between the data object and one or more data objects corresponding to one or more parent and child datasets of the dataset, wherein the one or more data lineage structures comprise data from the dataset and from the one or more parent and child datasets, wherein metadata defines how the dataset is computed from the parent dataset and how the child dataset is computed from the dataset.