Efficient representation of data lineage information
AssigneeInternational Business Machines Corporation
InventorsMichael Fankhauser, Joanne Friedman, Benjamin Halberstadt, Roger Kenneth Hecker
Life of this patent
Estimating the term…
Abstract
Presenting data lineage information by assigning a score to a data asset along a path between a data source and a data destination, where a predefined scoring function is applied to a characteristic of the data asset, and presenting via a computer-controlled output medium a description of the data source, the data destination, and the path between the data source and the data destination, where the description includes the data asset if the score meets predefined inclusion criteria.
Claims18
A method for presenting data lineage information, the method comprising:
- assigning, using a processor of a computer, a score to each data asset in a set of data assets along a data lineage path in a data lineage graph between a data source and a data destination by applying a scoring function to one or more characteristics of the data asset;
- identifying a subset of the set of data assets whose score meets inclusion criteria, wherein each data asset whose score exceeds a first threshold is included in the subset and one or more additional data assets whose scores exceed a second threshold and are below the first threshold are included in the subset in response to determining that these one or more additional data assets are to be used to meet a certain depth for the data lineage path;
- and
- presenting via a computer-controlled output medium a description of the data source, the data destination, and the path between the data source and the data destination, wherein the path includes the subset of the data assets.
A method for presenting data lineage information, the method comprising:
- assigning, using a processor, a score to each data asset in a plurality of data assets included along a data lineage path in a data lineage graph between a data source and a data destination in data lineage analysis results by applying a scoring function to one or more characteristics of the data asset;
- evaluating each score using data lineage filtering criteria;
- based on the evaluating, identifying a subset of the plurality of data assets whose score meets the data lineage filtering criteria, wherein each data asset whose score exceeds a first threshold is included in the subset and one or more additional data assets whose scores exceed a second threshold and are below the first threshold are included in the subset in response to determining that these one or more additional data assets are to be used to meet a certain depth for the data lineage path;
- and
- presenting the data lineage analysis results via a computer-controlled output medium as a filtered data lineage graph with the subset of the plurality of data assets.
A system for presenting data lineage information, the system comprising:
- a processor;
- storage coupled to the processor;
- wherein the storage stores computer program instructions, and wherein the computer program instructions are executed by the processor to perform operations, and wherein the operations comprise:
- assigning, using a processor of a computer, a score to each data asset in a set of data assets along a data lineage path in a data lineage graph between a data source and a data destination by applying a scoring function to one or more characteristics of the data asset;
- identifying a subset of the set of data assets whose score meets inclusion criteria, wherein each data asset whose score exceeds a first threshold is included in the subset and one or more additional data assets whose scores exceed a second threshold and are below the first threshold are included in the subset in response to determining that these one or more additional data assets are to be used to meet a certain depth for the data lineage path;
- and
- presenting via a computer-controlled output medium a description of the data source, the data destination, and the path between the data source and the data destination, wherein the path includes the subset of the data assets.
A system for presenting data lineage information, the system comprising:
- a processor;
- storage coupled to the processor;
- wherein the storage stores computer program instructions, and wherein the computer program instructions are executed by the processor to perform operations, and wherein the operations comprise:
- assigning a score to each data asset in a plurality of data assets included along a data lineage path in a data lineage graph between a data source and a data destination in data lineage analysis results by applying a scoring function to one or more characteristics of the data asset;
- evaluating each score using data lineage filtering criteria;
- based on the evaluating, identifying a subset of the plurality of data assets whose score meets the data lineage filtering criteria, wherein each data asset whose score exceeds a first threshold is included in the subset and one or more additional data assets whose scores exceed a second threshold and are below the first threshold are included in the subset in response to determining that these one or more additional data assets are to be used to meet a certain depth for the data lineage path;
- and
- presenting the data lineage analysis results via a computer-controlled output medium as a filtered data lineage graph with the subset of the plurality of data assets.
A computer program product for presenting data lineage information, the computer program product comprising a computer-readable storage device with computer-readable program code embodied in the computer-readable storage device, wherein the computer-readable program code, when executed by a processor of a computer, is configured to:
- assign a score to each data asset in a set of data assets along a data lineage path in a data lineage graph between a data source and a data destination by applying a scoring function to one or more characteristics of the data asset;
- identify a subset of the set of data assets whose score meets inclusion criteria, wherein each data asset whose score exceeds a first threshold is included in the subset and one or more additional data assets whose scores exceed a second threshold and are below the first threshold are included in the subset in response to determining that these one or more additional data assets are to be used to meet a certain depth for the data lineage path;
- and
- present via a computer-controlled output medium a description of the data source, the data destination, and the path between the data source and the data destination, wherein the path includes the subset of the data assets.
A computer program product for presenting data lineage information, the computer program product comprising a computer-readable storage device with computer-readable program code embodied in the computer-readable storage device, wherein the computer-readable program code, when executed by a processor of a computer, is configured to:
- assign a score to each data asset in a plurality of data assets included in data lineage analysis results by applying a scoring function to one or more characteristics of the data asset;
- evaluate each score using data lineage filtering criteria;
- based on the evaluating, identifying a subset of the plurality of data assets whose score meets the data lineage filtering criteria, wherein each data asset whose score exceeds a first threshold is included in the subset and one or more additional data assets whose scores exceed a second threshold and are below the first threshold are included in the subset in response to determining that these one or more additional data assets are to be used to meet a certain depth for the data lineage path;
- and
- present the data lineage analysis results via a computer-controlled output medium as a filtered data lineage graph with the subset of the plurality of data assets.
Dependencies are inferred from the claim text.