Systems and methods for predicting correct or missing data and data anomalies
AssigneeCollibra Belgium BV
InventorsKirk J. Haslbeck, Brian N. Mearns
Life of this patent
Estimating the term…
Loading patent…
AssigneeCollibra Belgium BV
InventorsKirk J. Haslbeck, Brian N. Mearns
Estimating the term…
The present disclosure is directed to systems and methods for predicting and correcting data anomalies. In one example aspect, data is received by the system. The system may analyze the data by profiling the data for certain profiling statistics (e.g., min, max, mean, cardinality, etc.). At least one machine-learning algorithm (e.g., a Random-Forest algorithm) may be applied to the profiled data to identify potential relationships among certain data columns in the data. Once certain relationships are identified, the data that is related may be extracted to form an itemset. A second machine-learning algorithm (e.g., Frequent Pattern Growth algorithm) may be applied to the itemset to identify certain frequencies of related values in the itemset. Low frequency values may indicate anomalies in the dataset. If an anomaly is detected, the system may be configured to provide an intelligent remedial action, such as substituting certain values and/or filling in a missing value.
A method for predicting data quality in a dataset, comprising:
A system for correcting data anomalies in a dataset, comprising:
A computer-readable media storing non-transitory computer executable instructions that when executed cause a computing system to perform a method for predicting and correcting data anomalies comprising:
Dependencies are inferred from the claim text.