Built-in data quality monitoring
AssigneeSnowflake Inc.
InventorsHossein Ahmadi, Raja Suresh Krishna Balakrishnan, David Schultz, Jian Xu, Yunqiao Zhang
Life of this patent
Estimating the term…
Abstract
Described herein are techniques for data quality monitoring in a network-based data system. A data metric function used to evaluate data quality can be stored, where the data metric function is defined as schema level object. The data metric function can be attached to a table associated with an account and is evaluated on data associates with the table to generate evaluation results. The evaluation results can be stored in an account-specific central database, from which access is provided to the evaluation results to a user for the account.
Claims21
A method comprising:
- storing a data metric function to evaluate data quality in a network-based data system, the data metric function being defined as a schema level object;
- attaching the data metric function to a table associated with an account in the network-based data system;
- evaluating, by at least one hardware processor, the data metric function on data associated with the table to generate evaluation results;
- storing the evaluation results in an account-specific central database in the network-based data system;
- and
- providing access to the evaluation results in the account-specific central database to a user of the account.
A machine-storage medium embodying instructions that, when executed by a machine, cause the machine to perform operations comprising:
- storing a data metric function to evaluate data quality in a network-based data system, the data metric function being defined as a schema level object;
- attaching the data metric function to a table associated with an account in the network-based data system;
- evaluating, by at least one hardware processor, the data metric function on data associated with the table to generate evaluation results;
- storing the evaluation results in an account-specific central database in the network-based data system;
- and
- providing access to the evaluation results in the account-specific central database to a user of the account.
A system comprising:
- at least one hardware processor;
- and
- at least one memory storing instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform operations comprising:
- storing a data metric function to evaluate data quality in a network-based data system, the data metric function being defined as a schema level object;
- attaching the data metric function to a table associated with an account in the network-based data system;
- evaluating, by at least one hardware processor, the data metric function on data associated with the table to generate evaluation results;
- storing the evaluation results in an account-specific central database in the network-based data system;
- and
- providing access to the evaluation results in the account-specific central database to a user of the account.
Dependencies are inferred from the claim text.