System and method for integrating systems to implement data quality processing

A system, comprising:

• one or more processors;
• and
• a non-transitory computer-readable medium including instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, including:
• generating a business rule;
• generating a data quality specification for data to be tested, wherein the data quality specification is generated using the business rule and stored metadata, and wherein the data quality specification includes a test to perform on a set of specified reference data;
• generating a data quality rule corresponding to the data quality specification, wherein the data quality rule is specific to the test, and wherein the data quality rule is used to determine whether data in the production environment conforms to the data quality specification;
• transmitting the data quality rule, wherein when the data quality rule is received at a validation module, the validation module repeatedly executes a process for validating the data quality rule on the set of specified reference data, wherein the specified reference data is specific data used for the test, and wherein the data quality rule is continually updated until a determination is made to promote the data quality rule;
• receiving results of the process to validate the data quality rule, wherein the results include the updated data quality rule;
• promoting the updated data quality rule to a production environment;
• automating the updated data quality rule to automatically process data in a production environment;
• and
• implementing the updated data quality rule on data in the production environment to determine whether the data in the production environment conforms to the data quality specification.

A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, including instructions that, when executed by one or more processors, cause the one or more processors to:

• generate a business rule;
• generate a data quality specification for data to be tested, wherein the data quality specification is generated using the business rule and stored metadata, and wherein the data quality specification includes a test to perform on a set of specified reference data;
• generate a data quality rule corresponding to the data quality specification, wherein the data quality rule is specific to the test, and wherein the data quality rule is used to determine whether data in the production environment conforms to the data quality specification;
• transmit the data quality rule, wherein when the data quality rule is received at a validation module, the validation module repeatedly executes a process for validating the data quality rule on the set of specified reference data, wherein the specified reference data is specific data used for the test, and wherein the data quality rule is continually updated until a determination is made to promote the data quality rule;
• receive results of the process to validate the data quality rule, wherein the results include the updated data quality rule;
• promote the updated data quality rule to a production environment;
• automate the updated data quality rule to automatically process data in a production environment;
• and
• implement the updated data quality rule on data in the production environment to determine whether the data in the production environment conforms to the data quality specification.