Systems and methods for providing data quality management

A system for providing data quality management, the system comprising:

• at least one memory storing instructions;
• and
• at least one processor connected to a network and executing the instructions to perform operations comprising:
• extracting a plurality of first data elements from a data source;
• generating a data profile based on the first data elements;
• creating, by a machine learning algorithm and based on a property of the first data elements, a first set of rules for assessing data quality of the first data elements;
• generating a second set of rules based on the first data elements and the first set of rules;
• extracting a plurality of second data elements;
• assessing the second data elements based on a comparison of the second data elements to the second set of rules;
• detecting a plurality of defects based on the comparison, at least one of the detected defects including an event;
• determining, using a decision tree algorithm, data quality according to the detected defects, the data quality comprising a pocket of defect concentration;
• and
• transmitting instructions, to a client device, to display a representation of the determined pocket of defect concentration in a user interface of the client device.

A system for providing data quality management, the system comprising:

• at least one memory storing instructions;
• and
• at least one processor connected to a network and executing the instructions to perform operations comprising:
• extracting a plurality of first data elements from a data source;
• generating a data profile based on the first data elements;
• creating, by a machine learning algorithm and based on the first data elements, a first set of rules for assessing data quality of the first data elements;
• generating a second set of rules based on the first data elements and the first set of rules;
• extracting a plurality of second data elements;
• assessing the second data elements based on a comparison of the second data elements to the second set of rules;
• detecting a plurality of defects based on the comparison, at least one of the detected defects including an event;
• determining, using a decision tree algorithm, data quality according to the detected defects, the data quality comprising a pocket of defect concentration;
• and
• transmitting, to a client device, instructions to display a representation of the determined pocket of defect concentration in a user interface of the client device.

A system for providing data quality management, the system comprising:

• at least one memory storing instructions;
• and
• at least one processor connected to a network and executing the instructions to perform operations comprising:
• extracting a plurality of first data elements from a data source;
• generating a data profile based on the first data elements;
• creating, by a machine learning algorithm and based on the first data elements, a first set of rules for assessing data quality of the first data elements according to a threshold;
• generating a second set of rules based on the first data elements and the first set of rules;
• extracting a plurality of second data elements;
• assessing the second data elements based on a comparison of the second data elements to the second set of rules;
• detecting a plurality of defects based on the comparison, at least one of the detected defects including an event;
• determining, using a decision tree algorithm, data quality according to the detected defects, the data quality comprising a pocket of defect concentration;
• and
• transmitting, to a client device, instructions to display a representation of the determined pocket of defect concentration in a user interface of the client device.