# US 11,030,167 B2 · Systems and methods for providing data quality management > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,030,167 B2 - Document ID: US11030167B2 - Status: Granted - Kind: B2 - Application number: 16/252,024 - Filed: 2019-01-18 - Published: 2019-05-23 - Granted: 2021-06-08 - Earliest claimed: 2016-12-19 - Assignees: Capital One Services, LLC - Applicants: Capital One Services, LLC - Inventors: Yatindra Nath; Ankur Garg; Rajeev Tiwari; Pranav Vrat; Amit Mohanty - Web page: https://patentgrep.com/patent/US11030167B2 ## CPC - G06F 16/215: Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors - G06F 16/122: {using management policies (point-in-time backing up or restoration of persistent data G06F11/1446; file migration policies for HSM systems G06F16/185)} - G06F 16/2365: {Ensuring data consistency and integrity} - G06F 16/48: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06N 5/025: Extracting rules from data - G06N 20/00: Machine learning - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract A system for providing data quality management may include a processor configured to execute instructions to: extract a plurality of first data elements from a data source; generate a data profile based on the first data elements; automatically create a first set of rules based on the first data elements and the data profile, the first set of rules assessing data quality according to a threshold; generate a second set of rules based on the first data elements and the first set of rules; extract a plurality of second data elements; assess the second data elements based on a comparison of the second data elements to the second set of rules; detect defects based on the comparison; analyze data quality according to the detected defects; and transmit signals representing the data quality analysis to a client device for display to a user. ## Claims ### Claim 1 A system for providing data quality management, the system comprising: at least one memory storing instructions; and at least one processor connected to a network and executing the instructions to perform operations comprising: extracting a plurality of first data elements from a data source; generating a data profile based on the first data elements; creating, by a machine learning algorithm and based on a property of the first data elements, a first set of rules for assessing data quality of the first data elements; generating a second set of rules based on the first data elements and the first set of rules; extracting a plurality of second data elements; assessing the second data elements based on a comparison of the second data elements to the second set of rules; detecting a plurality of defects based on the comparison, at least one of the detected defects including an event; determining, using a decision tree algorithm, data quality according to the detected defects, the data quality comprising a pocket of defect concentration; and transmitting instructions, to a client device, to display a representation of the determined pocket of defect concentration in a user interface of the client device. ### Claim 2 (depends on 1) The system of claim 1, wherein creating the first set of rules comprises: creating the first set of rules, based on at least a portion of a name of the first data elements. ### Claim 3 (depends on 1) The system of claim 1, wherein creating the first set of rules comprises: creating the first set of rules, based on a result of a formality check of at least one of the first data elements. ### Claim 4 (depends on 1) The system of claim 1, wherein the operations further comprise: clustering the assessed second data elements into multiple segments based on the detected defects. ### Claim 5 (depends on 1) The system of claim 1, wherein extracting the first data elements comprises parsing the first data elements according to at least one of an alphanumeric identifier or a data list from the data source. ### Claim 6 (depends on 1) The system of claim 1, wherein generating the data profile comprises: receiving user input; and generating the data profile based on the received user input and the first data elements. ### Claim 7 (depends on 1) The system of claim 1, wherein the generated data profile comprises at least one of organizational information, authentication timestamp information, network node location, network node preference, access point location, or access point preference. ### Claim 8 (depends on 1) The system of claim 1, wherein generating the second set of rules comprises generating the second set of rules based on a user input for adjusting the first set of rules. ### Claim 9 (depends on 1) The system of claim 1, wherein the second set of rules comprises a framework criteria comprising at least one of a support value, a confidence value, or a lift ratio. ### Claim 10 (depends on 1) The system of claim 1, wherein the first set of rules comprises at least one of a null rule, a range rule, a uniqueness rule, a valid value rule, a format rule, a conditional rule, or a consistency rule. ### Claim 11 A system for providing data quality management, the system comprising: at least one memory storing instructions; and at least one processor connected to a network and executing the instructions to perform operations comprising: extracting a plurality of first data elements from a data source; generating a data profile based on the first data elements; creating, by a machine learning algorithm and based on the first data elements, a first set of rules for assessing data quality of the first data elements; generating a second set of rules based on the first data elements and the first set of rules; extracting a plurality of second data elements; assessing the second data elements based on a comparison of the second data elements to the second set of rules; detecting a plurality of defects based on the comparison, at least one of the detected defects including an event; determining, using a decision tree algorithm, data quality according to the detected defects, the data quality comprising a pocket of defect concentration; and transmitting, to a client device, instructions to display a representation of the determined pocket of defect concentration in a user interface of the client device. ### Claim 12 (depends on 11) The system of claim 11, wherein creating the first set of rules comprises: creating a first preliminary set of rules, based on at least a portion of a name of the first data elements; and creating the first set of rules by refining the preliminary set of rules based on a user input. ### Claim 13 (depends on 11) The system of claim 11, wherein the operations further comprise: clustering the assessed second data elements into multiple segments based on the detected defects. ### Claim 14 (depends on 11) The system of claim 11, wherein extracting the first data elements comprises parsing the first data elements according to at least one of an alphanumeric identifier or a data list from the data source. ### Claim 15 (depends on 11) The system of claim 11, wherein generating the data profile comprises: receiving user input; and generating the data profile based on the received user input and the first data elements. ### Claim 16 (depends on 11) The system of claim 11, wherein the generated data profile comprises at least one of organizational information, authentication timestamp information, network node location, network node preference, access point location, or access point preference. ### Claim 17 (depends on 11) The system of claim 11, wherein generating the second set of rules comprises generating the second set of rules based on a user input for adjusting the first set of rules. ### Claim 18 (depends on 11) The system of claim 11, wherein the second set of rules comprises a framework criteria comprising at least one of a support value, a confidence value, or a lift ratio. ### Claim 19 (depends on 11) The system of claim 11, wherein the first set of rules comprises at least one of a null rule, a range rule, a uniqueness rule, a valid value rule, a format rule, a conditional rule, or a consistency rule. ### Claim 20 A system for providing data quality management, the system comprising: at least one memory storing instructions; and at least one processor connected to a network and executing the instructions to perform operations comprising: extracting a plurality of first data elements from a data source; generating a data profile based on the first data elements; creating, by a machine learning algorithm and based on the first data elements, a first set of rules for assessing data quality of the first data elements according to a threshold; generating a second set of rules based on the first data elements and the first set of rules; extracting a plurality of second data elements; assessing the second data elements based on a comparison of the second data elements to the second set of rules; detecting a plurality of defects based on the comparison, at least one of the detected defects including an event; determining, using a decision tree algorithm, data quality according to the detected defects, the data quality comprising a pocket of defect concentration; and transmitting, to a client device, instructions to display a representation of the determined pocket of defect concentration in a user interface of the client device.