System and method for automatically suggesting rules for data stored in a table

A method of automatically suggesting columns within a table, the method comprising:

• profiling the table to identify is content type for each of one or more of the plurality of columns;
• accessing a rule knowledge base to locate content types specified for one or more identified rules;
• presenting one or more of the columns corresponding to content types specified for the one or more identified rules as suggestions;
• applying accepted rules for data quality detection and monitoring;
• storing the received acceptance in the rule knowledge base;
• and
• applying the user acceptance knowledge in future rule suggestion.

An apparatus comprising:

• a processor;
• a volatile memory including a staging area, the staging area storing data stored in a table, the table comprising a plurality of columns;
• a non-volatile memory including a rule knowledge base, the rule knowledge base including a data structure containing a plurality of content types and, for one or more of the plurality of content types, one or more rules specified for the one or more of the plurality of content types;
• a content type identification profiler configured to profile the table to identify a content type for each of one or more of the plurality of columns;
• a rule suggestion engine configured to access the rule knowledge base to locate rules specified for identified content types;
• a user interface configured to:
• present one or more of the located rules specified for identified content types via the user interface as suggestions;
• receive acceptance of one or more of the suggested rules from a user;
• and
• store the received acceptance in the rule knowledge base.

An apparatus comprising:

• a processor:
• a volatile memory including a staging area, the staging area storing data stored in a table, the table comprising a plurality of columns;
• a non-volatile memory including a rule knowledge base, the rule knowledge base including a data structure containing a plurality of content types and, for one or more of the plurality of content types, one or more rules specified for the one or more of the plurality a content types;
• a content type identification profiler configured to profile the table to identify a content type for each of one or more of the plurality of columns;
• a rule suggestion engine configured to access a rule knowledge base to locate rules specified for identified content types;
• a user interface configured to:
• presenting one or more of the columns corresponding to content types specified for the one or more identified rules as suggestions;
• receiving acceptance of one or more of the suggested one or more columns from a user,
• applying accepted rules for data quality detection and monitoring;
• storing the received validations in the rule knowledge base;
• and
• applying the user acceptance knowledge in future rule suggestion.

A non-transitory computer-readable storage medium comprising instructions that, when executed by at least one processor of a machine, cause the machine to perform operations of automatically suggesting rules for data stored in a table, the table comprising a plurality of columns, the method comprising:

• profiling the table to identify a content type for each of one or more of the plurality of columns;
• accessing a rule knowledge base to locate rules specified for identified content types;
• presenting one or more of the located rules specified for identified content types as suggestions;
• receiving acceptance of one or more of the suggested rules from a user;
• applying accepted rules for data quality detection and monitoring;
• storing the received acceptance in the rule knowledge base;
• and
• applying the user acceptance knowledge in future rule suggestion

A non-transitory computer-readable storage medium comprising instructions that, when executed by at least one processor of a machine, cause the machine to perform operations of automatically suggesting columns within a table, the method comprising:

• profiling the table to identify a content type for each of one or more of the plurality of columns;
• accessing a rule knowledge base to locate content types specified for one or more identified rules;
• presenting one or more of the columns corresponding to content types specified for the one or more identified rules as suggestions;
• receiving acceptance of one or more of the suggested one or more columns from a user;
• applying accepted rules for data quality detection and monitoring;
• storing the received acceptance in the rule knowledge base;
• and
• applying the user acceptance knowledge in future rule suggestion.