Processing a data set

A computer program product for processing a data set stored in a computer system, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:

• provide one or more parameters for quantifying data quality of the data set;
• generate for each parameter of the one or more parameters, a reference pattern comprising a set of rules indicating a dysfunctional behavior of the values of the parameter;
• process the data set to obtain values of the one or more parameters;
• identify a parameter of the one or more parameters whose obtained values match a corresponding reference pattern of the generated reference patterns;
• assign to the identified parameter a resource weight value indicating the amount of processing resources required to fix the dysfunctional behavior of the identified parameter;
• and
• initiate a process to fix the dysfunctional behavior of the identified parameter using the amount of processing resources of the computer system responsive to a user request, thereby increasing performance of the computer system by reducing processing time of the data set attributed to ad-hoc monitoring of data quality problems.

A computer system for processing a data set stored in the computer system, wherein one or more parameters for quantifying data quality of the data set are provided, the computer system comprising:

• a memory having computer readable instructions;
• and
• one or more processors for executing the computer readable instructions, the computer readable instructions comprising:
• providing one or more parameters for quantifying data quality of the data set;
• generating for each parameter of the one or more parameters, a reference pattern comprising a set of rules indicating a dysfunctional behavior of the values of the parameter;
• processing the data set to obtain values of the one or more parameters;
• identifying a parameter of the one or more parameters whose obtained values match a corresponding reference pattern of the generated reference patterns;
• assigning to the identified parameter a resource weight value indicating the amount of processing resources required to fix the dysfunctional behavior of the identified parameter;
• and
• initiating a process to fix the dysfunctional behavior of the identified parameter using the amount of processing resources of the computer system responsive to a user request, thereby increasing performance of the computer system by reducing processing time of the data set attributed to ad-hoc monitoring of data quality problems.