Computing the need for standardization of a set of values

A method for determining a data standardization score for an attribute of a dataset, the method comprising:

• providing attribute metadata descriptive of the attribute;
• providing a data standardization score algorithm for finding potential duplicates in attribute values and calculating a data standardization score accordingly, the calculated data standardization score reflecting whether data quality of attribute values would increase if a standardization rule is applied to the attribute values;
• determining, based on the metadata for the attribute, whether an indication to carry or not to carry out standardization is available for at least part of attribute values of the dataset;
• in response to finding the indication to carry out standardization, setting a respective value for the data standardization score;
• in response to not finding the indication to carry out standardization, running the data standardization score algorithm on the at least part of attribute values of the dataset;
• comparing the data standardization score value to a predefined criterion to determine whether data standardization is to be applied on the attribute;
• and
• applying data standardization on the attribute to transform data to a predefined format in response to determining data standardization is to be applied on the attribute.