Method and system for improving quality of a dataset

An artificial intelligence server configured for updating a dynamic list of labeling tasks to be performed on data items of a dataset stored in a storage system, the artificial intelligence server comprising:

• a memory module for storing versions of the dynamic list;
• a processor module configured to:
• receive one or more labels, each label associated to one labeling task;
• insert the one or more received labels into a dataset;
• train an Artificial Intelligence (AI) model on labeled data items from the dataset;
• obtain predicted labels for a plurality of unlabeled data items from the dataset by applying the model thereon;
• compute a model-uncertainty measurement by applying one or more uncertainty estimation methods;
• compute relevancy values for at least a subset of the predicted labels taking into account the predicted label and the model-uncertainty measurement;
• insert in the dynamic list, the data items corresponding to the labeling tasks with the highest relevancy values;
• and
• reorder the dynamic list upon computing of the relevancy values.