Rules-based dataset cleaning

A system comprising:

• memory;
• and
• one or more processors coupled to the memory, the one or more processors to:
• store rules for performing rules-based cleaning operations on a plurality of datasets, wherein each rule comprises one or more functions to be executed against a dataset during the rules-based cleaning operations, the one or more functions each having one or more associated conditions and actions, wherein the one or more actions are performed on the dataset responsive to the one or more associated conditions being satisfied;
• and
• apply the rules to each of the plurality of datasets to perform the rules-based cleaning operations, wherein to apply the rules to a given dataset, the one or more processors to:
• identify an ordered list of the one or more functions to be executed with respect to the given dataset during the rules-based cleaning operations;
• determine, for each of the one or more functions, whether the given dataset satisfies one or more conditions associated with a respective function of the one or more functions;
• responsive to the given dataset satisfying the one or more conditions associated with the respective function, perform, on the given dataset, one or more actions associated with the respective function;
• and
• provide a derived dataset comprising at least one modification to the given dataset resulting from the one or more actions associated with the respective function.

A non-transitory computer readable storage medium storing instructions that, when executed by one or more processors, cause the one or more processors to:

• store rules for performing rules-based cleaning operations on a plurality of datasets, wherein each rule comprises one or more functions to be executed against a dataset during the rules-based cleaning operations, the one or more functions each having one or more associated conditions and actions, wherein the one or more actions are performed on the dataset responsive to the one or more associated conditions being satisfied;
• and
• apply the rules to each of the plurality of datasets to perform the rules-based cleaning operations, wherein to apply the rules to a given dataset, the instructions cause the one or more processors to:
• identify an ordered list of the one or more functions to be executed with respect to the given dataset during the rules-based cleaning operations;
• determine, for each of the one or more functions, whether the given dataset satisfies one or more conditions associated with a respective function of the one or more functions;
• responsive to the given dataset satisfying the one or more conditions associated with the respective function, perform, on the given dataset, one or more actions associated with the respective function;
• and
• provide a derived dataset comprising at least one modification to the given dataset resulting from the one or more actions associated with the respective function.