Test and training data

A method comprising:

• generating a plurality of sets of training and test data packages using a method as claimed in any one of the preceding claims;
• training a model using training data of a selected one of said training and test data packages;
• and
• generating a performance measurement for the trained model by applying the test data of the selected training and test data packages to the trained model.

An apparatus comprising:

• means for obtaining a plurality of sets of training and test data packages, wherein:
• each of the plurality of sets comprises test data and training data, wherein the test data comprises a subset of a first plurality of data items and the training data comprises a remainder of the first plurality of data items;
• each data item of the first plurality of data items is allocated as test data for only one of the plurality of sets of training and test data packages;
• and each data item comprises a classification identifier;
• means for receiving a new data item having a classification identifier;
• and
• means for adding the new data item to one of the plurality of sets of training and test data packages as test data and adding the new data item to the other of the plurality of sets of training and test data packages as training data, wherein the one of the plurality of sets of training and test data packages to which the new data item is added as test data is selected depending on the classification identifier of the new data item and the classification identifiers of the first plurality of data items.