Back to results
US 2014/0279734 A1Published application
Performing Cross-Validation Using Non-Randomly Selected Cases
AssigneeHewlett-Packard Development Company, L.P.
InventorGeorge Forman
Life of this patent
Estimating the term…
Abstract
A technique to perform cross-validation using a set of randomly selected labeled cases and a set of non-randomly selected labeled cases. A training set for use during cross-validation can include cases from both sets. A test set for use during cross-validation can include cases from the randomly selected set but exclude cases from the non-randomly selected set.
Claims15
A method for performing cross-validation, comprising:
- given a first set of randomly selected labeled cases and a second set of actively selected labeled cases,
- training a classifier on a training set comprising a first subset of the first set and a subset of the second set;
- and
- measuring the performance of the classifier on a test set comprising a second subset of the first set that is disjoint relative to the first subset, the test set including no cases from the second set.
1 more element
A system, comprising:
- a memory to store a first set of randomly sampled labeled cases and a second set of non-randomly sampled labeled cases;
- and
- a cross-validation module to perform cross-validation using the first and second sets of cases, the cross-validation module configured to exclude the second set of non-randomly sampled labeled cases from a test set used in a test phase of the cross-validation.
A non-transitory computer readable storage medium storing instructions that, when executed by a processor, cause a computer to perform cross-validation as follows:
- train a classifier on a training set comprising a first subset of a first set of randomly selected labeled cases and a subset of a second set of actively selected labeled cases;
- and
- measure the performance of the classifier on a test set comprising a second subset of the first set, the test set excluding actively selected cases.
Dependencies are inferred from the claim text.