Cleaning a machine learning dataset using coresets
AssigneeDataheroes, Ltd.
InventorsEitan NETZER, Oren NETZER, Liran SIGALAT
Life of this patent
Estimating the term…
Loading patent…
AssigneeDataheroes, Ltd.
InventorsEitan NETZER, Oren NETZER, Liran SIGALAT
Estimating the term…
A computerized method of cleaning a data set, configured for training of a machine learning model, includes data instances, each including a label. It comprises: computing coreset(s) from the data set, generating an importance measure for each coreset sample, indicative of an importance/weight value; selecting, from the coresets, a coreset(s) (a representative sub-set) that is representative of the data set; and selecting a number of samples, based on importance-related criteria, indicative of corresponding importance measures of the selected coreset(s) having high importance/low weight values. The set of selected samples has high probability of high importance/low weight values, compared to a probability associated with selecting data instances from the data set. The set facilitates determining whether each sample requires an action. The action gives an increased-quality representative sub-set. This facilitates quicker/higher-accuracy training of the model.
1-22. (canceled)
A computerized method of cleaning a data set, the method performed by a processing circuitry of a data cleaning system, the method comprising:
Dependencies are inferred from the claim text.