Automatic labeling of large datasets
AssigneeMicrosoft Technology Licensing, LLC
InventorSriram Vasudevan
Life of this patent
Estimating the term…
Abstract
Methods, systems, and computer programs are presented for labeling datasets. An example method can include generating rules for labeling data records within a first dataset. The rules can indicate an extent to which a data record matches query criteria. The method can further include generating an aggregated label for the corresponding data record based on the rules and training a machine learning model using the first dataset and the aggregated label. The method can include receiving an indication of user engagement and combining the indication of user engagement with the aggregated label to generate a score.
Claims20
A computer-implemented method for labeling datasets, the method comprising:
- generating, by one or more processors, a plurality of rules for labeling data records within a first dataset, the rules indicating an extent to which a corresponding data record matches one or more query criteria;
- generating, by the one or more processors, an aggregated label for the corresponding data record based on the plurality of rules;
- training a machine learning model using the first dataset and the aggregated label;
- and
- receiving an indication of user engagement and combining the indication of user engagement with the aggregated label to generate a score.
A system comprising:
- a memory comprising instructions;
- one or more databases for storing external data;
- and
- one or more computer processors, wherein the instructions, when executed by the one or more computer processors, cause the system to perform operations comprising:
- generating, by one or more processors, a plurality of rules for labeling data records within a first dataset separate from the external databases, the rules indicating an extent to which a corresponding data record matches one or more query criteria;
- generating, by the one or more processors, an aggregated label for the corresponding data record based on the plurality of rules;
- and
- training a machine learning model using the first dataset and the aggregated label;
- and receiving an indication of user engagement and combining the indication of user engagement with the aggregated label to generate a score.
A tangible machine-readable storage medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:
- receiving a user query, the query being characterized according to a number of features;
- generating an aggregated label for a data record based on a plurality of rules that indicate the extent to which a corresponding data record matches one or more of the number of features;
- training a model using a first dataset and the aggregated label;
- and
- causing presentation of a user interface (UI) for presenting an assessment of one or more data records of the first dataset or a second dataset based on the model and based on a score provided by the model.
Dependencies are inferred from the claim text.