Training mechanism of verbal harassment detection systems
AssigneeBeijing Didi Infinity Technology and Development Co., Ltd.
InventorsYing Lyu, Kun Han
Life of this patent
Estimating the term…
Abstract
In some cases, lower quality, large scale training data can be automatically generated by automatic labeling. The generated training data can be used to pre-train a machine learning model. For instance, the model can be a model for detection of verbal harassment. Parameters of the pre-trained model can be refined or updated using another one or more higher-quality sets of training data, with which the model can be subsequently trained.
Claims20
A computer-implemented method of training a machine learning model for detection of verbal harassment, the method comprising:
- by one or more hardware processors:
- determining a plurality of verbal harassment heuristics using a first plurality of segments, the segments of the first plurality of segments previously labeled with an occurrence of verbal harassment or a non-occurrence of verbal harassment;
- determining a plurality of labels for a second plurality of segments by applying the plurality of verbal harassment heuristics and a plurality of verbal harassment patterns, the segments of the second plurality of segments not previously labeled with the occurrence or the non-occurrence of verbal harassment;
- aggregating the plurality of labels into a plurality of likelihoods for the occurrence of verbal harassment;
- selecting a subset of segments from the second plurality of segments based on comparing the plurality of likelihoods to at least one threshold;
- pre-training a machine learning model for verbal harassment detection using the subset of segments from the second plurality of segments and a plurality of randomly selected segments;
- and
- subsequent to the pre-training, updating one or more parameters of the machine learning model using a third plurality of segments.
A computer-implemented method of training a machine learning model for detection of verbal harassment, the method comprising:
- by one or more hardware processors:
- generating a first set of training data comprising a first plurality of segments by labeling at least some of the segments of the first plurality of segments;
- pre-training a machine learning model for verbal harassment detection using the first set of training data;
- and
- subsequent to completion of pre-training the machine learning model using the first set of training data, updating one or more parameters of the machine learning model using a second set of training data comprising a second plurality of segments.
Dependencies are inferred from the claim text.