Text Classifier Training

A computer program product comprising a non-transitory computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a computing device, causes the computing device to implement a domain terms selector component, a domain terms replacer component, and a text classifier trainer component, wherein the computer readable program causes the computing device to:

• receive, by the data processing system, a training set of text and class specification pairs to be used as a ground truth for training a text classifier machine learning model for a text classifier;
• identify, by the domain terms selector component executing on a processor of the data processing system, at least one domain term in the texts of the training set;
• replace, by the domain terms replacer component executing on a processor of the data processing system, the at least one identified domain term in the texts of the training set with a corresponding replacement term to form a revised set of text and class specification pairs;
• and
• train, by the text classifier trainer component executing on a processor of the data processing system, the text classifier machine learning model using the revised set to form a trained text classifier machine learning model,
• wherein replacing the identified domain term comprises, for each given identified domain term, determining a domain term type of the given identified domain term and replacing the given identified domain term based on selecting a replacement method associated with the domain term type by a replacement method map.

An apparatus comprising:

• a processor;
• and
• a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to implement a domain terms selector component, a domain terms replacer component, and a text classifier trainer component, wherein the instructions cause the processor to:
• receive, by the data processing system, a training set of text and class specification pairs to be used as a ground truth for training a text classifier machine learning model for a text classifier;
• identify, by the domain terms selector component executing on a processor of the data processing system, at least one domain term in the texts of the training set;
• replace, by the domain terms replacer component executing on a processor of the data processing system, the at least one identified domain term in the texts of the training set with a corresponding replacement term to form a revised set of text and class specification pairs;
• and
• train, by the text classifier trainer component executing on a processor of the data processing system, the text classifier machine learning model using the revised set to form a trained text classifier machine learning model,
• wherein replacing the identified domain term comprises, for each given identified domain term, determining a domain term type of the given identified domain term and replacing the given identified domain term based on selecting a replacement method associated with the domain term type by a replacement method map.