Teacher and student learning for constructing mixed-domain model

A computer system for constructing a model supporting a plurality of domains, the computer system comprising:

• a memory storing program instructions;
• a processing circuitry in communications with the memory for executing the program instructions, wherein the program instructions are configured to:
• prepare a plurality of teacher models, wherein each teacher model is specialized for different one of the plurality of the domains;
• obtain a plurality of training data collections, wherein each of the plurality of training data collections is collected for a different one of the plurality of the domains;
• input training data from each of the plurality of training data collections into a corresponding one of the plurality of the teacher models to generate a plurality of soft label sets;
• and
• train a student model using the plurality of the soft label sets.

A computer program product constructing a model supporting a plurality of domains, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method comprising:

• preparing a plurality of teacher models, each teacher model being specialized for different one of the plurality of the domains;
• obtaining a plurality of training data collections, each of the plurality of training data collections being collected for a different one of the plurality of the domains;
• inputting training data from each of the plurality of the training data collections into a corresponding one of the plurality of the teacher models to generate a plurality of soft label sets;
• and
• training a student model using the plurality of the soft label sets.