Asymmetric facial expression recognition

A system, comprising:

• at least one computing device in communication with a computer memory, the computer memory comprising computer-readable instructions that upon execution by the at least one computing device, configure the system to perform operations comprising:
• determining a first loss function based on a first set of feature vectors associated with a first set of images depicting facial expressions and a first set of labels indicative of the facial expressions;
• determining a second loss function based on a second set of feature vectors associated with a second set of images depicting asymmetric facial expressions and a second set of labels indicative of the asymmetric facial expressions;
• determining, based on the first loss function and the second loss function, a maximum loss function;
• applying the maximum loss function during training of a model, wherein the trained model is configured to predict different types of asymmetric facial expressions in input images;
• and
• controlling a facial animation using the predicted different types of asymmetric facial expressions.

A non-transitory computer-readable storage medium, storing computer-readable instructions that upon execution by a processor cause the processor to implement operations comprising:

• determining a first loss function based on a first set of feature vectors associated with a first set of images depicting facial expressions and a first set of labels indicative of the facial expressions;
• determining a second loss function based on a second set of feature vectors associated with a second set of images depicting asymmetric facial expressions and a second set of labels indicative of the asymmetric facial expressions;
• determining, based on the first loss function and the second loss function, a maximum loss function;
• applying the maximum loss function during training of a model, wherein the trained model is configured to predict different types of asymmetric facial expressions in input images;
• and
• controlling a facial animation using the predicted different types of asymmetric facial expressions.