Emotion prediction method based on virtual facial expression image augmentation

An emotion prediction system comprising:

• a facial expression recognition unit configured to extract a facial expression feature from a user facial image;
• and
• an emotion prediction unit configured to predict a user emotion from the extracted facial expression feature,
• wherein the facial expression recognition unit is configured to extract the facial expression feature by using a facial expression recognition network, the facial expression recognition network being an AI model that is trained to receive a user facial image and to extract a facial expression feature,
• wherein the facial expression recognition network is retrained with virtual facial images which are augmented from a facial image that causes a failure in emotion recognition.

A facial expression recognition method comprising:

• a step of acquiring a user facial image;
• and
• a step of extracting a facial expression feature from the acquired user facial image.
• wherein the step of extracting comprises extracting the facial expression feature by using a facial expression recognition network, the facial expression recognition network being an AI model that is trained to receive a user facial image and to extract a facial expression feature,
• wherein the facial expression recognition network is retrained with virtual facial images which are augmented from a facial image that causes a failure in predicting an emotion from an extracted facial expression feature.