Data-driven extraction and composition of secondary dynamics in facial performance capture

One or more non-transitory computer-readable medium including instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

• receiving training data associated with a performer enacting one or more facial expressions;
• generating a first geometric model of a first facial expression included in the one or more facial expressions based on the training data;
• generating a first set of values that correspond to one or more non-rigid portions of the face of the performer based on the first geometric model;
• generating a second set of values that correspond to one or more rigid portions of the face of the performer based on the first geometric model;
• and
• training a first expression model associated with the first facial expression based on the first set of values and the second set of values, wherein the first expression model is usable to predict an amount of secondary dynamics associated with the first facial expression.

A system comprising:

• one or more memories storing instructions;
• and
• one or more processors that are coupled to the one or more memories and, when executing the instructions, are configured to:
• receive training data associated with a performer enacting one or more facial expressions;
• generate a first geometric model of a first facial expression included in the one or more facial expressions based on the training data;
• generate a first set of values that correspond to one or more non-rigid portions of the face of the performer based on the first geometric model;
• generate a second set of values that correspond to one or more rigid portions of the face of the performer based on the first geometric model;
• and
• train a first expression model associated with the first facial expression based on the first set of values and the second set of values, wherein the first expression model is usable to predict an amount of secondary dynamics associated with the first facial expression.