Camera reprojection for faces

One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

• generate, using a machine-learning model, a first image of a first portion of a face of a user from a first viewpoint, and a second image of a second portion of the face of the user from a second viewpoint, a synthesized image corresponding to a third portion of the face of the user as viewed from a third viewpoint, wherein the third viewpoint is different from the first viewpoint and second viewpoint;
• generate a texture image for the face of the user by projecting at least the synthesized image onto a 3D facial model from a predetermined camera pose that captured a ground-truth image for training the machine-learning model;
• reproject the texture image onto the 3D facial model at the predetermined camera pose, the predetermined camera pose representative of a position of a camera that captured the ground-truth image;
• and
• cause an output image of a facial representation of the user.

A system comprising:

• one or more processors;
• and one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:
• generate, using a machine-learning model, a first image of a first portion of a face of a user from a first view point, and a second image of a second portion of the face of the user from a second viewpoint, a synthesized image corresponding to a third portion of the face of the user as viewed from a third viewpoint, wherein the third viewpoint is different from the first viewpoint and the second viewpoint;
• generate a texture image for the face of the user by projecting at least the synthesized image onto a 3D facial model from a predetermined camera pose that captured a ground-truth image for training the machine-learning model;
• reproject the texture image onto the 3D facial model at the predetermined camera pose, the predetermined camera pose representative of a position of a camera that captured the ground-truth image;
• and
• cause an output image of a facial representation of the user.