Face swapping with neural network-based geometry refining

A computer-implemented method for changing a face within an image, the method comprising:

• receiving a first image including a face associated with a first facial identity;
• generating, via a machine learning model, wherein the machine learning model comprises a decoder including a plurality of sets of layers, wherein each set of layers included in the plurality of sets of layers is associated with a different facial identity, and wherein generating the first texture map and the first position map uses a first set of layers included in the plurality of sets of layers that is associated with the second facial identity;
• and
• rendering a second image including a face associated with a second facial identity based on the first texture map and the first position map, wherein the second facial identity is different from the first facial identity.

One or more non-transitory computer-readable media including instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

• receiving a first image including a face associated with a first facial identity;
• generating, via a machine learning model, at least a first texture map, a second texture map, and a first position map based on the first image, wherein the second texture map comprises one or more adjustments to the first texture map;
• and
• rendering a second image including a face associated with a second facial identity based on the first texture map, the first position map, and the second texture map, wherein the second facial identity is different from the first facial identity.

A system comprising:

• one or more memories storing instructions;
• one or more processors that are coupled to the one or more memories and, when executing the instructions, are configured to:
• receive a first image including a face associated with a first facial identity;
• generate, via a machine learning model, at least a first texture map, a second texture map, and a first position map based on the first image, wherein the second texture map comprises one or more adjustments to the first texture map;
• and
• render a second image including a face associated with a second facial identity based on the first texture map, the first position map, and the second texture map, wherein the second facial identity is different from the first facial identity.