Techniques for generating dubbed media content items

One or more non-transitory computer-readable media storing instructions that, when executed by at least one processor, cause the at least one processor to perform steps comprising:

• generating first three-dimensional (3D) geometry, a texture map, and a lighting map based on a face of an actor included in a first video frame of a first media content item;
• generating second 3D geometry based on a face of a dubber included in a second video frame of a second media content item;
• performing one or more operations that align the second 3D geometry with the first 3D geometry to generate an aligned second 3D geometry;
• performing one or more operations to convert the lighting map to a neural lighting;
• and
• performing one or more operations via one or more trained machine learning models to render a third video frame based on the aligned second 3D geometry, the texture map, the neural lighting, and the first video frame of the first media content item.

A system, comprising:

• a memory storing instructions;
• and
• a processor that is coupled to the memory and, when executing the instructions, is configured to perform the steps of:
• generating first three-dimensional (3D) geometry, a texture map, and a lighting map based on a face of an actor included in a first video frame of a first media content item,
• generating second 3D geometry based on a face of a dubber included in a second video frame of a second media content item,
• performing one or more operations that align the second 3D geometry with the first 3D geometry to generate an aligned second 3D geometry,
• performing one or more operations to convert the lighting map to a neural lighting, and
• performing one or more operations via one or more trained machine learning models to render a third video frame based on the aligned second 3D geometry, the texture map, the neural lighting, and the first video frame of the first media content item.