System and Method to Digitally Replace Objects in Images or Video

An system comprising:

• a memory;
• and
• a processor coupled to the memory, wherein the processor is configured to perform operations, the operations comprising:
• receiving video data of a video frame of video content;
• identifying a first representation of a first object in the video frame to be replaced with a second representation of a second object, the first representation to be replaced based on absence of a visible feature in the first representation;
• manipulating a three-dimensional model of the second object to generate the second representation, wherein the second representation includes the visible feature;
• and
• generating a modified version of the video frame that includes the second representation in place of the first representation.

A computer-readable storage device storing instructions that, when executed by a processor, cause the processor to perform operations, the operations comprising:

• receiving video data of a video frame of video content;
• identifying a first representation of a first object in the video frame to be replaced with a second representation of a second object, the first representation to be replaced based on absence of a visible feature in the first representation;
• manipulating a three-dimensional model of the second object to generate the second representation, wherein the second representation includes the visible feature;
• and
• generating a modified version of the video frame that includes the second representation in place of the first representation.