Facial anonymization with consistent facial attribute preservation in video

A system for consistently anonymizing a source video, comprising:

• one or more memories to store a source video comprising a plurality of source images of a person with a source identity;
• and
• one or more processors configured to:
• execute an identity-preserving encoder and decoder trained to preserve identity information unique to an individual in an encoded space, the identity-preserving encoder executed to encode one or more of the source images in the source video of the person with a source identity to generate identity-preserving encoded data representing the source identity information in the encoded space,
• execute a de-identification engine to generate de-identifying encoded data representing information for a target identity different than the source identity in the encoded space,
• compute a transformation based on a difference between the identity-preserving encoded data and the de-identifying encoded data, the difference representing the removal of the source identity information and the addition of the target identity information,
• swap the identity from the source to the target in the encoded space by applying the same transformation to the identity-preserving encoded data for a plurality of source images causing the removal of the source identity information and the addition of the same target identity information for all of the plurality of source images, and
• execute the decoder to decode the swapped identity encoded data to generate a plurality of output images representing the non-identity information from the plurality of source images and the same target identity, but not the source identity, information, for all the plurality of output images in an output video.