Method for synchronizing digital human voice and lip movements

A method for synchronizing digital human voice and lip movements, comprising:

• acquiring a source video, and preprocessing the source video to obtain audio data and image data;
• performing synchronization processing on audio encoding features and image encoding features by using a lip synchronization model to obtain synchronization features, wherein the audio encoding features are output by the lip synchronization model from the audio data, the image encoding features are obtained by the lip synchronization model performing image division, feature fusion and feature encoding on the image data, and the synchronization processing comprises linear feature projection and feature similarity calculation;
• and
• performing video generation according to the synchronization features to obtain a target video;
• wherein a training process of the lip synchronization model comprises:
• acquiring a training video, and extracting audio training data and image training data according to the training video;
• performing model training on the audio training data, the image training data, and the lip synchronization model;
• and
• converging the lip synchronization model by using a loss function until the lip synchronization model meets preset model requirements.