Method and apparatus for virtual avatar generation

A method for virtual avatar generation, comprising:

• receiving and storing a first facial image and a second facial image by a face recorder;
• identifying faces of the first facial image and the second facial image by a face encoder;
• extracting a plurality of first facial features from the first facial image and then encode them into M first facial feature vectors by the face encoder;
• extracting a plurality of second facial features from the second facial image and then encode them into M second facial feature vectors by the face encoder;
• synthesizing a facial fused feature vector from the first facial feature vectors in combination with the second facial feature vectors by a face fusion engine, thereby generating a fused image from the facial fused feature vector;
• receiving and storing a first audio clip and a second audio clip by a voice recorder;
• identifying voices of the first audio clip and the second audio clip by a voice encoder;
• extracting a plurality of first voice features from the first audio clip and then encode them into N first voice feature vectors by the voice encoder;
• extracting a plurality of second voice features from the second audio clip and then encode them into N second voice feature vectors by the voice encoder;
• and
• synthesizing a voice fused feature vector from the first voice feature vectors in combination with the second voice feature vectors by a voice fusion engine, thereby generating a fused voice from the voice fused feature vector.