Method of Facial Expression Generation with Data Fusion

A virtual reality system for facial expression generation with data fusion, the virtual reality system comprising:

• a computing device, for executing a software system to generate virtual reality images;
• a head-mounted display (HMD), connecting to the computing device, for displaying a virtual reality image to an user;
• and
• a plurality of tracking devices, connecting to the computing device, for collecting facial information of the user from a plurality of data sources, wherein the plurality of data sources includes a real-time data detection and a data pre-configuration, which comprises at least one of a randomly generated facial feature and a predefined facial feature within a predetermined interval;
• wherein the computing device includes:
• a processing means for executing a program;
• and
• a storage unit coupled to the processing means for storing the program;
• wherein the program instructs the processing means to perform the following steps:
• obtaining facial information from the plurality of tracking devices;
• mapping the facial information to facial expression parameters for simulating a facial geometry model of the user;
• performing a fusion process according to the facial expression parameters, to generate fusing parameters associated to the facial expression parameters with weighting;
• and
• generating a facial expression of an avatar in the virtual reality system according to the fusing parameters.