Deep Learning-Based Three-Dimensional Facial Reconstruction System

A deep learning-based three-dimensional (3D) facial reconstruction system, comprising:

• a main color range camera arranged at a front angle of a reference user, and configured to capture a main color image and a main depth map of the reference user from the front angle;
• a plurality of auxiliary color cameras arranged at a plurality of side angles of the reference user, and configured to capture a plurality of auxiliary color images of the reference user from the plurality of side angles;
• a processor coupled to the main color range camera and the plurality of auxiliary color cameras;
• and
• a memory coupled to the processor and configured to store a plurality of instructions;
• wherein the processor is configured to execute the plurality of instructions to:
• generate a 3D front angle image of a 3D ground truth model according to the main color image and the main depth map;
• generate a plurality of 3D side angle images of the 3D ground truth model according to the 3D front angle image and the plurality of auxiliary color images;
• and
• train an artificial neural network model according a training image, the 3D front angle image and the plurality of 3D side angle images.