Training and inference method for generating stylized 3D mesh and device for the same

A training method for generating a stylized 3D mesh, the method comprising the steps of:

• inputting a training-purpose 2D input image into a first neural network, and generating a per-pixel feature vector from the training-purpose 2D input image based on a first target style;
• inputting the per-pixel feature vector into a second neural network, and training the second neural network to generate and output a surface normal map corresponding to a 3D mesh of the training-purpose 2D input image;
• providing a new first neural network applied with a second target style;
• and
• providing the new first neural network and second neural network to generate a surface normal map applied with the second target style in an inference-purpose 2D input image.

An inference method for generating a stylized 3D mesh, the method comprising the steps of:

• inputting a 2D input image into a first neural network, and generating a per-pixel feature vector based on the 2D input image and a target style;
• inputting the per-pixel feature vector into a second neural network, and generating and outputting the surface normal map applied with the target style as a surface normal map corresponding to a 3D mesh of the 2D input image;
• and
• generating a stylized 3D mesh of the 2D input image based on the surface normal map.