Method of generating 3D facial model for an avatar and related device
AssigneeXrspace Co., Ltd.
InventorsTing-Chieh Lin, Shih-Chieh Chou
Life of this patent
Estimating the term…
Abstract
A method of generating 3D facial geometry for a computing device is disclosed. The method comprises obtaining a 2D image, performing a deep neural network, DNN, operation on the 2D image, to classify each of facial features of the 2D image as texture components and obtain probabilities that the facial feature belong to the texture components, wherein the texture components are represented by 3D face mesh and are predefined in the computing device, and generating a 3D facial model based on a 3D face template predefined in the computing device and the texture component with the highest probability.
Claims21
A method of generating 3D facial geometry for an avatar, for a computing device, the method comprising:
- obtaining a 2D image;
- performing a landmark detection operation on the 2D image, to obtain at least a facial feature with landmarks;
- determining weightings for a plurality of classifications of the facial feature based on relative distances of the landmarks, wherein the plurality of classifications are predefined in the computing device;
- performing a deep neural network, DNN, operation on the 2D image, to classify each of facial features of the 2D image as texture components and obtain probabilities that the facial feature belong to the texture components, wherein the texture components are represented by 3D face mesh and are predefined in the computing device;
- and
- generating a 3D facial model based on a 3D face template predefined in the computing device with 3D parameters corresponding to the plurality of classifications of the facial feature, the corresponding weightings, and the texture component with the highest probability.
An avatar simulation system comprising:
- a camera, for obtaining a 2D image;
- a computing device or a cloud, for generating 3D facial model;
- wherein the computing device or the cloud includes:
- a processing unit for executing a program;
- and
- a storage unit coupled to the processing unit for storing the program;
- wherein the program instructs the processing unit to perform the following steps:
- obtaining a 2D image;
- performing a landmark detection operation on the 2D image, to obtain at least a facial feature with landmarks;
- determining weightings for a plurality of classifications of the facial feature based on relative distances of the landmarks, wherein the plurality of classifications are predefined in the computing device;
- performing a deep neural network, DNN, operation on the 2D image, to classify each of facial features of the 2D image as texture components and obtain probabilities that the facial feature belong to the texture components, wherein the texture components are represented by 3D face mesh and are predefined in the computing device;
- and
- generating a 3D facial model based on a 3D face template predefined in the computing device with 3D parameters corresponding to the plurality of classifications of the facial feature, the corresponding weightings, and the texture component with the highest probability.
A computing device for generating 3D facial geometry for an avatar comprising:
- a processing unit for executing a program;
- and
- a storage unit coupled to the processing unit for storing the program;
- wherein the program instructs the processing unit to perform the following steps:
- obtaining a 2D image;
- performing a landmark detection operation on the 2D image, to obtain at least a facial feature with landmarks;
- determining weightings for a plurality of classifications of the facial feature based on relative distances of the landmarks, wherein the plurality of classifications are predefined in the computing device;
- performing a deep neural network, DNN, operation on the 2D image, to classify each of facial features of the 2D image as texture components and obtain probabilities that the facial feature belong to the texture components, wherein the texture components are represented by 3D face mesh and are predefined in the computing device;
- and
- generating a 3D facial model based on a 3D face template predefined in the computing device with 3D parameters corresponding to the plurality of classifications of the facial feature, the corresponding weightings, and the texture component with the highest probability.
Dependencies are inferred from the claim text.