Personalized deformable mesh by finetuning on personalized texture
AssigneeQUALCOMM Incorporated
InventorsWei-Lun CHANG, Ke-Li CHENG, Michel Adib SARKIS
Life of this patent
Estimating the term…
Abstract
Techniques and systems are provided for generating a three-dimensional facial model. For instance, a process can include: obtaining a frame, the frame including a face; obtaining a mesh 3D model of the face; generating facial texture information associated with the face based on the frame and the mesh 3D model; generating, based on the facial texture information, displacement map information; and applying the displacement map information to the mesh 3D model to generate a finetuned mesh 3D model.
Claims30
A method for generating a three-dimensional facial model, the method comprising:
- obtaining a frame, the frame including a face;
- obtaining a mesh 3D model of the face;
- generating facial texture information associated with the face based on the frame and the mesh 3D model;
- generating, based on the facial texture information, displacement map information;
- and
- applying the displacement map information to the mesh 3D model to generate a finetuned mesh 3D model.
An apparatus for generating a three-dimensional facial model, the apparatus comprising:
- at least one memory;
- and
- at least one processor coupled to the at least one memory, the at least one processor being configured to:
- obtain a frame, the frame including a face;
- obtain a mesh 3D model of the face;
- generate facial texture information associated with the face based on the frame and the mesh 3D model;
- generate, based on the facial texture information, displacement map information;
- and
- apply the displacement map information to the mesh 3D model to generate a finetuned mesh 3D model.
A non-transitory computer-readable medium having stored thereon instructions that, when executed by at least one processor, cause the at least one processor to:
- obtain a frame, the frame including a face;
- obtain a mesh 3D model of the face;
- generate facial texture information associated with the face based on the frame and the mesh 3D model;
- generate, based on the facial texture information, displacement map information;
- and
- apply the displacement map information to the mesh 3D model to generate a finetuned mesh 3D model.
Dependencies are inferred from the claim text.