3D face modeling methods and apparatuses
AssigneeSamsung Electronics Co., Ltd.
InventorsSeon Min Rhee, Jungbae Kim, Jaejoon Han
Life of this patent
Estimating the term…
Abstract
A three-dimensional (3D) face modeling method and apparatus is disclosed. The 3D face modeling apparatus may generate a personalized 3D face model using a two-dimensional (2D) input image and a generic 3D face model, obtain a depth image and a texture image using the generated personalized 3D face model, determine a patch region of each of the depth image and the texture image, and adjust a shape of the personalized 3D face model based on a matching relationship between the patch region of the depth image and the patch region of the texture image.
Claims18
A three-dimensional (3D) face modeling method, comprising:
- generating a personalized 3D face model using a two-dimensional (2D) input image and a generic 3D face model;
- obtaining a depth image and a texture image using the personalized 3D face model;
- determining a patch region of the depth image and a patch region of the texture image;
- and
- adjusting a shape of the personalized 3D face model based on a relationship between the patch region of the depth image and the patch region of the texture image,
- wherein the obtaining includes,
- obtaining the depth image by projecting, onto a 2D plane, a depth value of the personalized 3D face model, and
- obtaining the texture image by projecting, onto a 2D plane, a 3D texture face model generated by mapping a texture of the 2D input image to the personalized 3D face model,
- wherein the adjusting includes,
- determining a projection location at which a current vertex of the personalized 3D face model is projected to the patch region of the depth image;
- determining a point in the patch region of the texture image corresponding to the projection location,
- determining 3D coordinates of the point based on a depth corresponding to the projection location and a normal direction corresponding to the patch region of the texture image, and
- adjusting the shape of the personalized 3D face model based on the determined 3D coordinates of the point.
A three-dimensional (3D) face modeling apparatus, comprising:
- at least one memory configured to store instructions;
- and
- at least one processor configured to execute the instructions to cause the apparatus to,
- generate a personalized 3D face model using a two-dimensional (2D) input image and a generic 3D face model;
- obtain a depth image and a texture image using the generated personalized 3D face model;
- determine a patch region of the depth image and a patch region of the texture image;
- and
- adjust a shape of the personalized 3D face model based on a matching relationship between the patch region of the depth image and the patch region of the texture image,
- wherein the processor is configured to execute the instructions to cause the apparatus to,
- obtain the depth image by projecting, onto a 2D plane, a depth value of the personalized 3D face model, and
- obtain the texture image by projecting, onto a 2D plane, a 3D texture face model generated by mapping a texture of the 2D input image to the personalized 3D face model,
- determine a projection location at which a current vertex of the personalized 3D face model is projected to the patch region of the depth image;
- determine a point in the patch region of the texture image corresponding to the projection location,
- determine 3D coordinates of the point based on a depth corresponding to the projection location and a normal direction corresponding to the patch region of the texture image, and
- adjust the shape of the personalized 3D face model based on the determined 3D coordinates of the point.
Dependencies are inferred from the claim text.