Coupled reconstruction of hair and skin

A non-transitory computer-readable medium containing a program which, when executed, performs an operation to model facial hair and skin, the operation comprising:

• receiving a plurality of multiscopic images depicting at least part of a face of a subject having facial hair;
• analyzing the plurality of multiscopic images in order to determine correspondences between the plurality of multiscopic images and further determine one or more facial hairs depicted in the plurality of multiscopic images;
• generating a disparity map based on the correspondences, the disparity map containing one or more disparity values adjusted in directions of improved photometric-consistency and improved surface-consistency, respectively;
• generating a geometry mesh of the subject, based on the disparity map;
• generating one or more 3D facial hair segments representing the determined one or more facial hairs;
• generating a 3D model of facial skin underlying the one or more facial hairs, based on the generated one or more 3D facial hair segments and by operation of one or more computer processors when executing the program;
• and
• generating a 3D model of the subject, based on the geometry mesh, the one or more 3D facial hair segments, and the 3D model of facial skin.

A system to model facial hair and skin, the system comprising:

• one or more computer processors;
• a memory containing a program which, when executed by the one or more computer processors, performs an operation comprising:
• receiving a plurality of multiscopic images depicting at least part of a face of a subject having facial hair;
• analyzing the plurality of multiscopic images in order to determine correspondences between the plurality of multiscopic images and further determine one or more hairs depicted in the plurality of multiscopic images;
• generating a disparity map based on the correspondences, the disparity map containing one or more disparity values adjusted in a directions of improved photometric-consistency and improved surface-consistency, respectively;
• generating a geometry mesh of the subject, based on the disparity map;
• generating one or more 3D hair segments representing the determined one or more hairs;
• generating a 3D model of skin underlying the one or more hairs, based on the generated one or more 3D hair segments;
• and
• generating a 3D model of the subject, based on the geometry mesh, the one or more 3D facial hair segments, and the 3D model of facial skin.

A computer-implemented method to model filament and surface, the computer-implemented method comprising:

• receiving a plurality of multiscopic images depicting at least part of a target having at least one filament;
• analyzing the plurality of multiscopic images in order to determine correspondences between the plurality of multiscopic images and further determine one or more filaments depicted in the plurality of multiscopic images;
• generating a disparity map based on the correspondences, the disparity map containing one or more disparity values adjusted in directions of improved photometric-consistency and improved surface-consistency, respectively;
• generating a geometry mesh of the target, based on the disparity map;
• generating, based on the determined one or more filaments, one or more 2D filament segments representing the one or more filaments;
• generating, based on the one or more 2D filament segments, one or more 3D filament segments representing the determined one or more filaments;
• generating a 3D model of surface underlying the one or more filaments, based on the generated one or more 3D filament segments and by operation of one or more computer processors;
• and
• generating a 3D model of the target, based on the geometry mesh, the one or more 3D filament segments, and the 3D model of surface underlying the one or more filaments.