Appearance synthesis of digital faces
AssigneesDisney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
InventorsPrashanth CHANDRAN, Dominik Thabo BEELER, Derek Edward BRADLEY
Life of this patent
Estimating the term…
Loading patent…
AssigneesDisney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
InventorsPrashanth CHANDRAN, Dominik Thabo BEELER, Derek Edward BRADLEY
Estimating the term…
Techniques are disclosed for generating digital faces. In some examples, a style-based generator receives as inputs initial tensor(s) and style vector(s) corresponding to user-selected semantic attribute styles, such as the desired expression, gender, age, identity, and/or ethnicity of a digital face. The style-based generator is trained to process such inputs and output low-resolution appearance map(s) for the digital face, such as a texture map, a normal map, and/or a specular roughness map. The low-resolution appearance map(s) are further processed using a super-resolution generator that is trained to take the low-resolution appearance map(s) and low-resolution 3D geometry of the digital face as inputs and output high-resolution appearance map(s) that align with high-resolution 3D geometry of the digital face. Such high-resolution appearance map(s) and high-resolution 3D geometry can then be used to render standalone images or the frames of a video that include the digital face.
A computer-implemented method for rendering one or more images of a digital face, the method comprising:
A non-transitory computer-readable storage medium including instructions that, when executed by a processing unit, cause the processing unit to perform steps for rendering one or more images of a digital face, the steps comprising:
A computing device comprising:
Dependencies are inferred from the claim text.