# US 2014/0192045 A1 · Method and apparatus for generating three-dimensional caricature using shape and texture of face > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0192045 A1 - Document ID: US20140192045A1 - Status: Published application - Kind: A1 - Application number: 14/147,773 - Filed: 2014-01-06 - Published: 2014-07-10 - Earliest claimed: 2013-01-08 - Assignees: Electronics and Telecommunications Research Institute - Applicants: Electronics and Telecommunications Research Institute - Inventors: Bon Woo HWANG; Kap Kee KIM; Seong Jae LIM; Seung Uk YOON; Hye Ryeong JUN; Bon Ki KOO; Jin Sung CHOI - Web page: https://patentgrep.com/patent/US20140192045A1 ## CPC - G06T 15/02: Non-photorealistic rendering - G06T 17/00: Three-dimensional [3D] modelling for computer graphics - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Provided is a method and apparatus for generating a three-dimensional (3D) caricature. The apparatus for generating a 3D caricature may include a 3D face data generation unit to generate 3D face data of a user corresponding to a shape and a texture of a face of the user, a 3D unique face model generation unit to generate a 3D unique face model using a shape and a texture of a unique face based on the 3D face data and a reference face, and a 3D caricature generation unit to generate a 3D caricature using the 3D unique face model and a caricature base face model. ## Claims ### Claim 1 An apparatus for generating a three-dimensional (3D) caricature, the apparatus comprising: a 3D face data generation unit to generate 3D face data of a user corresponding to a shape and a texture of a face of the user; a 3D unique face model generation unit to generate a 3D unique face model using a shape and a texture of a unique face based on the 3D face data and a reference face; and a 3D caricature generation unit to generate a 3D caricature using the 3D unique face model and a caricature base face model. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the 3D face data generation unit generates the shape of the face based on a 3D position of the face using phase shifts of the face in structured light being projected, and generates the texture of the face using an image of the face taken with diffused illumination without projecting the structured light. ### Claim 3 (depends on 1) The apparatus of claim 1, wherein the 3D face data generation unit generates the shape of the face based on the 3D position of the face, using a triangulation method, from a correspondence relationship between at least one face, and generates the texture of the face with respect to a particular face among the at least one face. ### Claim 4 (depends on 1) The apparatus of claim 1, wherein the reference face includes: shape information of the reference face including position information of 3D points representing shape information of facial elements, and edge information connecting the 3D points, and texture information of the reference face including image pixels representing the facial elements and a skin. ### Claim 5 (depends on 1) The apparatus of claim 1, wherein the 3D unique face model generation unit generates the shape of the unique face by deforming a shape of the reference face using a 3D registration technique based on a correspondence relationship between the shape of the face of the 3D face data and the shape of the reference face. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the 3D unique face model generation unit generates the texture of the unique face by deforming the texture of the 3D face data through warping based on a correspondence relationship between the texture of the face of the 3D face data and a texture of the reference face. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the caricature base face model includes a shape and a texture of a 3D caricature base face model corresponding to at least one 3D unique face model generated previously and a 3D caricature generated by an expert modeler. ### Claim 8 (depends on 1) The apparatus of claim 1, wherein the 3D caricature generation unit generates a shape of the 3D caricature by a linear superposition of a caricature sub-base of the shape depending on a shape weight vector calculated from the shape of the unique face and a caricature sub-base of the shape, when the 3D caricature generation unit calculates, using an optimization technique, the shape weight vector necessary for representing the shape of the unique face by a linear superposition of unique face sub-bases of a shape of the caricature base face model. ### Claim 9 (depends on 1) The apparatus of claim 1, wherein the 3D caricature generation unit generates a texture of the 3D caricature by a linear superposition of a caricature sub-base of the texture depending on a texture weight vector calculated from the texture of the unique face and a caricature sub-base of the texture, when the 3D caricature generation unit calculates, using an optimization technique, the texture weight vector necessary for representing the texture of the unique face by a linear superposition of unique face sub-bases of texture of the caricature base face model. ### Claim 10 (depends on 1) The apparatus of claim 1, further comprising: a 3D caricature providing unit to provide the generated 3D caricature through at least one of caricature storage, caricature reproduction, and storage output, based on a desired point in time by the user. ### Claim 11 A method of generating a three-dimensional (3D) caricature, the method comprising: generating 3D face data of a user corresponding to a shape and a texture of a face of the user; generating a 3D unique face model using a shape and a texture of a unique face based on the 3D face data and a reference face; and generating a 3D caricature using the 3D unique face model and a caricature base face model. ### Claim 12 (depends on 11) The method of claim 11, wherein the generating of the 3D face data comprises: generating the shape of the face based on a 3D position of the face using phase shifts of the face in structured light being projected; and generating the texture of the face using an image of the face taken with diffused illumination without projecting the structured light. ### Claim 13 (depends on 11) The method of claim 11, wherein the generating of the 3D face data comprises: generating the shape of the face based on the 3D position of the face, using a triangulation method, from a correspondence relationship between at least one face; and generating the texture of the face with respect to a particular face among the at least one face. ### Claim 14 (depends on 11) The method of claim 11, wherein the reference face includes: shape information of the reference face including position information of 3D points representing shape information of facial elements, and edge information connecting the 3D points, and texture information of the reference face including image pixels representing the facial elements and a skin ### Claim 15 (depends on 11) The method of claim 11, wherein the generating of the 3D unique face model comprises generating the shape of the unique face by deforming a shape of the reference face using a 3D registration technique based on a correspondence relationship between the shape of the face of the 3D face data and the shape of the reference face. ### Claim 16 (depends on 11) The method of claim 11, wherein the generating of the 3D unique face model comprises generating the texture of the unique face by deforming the texture of the 3D face data through warping based on a correspondence relationship between the texture of the face of the 3D face data and a texture of the reference face. ### Claim 17 (depends on 11) The method of claim 11, wherein the caricature base face model includes a shape and a texture of a 3D caricature base face model corresponding to at least one 3D unique face model generated previously and a 3D caricature generated by an expert modeler. ### Claim 18 (depends on 11) The method of claim 11, wherein the generating of the 3D caricature comprises generating a shape of the 3D caricature by a linear superposition of a caricature sub-base of the shape depending on a shape weight vector calculated from the shape of the unique face and a caricature sub-base of the shape, when the shape weight vector necessary for representing the shape of the unique face by a linear superposition of unique face sub-bases of a shape of the caricature base face model is calculated using an optimization technique. ### Claim 19 (depends on 11) The method of claim 11, wherein the generating of the 3D caricature comprises generating a texture of the 3D caricature by a linear superposition of a caricature sub-base of the texture depending on a texture weight vector calculated from the texture of the unique face and a caricature sub-base of the texture, when the texture weight vector necessary for representing the texture of the unique face by a linear superposition of unique face sub-bases of texture of the caricature base face model is calculated using an optimization technique. ### Claim 20 (depends on 11) The method of claim 11, further comprising: providing the generated 3D caricature through at least one of caricature storage, caricature reproduction, and storage output, based on a desired point in time by the user.