# US 2019/0035149 A1 · Methods of generating personalized 3d head models or 3d body models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0035149 A1
- Document ID: US20190035149A1
- Status: Published application
- Kind: A1
- Application number: 15/752,709
- Filed: 2016-08-15
- Published: 2019-01-31
- Earliest claimed: 2015-08-14
- Assignees: Metail Limited
- Applicants: Metail Limited
- Inventors: Yu CHEN; Dongjoe SHIN; Joe TOWNSEND; Jim DOWNING; Duncan ROBERTSON; Tom ADEYOOLA
- Web page: https://patentgrep.com/patent/US20190035149A1

## CPC

- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06T 7/50: Depth or shape recovery
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 15/04: Texture mapping
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06V 40/165: {using facial parts and geometric relationships}
- G06V 40/166: {using acquisition arrangements}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 2200/08: involving all processing steps from image acquisition to 3D model generation
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30201: Face
- G06T 2215/16: Using real world measurements to influence rendering
- G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes
- G06T 2219/2021: Shape modification
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

There is provided a method of generating an image file of a personalized 3D head model of a user, the method comprising the steps of: (i) acquiring at least one 2D image of the user's face; (ii) performing automated face 2D landmark recognition based on the at least one 2D image of the user's face; (iii) providing a 3D face geometry reconstruction using a shape prior; (iv) providing texture map generation and interpolation with respect to the 3D face geometry reconstruction to generate a personalized 3D head model of the user, and (v) generating an image file of the personalized 3D head model of the user. A related system and computer program product are also provided.

## Claims

### Claim 1

A method of generating an image file of a personalized 3D head model of a user, the method comprising the steps of:
(i) acquiring at least one 2D image of the user's face;
(ii) performing automated face 2D landmark recognition based on the at least one 2D image of the user's face;
(iii) providing a 3D face geometry reconstruction using a shape prior;
(iv) providing texture map generation and interpolation with respect to the 3D face geometry reconstruction to generate a personalized 3D head model of the user, and
(v) generating an image file of the personalized 3D head model of the user.

### Claim 2 (depends on 1)

The method of claim 1, wherein the at least one 2D image of the user's face is acquired via a network communication.

### Claim 3 (depends on 2)

The method of claim 2, wherein the at least one 2D image of the user's face is acquired via the network communication, from a smartphone including a camera.

### Claim 4 (depends on 1)

The method of claim 1, wherein the at least one 2D image of the user's face is a front image of the user's face.

### Claim 5 (depends on 1)

The method of claim 1, wherein the at least one 2D image of the user's face is a smartphone camera image of the user's face.

### Claim 6 (depends on 1)

The method of claim 1, wherein the automated face 2D landmark recognition includes using a 2D face landmark detector.

### Claim at position 7

7-17. (canceled)

### Claim 18 (depends on 1)

The method of claim 1, in which the image file is a 3D image file.

### Claim 19 (depends on 1)

The method of claim 1, in which the image file is a 2D image file.

### Claim 20 (depends on 1)

The method of claim 1, in which the image file is an animation file.

### Claim 21 (depends on 1)

The method of claim 1, in which the image file is a personalised sticker set.

### Claim at position 12

22-43. (canceled)

### Claim 44 (depends on 1)

The method of claim 1, in which head size is estimated from body shape parameters.

### Claim 45 (depends on 1)

The method of claim 1, in which an automatic image analysis is performed to help users quickly acquire input data of good quality so that they have a better chance of creating a photo-realistic personalised avatar.

### Claim 46 (depends on 45)

The of claim 45, in which prior to starting the video or image capture, the user is presented with a live view of the camera feed, and a feedback mechanism analyses the live view and, if necessary, provides the user with recommendations on how to improve the conditions in order to achieve a high quality end result.

### Claim 47

A system configured to perform a method of generating an image file of a personalized 3D head model of a user, the method comprising the steps of:
(i) acquiring at least one 2D image of the user's face
(ii) performing automated face 2D landmark recognition based on the at least one 2D image of the user's face;
(iii) providing a 3D face geometry reconstruction using a shape prior
(iv) providing texture map generation and interpolation with respect to the 3D face geometry reconstruction to generate a personalized 3D head model of the user, and
(v) generating an image file of the personalized 3D head model of the user.

### Claim 48

A computer program product executable on a processor to generate an image file of a personalized 3D head model of a user, the computer program product executable on the processor to:
(i) receive at least one 2D image of the user's face;
(ii) perform an automated face 2D landmark recognition based on the at least one 2D image of the user's face;
(iii) provide a 3D face geometry reconstruction using a shape prior;
(iv) provide texture map generation and interpolation with respect to the 3D face geometry reconstruction to generate a personalized 3D head model of the user, and
(v) generate an image file of the personalized 3D head model of the user.

### Claim 49 (depends on 48)

The computer program product of claim 48, executable on the processor to perform a method of generating an image file of a personalized 3D head model of a user, the method comprising the steps of:
(i) acquiring at least one 2D image of the user's face;
(ii) performing automated face 2D landmark recognition based on the at least one 2D image of the user's face;
(iii) providing a 3D face geometry reconstruction using a shape prior;
(iv) providing texture map generation and interpolation with respect to the 3D face geometry reconstruction to generate a personalized 3D head model of the user, and
(v) generating an image file of the personalized 3D head model of the user.

### Claim at position 19

50-83. (canceled)
