# US 10,479,109 B2 · Automatic facial makeup method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,479,109 B2
- Document ID: US10479109B2
- Status: Granted
- Kind: B2
- Application number: 15/608,173
- Filed: 2017-05-30
- Published: 2017-12-07
- Granted: 2019-11-19
- Earliest claimed: 2016-06-02
- Assignees: Zong Jing Investment, Inc.
- Applicants: Zong Jing Investment, Inc.
- Inventors: Charlene Hsueh-Ling Wong; Yi-Hsueh Yang
- Web page: https://patentgrep.com/patent/US10479109B2

## CPC

- B41J 3/4073: {Printing on three-dimensional objects not being in sheet or web form, e.g. spherical or cubic objects (B41J3/283, B41J3/286 take precedence; building up a 3D object using individual droplets from jetting heads B29C64/112)}
- A45D 33/02: with dispensing means, e.g. sprinkling means
- A45D 34/04: Appliances specially adapted for applying liquid, e.g. using roller or ball
- A45D 44/005: {for selecting or displaying personal cosmetic colours or hairstyle}
- G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships}
- B41J: TYPEWRITERS; SELECTIVE PRINTING MECHANISMS, i.e. MECHANISMS PRINTING OTHERWISE THAN FROM A FORME; CORRECTION OF TYPOGRAPHICAL ERRORS
- A45D: HAIRDRESSING OR SHAVING EQUIPMENT (wigs, toupees or the like A41G3/00, A41G5/00; hairdressers' chairs A47C1/04; hair cutting appliances, razors B26B); EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An automatic facial makeup method includes receiving a makeup template, wherein the makeup template comprises a plurality of defined areas and a plurality of makeup instructions relating to application of at least one makeup to the plurality of defined areas, and wherein each of the plurality of defined areas is defined by a plurality of first feature points. A facial image comprising a facial block is received, wherein the facial block corresponds to a facial region depicted in the facial image. Makeup areas in the facial block are defined by mapping, for each of the plurality of defined areas, first feature points to second feature points in the facial block, wherein each second feature point has a same relative position on the facial block as a corresponding first feature point. A makeup component performs a makeup operation according to each makeup instruction on the makeup area corresponding to each makeup instruction.

## Claims

### Claim 1

An automatic facial makeup method, comprising:
receiving a makeup template, wherein the makeup template comprises a plurality of defined areas and a plurality of makeup instructions relating to application of at least one makeup to the plurality of defined areas, and wherein each of the plurality of defined areas is defined by a plurality of first feature points, wherein each makeup instruction comprises aperture data for adjusting an aperture of a nozzle of a makeup component;
receiving a facial image of a user comprising a facial block having a plurality of second feature points;
defining makeup areas on a face of the user corresponding to regions in the facial block by mapping, for each of the plurality of defined areas, first feature points to second feature points in the facial block, wherein each second feature point has a same relative position on the facial block as a corresponding first feature point;
controlling, by a control unit, the makeup component to adjust the aperture of the nozzle of the makeup component according to the aperture data; and
performing, by the makeup component, a makeup operation according to each makeup instruction on the makeup area corresponding to each makeup instruction and according to the adjusted aperture of the nozzle,
wherein the makeup template further comprises a facial image, wherein the plurality of defined areas are located on the facial image and comprise two eye shadow defined areas, wherein each eye shadow defined area is divided into two or more defined sub-areas.

### Claim 2 (depends on 1)

The automatic facial makeup method according to claim 1, wherein each makeup area comprises polygonal coordinate data defined by the second feature points.

### Claim 3

An automatic facial makeup method, comprising:
receiving a makeup template, wherein the makeup template comprises a plurality of defined areas and a plurality of makeup instructions relating to application of at least one makeup to the plurality of defined areas, and wherein each of the plurality of defined areas is defined by a plurality of first feature points, wherein each makeup instruction comprises aperture data for adjusting an aperture of a nozzle of a makeup component;
receiving a facial image of a user comprising a facial block having a plurality of second feature points;
defining makeup areas on a face of the user corresponding to regions in the facial block by mapping, for each of the plurality of defined areas, first feature points to second feature points in the facial block, wherein each second feature point has a same relative position on the facial block as a corresponding first feature point, wherein each makeup area comprises polygonal coordinate data defined by the second feature points;
controlling, by a control unit, the makeup component to adjust the aperture of the nozzle of the makeup component according to the aperture data; and
performing, by the makeup component, a makeup operation according to each makeup instruction on the makeup area corresponding to each makeup instruction and according to the adjusted aperture of the nozzle, wherein performing the makeup operation further comprises: receiving a start signal; and before the step of applying a makeup preparation, moving the nozzle of the makeup component to an initial location in response to the start signal, wherein each of the plurality of makeup areas comprises a foundation makeup area.

### Claim 4 (depends on 3)

The automatic facial makeup method according to claim 3, wherein the foundation makeup area comprises a left cheek makeup area, a jaw makeup area, a right cheek makeup area, a forehead makeup area, and a nose makeup area, wherein the left cheek makeup area is defined with reference to a plurality of second feature points below a left eye, a second feature point of a left nose wing, and a second feature point of a left mouth corner in the plurality of second feature points, wherein the jaw makeup area is defined with reference to a plurality of second feature points of a lower lip line, the second feature point of the left mouth corner, and a second feature point of a right mouth corner in the plurality of second feature points, wherein the right cheek makeup area is defined with reference to a plurality of second feature points below a right eye, a second feature point of a right nose wing, and the second feature point of the right mouth corner in the plurality of second feature points, wherein the forehead makeup area is defined with reference to a plurality of second feature points above a left eyebrow and a plurality of second feature points above a right eyebrow in the plurality of second feature points, and wherein the nose makeup area is defined with reference to a second feature point of an inner left eyebrow corner, a second feature point of an inner right eyebrow corner, a second feature point of an inner left canthus, and a second feature point of an inner right canthus in the plurality of second feature points.

### Claim 5 (depends on 4)

The automatic facial makeup method according to claim 4, wherein the makeup instruction comprises a foundation spraying path, wherein the foundation spraying path is utilized for moving left and right in a staggered manner and moving evenly up and down at intervals in the left cheek makeup area, the right cheek makeup area, and the nose makeup area, and wherein the found spraying path is utilized for moving up and down in a staggered manner and moving evenly left and right at intervals in the jaw makeup area and the forehead makeup area.

### Claim 6 (depends on 5)

The automatic facial makeup method according to claim 5, wherein the foundation spraying path is a single path utilized for sequentially passing the left cheek makeup area, the jaw makeup area, the right cheek makeup area, the forehead makeup area, and the nose makeup area.

### Claim 7 (depends on 3)

The automatic facial makeup method according to claim 3, wherein each of the plurality of makeup areas further comprises a blush area, wherein the makeup instruction further comprises a blush spraying path, and the blush spraying path locates two central point locations according to the second feature point of the left nose wing, the second feature point of the right nose wing, and two second feature points of two eye pupils in the plurality of second feature points and is constructed by each the central point location inside out in a spiral manner.

### Claim 8 (depends on 3)

The automatic facial makeup method according to claim 3, wherein each of the plurality of makeup areas further comprises a blush area, wherein the makeup instruction further comprises a blush spraying path, wherein on the blush spraying path, a nose bridge middle line is further established from a middle point between the second feature point of the left nose wing and the second feature point of the right nose wing to a plurality of second feature points of a nose root in the plurality of second feature points, a horizontal reference line is constructed by using a nose tip as a starting point, and two central point locations, a horizontal displacement distance, and a size of blush-applying region are defined according to the nose bridge middle line, the horizontal reference line, and a width between the two second feature points of the two eye pupils.

### Claim 9 (depends on 1)

The automatic facial makeup method according to claim 1, wherein the plurality of defined areas comprise a foundation defined area, and the foundation defined area is located on a full-face skin area of the facial image.

### Claim 10 (depends on 9)

The automatic facial makeup method according to claim 9, wherein the plurality of defined areas further comprise at least one blush defined area, and each blush defined area is separately located on a left check area or a right cheek area of the facial image.

### Claim 11 (depends on 9)

The automatic facial makeup method according to claim 9, wherein the plurality of defined areas further comprise at least one first eye shadow defined area, and each first eye shadow defined area is separately located on a left eyelid area or a right eyelid area of the facial outline.

### Claim 12 (depends on 11)

The automatic facial makeup method according to claim 11, wherein the plurality of defined areas further comprise at least one second eye shadow defined area, and each second eye shadow defined area is separately located on the left eyelid area or the right eyelid area of the facial image.

### Claim 13 (depends on 12)

The automatic facial makeup method according to claim 12, wherein the first eye shadow defined area and the second eye shadow defined area on the left eyelid area completely or partially overlap.

### Claim 14 (depends on 13)

The automatic facial makeup method according to claim 13, wherein the first eye shadow defined area and the second eye shadow defined area on the right eyelid area completely or partially overlap.

### Claim 15 (depends on 9)

The automatic facial makeup method according to claim 9, wherein the two eye shadow defined areas are established with reference to a plurality of first feature points of two eye edges in the plurality of first feature points.

### Claim 16 (depends on 1)

The automatic facial makeup method according to claim 1,
wherein a first defined sub-area is two thirds of the area, located close to a first feature point of an inner canthus, of an area encircled by the plurality of first feature points of the eye edges after the area is vertically equally divided into three parts,
wherein a second defined sub-area is one third of the area, located close to a first feature point of an outer canthus, of the area encircled by the plurality of first feature points of the eye edges after the area is vertically equally divided into three parts, and
wherein a third defined sub-area is an area within the area encircled by the plurality of first feature points of the eye edges and between an edge composed of the plurality of first feature points of the eye edges and an edge gradually extending from the first feature point of the inner canthus to a first feature point of an upper eye edge close to the first feature point of the outer canthus along the edge composed of the plurality of first feature points of the eye edges.

### Claim 17 (depends on 1)

The automatic facial makeup method according to claim 1, wherein the photographing apparatus is a 3D photographing apparatus, and the facial image is a 3D image.

### Claim 18 (depends on 17)

The automatic facial makeup method according to claim 17, wherein the makeup template is another 3D image.

### Claim 19 (depends on 1)

The automatic facial makeup method according to claim 1, wherein the facial image is from one of a photographing apparatus, a cloud storage unit, a memory storage unit, or an electronic apparatus.