Makeup simulation device, method, and non-transitory recording medium

A makeup simulation method for superimposing an eye makeup part onto a face image obtained by photographing a face of a subject and causing the face image to be displayed on a display device, the makeup simulation method comprising:

• acquiring a first face image and a second face image that are different from each other in appearance of the face due to movement of a specific face part and generating a deformed makeup part by deforming an eye makeup part drawn on the specific face part in the first face image with left and right electronic mascara brushes by a makeup execution person in accordance with movement of the specific face part;
• superimposing the makeup part and the deformed makeup part onto face images including the second face image of the subject, respectively;
• storing in a memory the left and right electronic mascara brushes for drawing a mascara line on the upper lid of left and right open eye images, respectively;
• displaying on the display device a makeup part drawing screen displaying the first face image and the second face image,
• displaying on the display device a makeup item selection region displaying the stored left and right electronic mascara brushes,
• in a case where the first face image is a face image showing closed eyes comprising an eye-closed image, and where the second face image is a face image showing opened eyes comprising an eye-opened image, the makeup part deforming operation deforms the eye makeup part for an upper eyelid drawn on a face part of the closed eyes by a makeup execution person to an eye makeup part for a face part of the opened eyes by stretching a lower chord part of the eye makeup part for the upper eyelid upward, and by removing, from the eye makeup part, a part of the eye makeup part that overlaps a region of the opened eyes in a case where the eye makeup part is superimposed on the face image showing the opened eyes as it is;
• and
• switching a displayed face image between a face image on which the makeup part is superimposed and a face image on which the deformed makeup part is superimposed,
• in a case where the first face image is an eye-opened image and the second face image is an eye-closed image,
• the left electronic mascara brush is used by the makeup execution person to draw a mascara line on a left eye-opened image and the right electronic mascara brush is used by the makeup execution person to draw a mascara line on a right-opened image, and
• the makeup part deforming unit deforms the mascara line drawn on the left eye-opened image and applies the deformed mascara line to the left eye-closed image, and deforms the mascara line drawn on the right eye-opened image and applies the deformed mascara line to the right eye-closed image using
• eye inner corner points of the left and right eye images, respectively,
• eye outer corner points of the left and right eye images, respectively, and
• a point located between an iris upper point and an iris lower point of the left and right eye images, respectively,
• so that the mascara line lies down along a face surface of the left and right eye-closed images, to mimic the typical behavior of eyelashes in an eye-closed state, and
• wherein the makeup part deforming operation adjusts the scale of the eye-closed image to match the scale of the eye-opened image.

A non-transitory computer-readable recording medium storing a makeup simulation program for superimposing a makeup part onto a face image obtained by photographing a face of a subject and causing the face image to be displayed on a display device, the makeup simulation program causing a computer to execute processing comprising:

• acquiring a first face image and a second face image that are different from each other in appearance of the face due to movement of a specific face part and generating a deformed makeup part by deforming an eye makeup part drawn on the specific face part in the first face image with left and right electronic mascara brushes by a makeup execution person in accordance with movement of the specific face part;
• superimposing the makeup part and the deformed makeup part onto face images including the second face image of the subject, respectively;
• storing in a memory the left and right electronic mascara brushes for drawing a mascara line on the upper lid of left and right open eye images, respectively;
• displaying on the display device a makeup part drawing screen displaying the first face image and the second face image;
• displaying on the display device a makeup item selection region displaying the stored left and right electronic mascara brushes;
• in a case where the first face image is a face image showing closed eyes comprising an eye-closed image, and where the second face image is a face image showing opened eyes comprising an eye-opened image, the makeup part deforming operation deforms the eye makeup part for an upper eyelid drawn on a face part of the closed eyes by a makeup execution person to an eye makeup part for a face part of the opened eyes by stretching a lower chord part of the eye makeup part for the upper eyelid upward, and by removing, from the eye makeup part, a part of the eye makeup part that overlaps a region of the opened eyes in a case where the eye makeup part is superimposed on the face image showing the opened eyes as it is;
• and
• switching a displayed face image between a face image on which the makeup part is superimposed and a face image on which the deformed makeup part is superimposed,
• in a case where the first face image is an eye-opened image and the second face image is an eye-closed image,
• the left electronic mascara brush is used by the makeup execution person to draw a mascara line on a left eye-opened image and the right electronic mascara brush is used by the makeup execution person to draw a mascara line on a right-opened image, and
• the makeup part deforming unit deforms the mascara line drawn on the left eye-opened image and applies the deformed mascara line to the left eye-closed image, and deforms the mascara line drawn on the right eye-opened image and applies the deformed mascara line to the right eye-closed image using
• eye inner corner points of the left and right eye images, respectively,
• eye outer corner points of the left and right eye images, respectively, and
• a point located between an iris upper point and an iris lower point of the left and right eye images, respectively,
• so that the mascara line lies down along a face surface of the left and right eye-closed images, to mimic the typical behavior of eyelashes in an eye-closed state, and
• wherein the makeup part deforming operation adjusts the scale of the eye-closed image to match the scale of the eye-opened image.