Method, apparatus and device for automatically making up portrait lips, storage medium and program product

A computing device, comprising:

• a processor, a memory, a communication interface, and a communication bus;
• wherein the processor, the memory, and the communication interface communicate with each other through the communication bus;
• the memory is configured to store an executable instruction that causes the processor to perform:
• extracting lip key points from a portrait facial image and detecting a portrait facial orientation and a lip shape in the portrait facial image;
• adjusting positions of the lip key points based on the portrait facial orientation and the lip shape;
• detecting a skin hue and a skin color number of a facial area in the portrait facial image;
• and selecting a target lipstick color from a lipstick color sample library based on the skin hue and the skin color number;
• and,
• performing fusion coloring by using the target lipstick color according to the positions of the lip key points;
• wherein when adjusting positions of the lip key points based on the portrait facial orientation and the lip shape, the processor is configured to perform:
• for side lip corner key points in the lip key points, when the portrait facial orientation is front-facing and the lip shape is closed, finding two darkest pixel points in a front-facing adjustment area, and taking a middle position between the two pixel points as an adjusted position of the side lip corner key points;
• wherein the front-facing adjustment area is an area formed by extending a first preset number of pixel points around positions of the side lip corner key points;
• when the portrait facial orientation is front-facing and the lip shape is open, performing edge detection on the front-facing adjustment area, and determining a first reference point according to a first edge detection result;
• by taking the first reference point as a center, finding a first skin color boundary point and a first lip color boundary point in a skin color area and a lip color area;
• and taking a middle position between the first skin color boundary point and the first lip color boundary point as an adjusted position of the side lip corner key points;
• when the portrait facial orientation is left-leaning or right-leaning and the lip shape is closed, finding a darkest pixel point in a side-leaning adjustment area and adjusting positions of the side lip corner key points according to a relative position of the darkest pixel in the side-leaning adjustment area;
• wherein the side-leaning adjustment area is an area formed by extending a second preset number of pixel points in left-right directions and a third preset number of pixel points in up-down directions from the positions of the side lip corner key points;
• when the portrait facial orientation is left-leaning or right-leaning and the lip shape is open, finding a darkest pixel point in the side-leaning adjustment area, performing edge detection on the side-leaning adjustment area, and determining a second reference point according to a second edge detection result;
• by taking the second reference point as a center, finding a second skin color boundary point and a second lip color boundary point in a skin color area and a lip color area, and adjusting positions of the side lip corner key points according to a relative position of the darkest pixel point in the side-leaning adjustment area, the second skin color boundary point and the second lip color boundary point.

A non-transitory computer storage medium, comprising:

• an executable instruction stored thereon;
• wherein the executable instruction, when executed by a processor, causes the processor to perform:
• extracting lip key points from a portrait facial image and detecting a portrait facial orientation and a lip shape in the portrait facial image;
• adjusting positions of the lip key points based on the portrait facial orientation and the lip shape;
• detecting a skin hue and a skin color number of a facial area in the portrait facial image;
• and selecting a target lipstick color from a lipstick color sample library based on the skin hue and the skin color number;
• and,
• performing fusion coloring by using the target lipstick color according to the positions of the lip key points;
• wherein when adjusting positions of the lip key points based on the portrait facial orientation and the lip shape, the executable instruction, when executed by the processor, causes the processor to perform:
• for side lip corner key points in the lip key points, when the portrait facial orientation is front-facing and the lip shape is closed, finding two darkest pixel points in a front-facing adjustment area, and taking a middle position between the two pixel points as an adjusted position of the side lip corner key points;
• wherein the front-facing adjustment area is an area formed by extending a first preset number of pixel points around positions of the side lip corner key points;
• when the portrait facial orientation is front-facing and the lip shape is open, performing edge detection on the front-facing adjustment area, and determining a first reference point according to a first edge detection result;
• by taking the first reference point as a center, finding a first skin color boundary point and a first lip color boundary point in a skin color area and a lip color area;
• and taking a middle position between the first skin color boundary point and the first lip color boundary point as an adjusted position of the side lip corner key points;
• when the portrait facial orientation is left-leaning or right-leaning and the lip shape is closed, finding a darkest pixel point in a side-leaning adjustment area and adjusting positions of the side lip corner key points according to a relative position of the darkest pixel in the side-leaning adjustment area;
• wherein the side-leaning adjustment area is an area formed by extending a second preset number of pixel points in left-right directions and a third preset number of pixel points in up-down directions from the positions of the side lip corner key points;
• when the portrait facial orientation is left-leaning or right-leaning and the lip shape is open, finding a darkest pixel point in the side-leaning adjustment area, performing edge detection on the side-leaning adjustment area, and determining a second reference point according to a second edge detection result;
• by taking the second reference point as a center, finding a second skin color boundary point and a second lip color boundary point in a skin color area and a lip color area, and adjusting positions of the side lip corner key points according to a relative position of the darkest pixel point in the side-leaning adjustment area, the second skin color boundary point and the second lip color boundary point.