Deep-learning-based automatic skin retouching

A computerized method for automatically retouching an input image, the method comprising:

• automatically generating a skin quality map from a skin mask of an input image, wherein the skin mask identifies regions of skin in the input image, and wherein the skin quality map is a probability map comprising a probability for each analyzed region that the analyzed region needs retouching;
• separating the skin mask into a high frequency layer and a low frequency layer;
• providing the skin quality map as an input into a first neural network configured to perform texture synthesis on the high frequency layer to generate a retouched high frequency layer;
• applying a color transformation to the low frequency layer to generate a retouched low frequency layer, wherein parameters of the color transformation are generated using a second neural network and upsampled using the image quality map;
• and
• combining the retouched high frequency layer and the retouched low frequency layer.

A computer system comprising:

• one or more hardware processors and memory configured to provide computer program instructions to the one or more hardware processors;
• a skin quality detection network configured to generate a skin quality map from a skin mask of an input image, wherein the skin mask identifies regions of skin in the input image, and wherein the skin quality map is a probability map comprising a probability for each analyzed region that the analyzed region needs retouching;
• a frequency separator configured to separate the skin mask into a high frequency layer and a low frequency layer;
• a means for performing texture synthesis on the high frequency layer by providing the skin quality map as an input into a first neural network configured to generate a retouched high frequency layer;
• a means for applying a color transformation to the low frequency layer to generate a retouched low frequency layer using parameters of the color transformation generated using a second neural network and upsampled using the skin quality map;
• and
• a combiner configured to reconstitute the retouched high frequency layer and the retouched low frequency layer.