Automatic removal of lighting effects from an image
AssigneeAdobe Inc.
InventorsHe Zhang, Shi Yan, Jianming Zhang
Life of this patent
Estimating the term…
Abstract
In accordance with the described techniques, an image delighting system receives an input image depicting a human subject that includes lighting effects. The image delighting system further generates a segmentation mask and a skin tone mask. The segmentation mask includes multiple segments each representing a different portion of the human subject, and the skin tone mask identifies one or more color values for a skin region of the human subject. Using a machine learning lighting removal network, the image delighting system generates an unlit image by removing the lighting effects from the input image based on the segmentation mask and the skin tone mask.
Claims20
A method, comprising:
- receiving, by a processing device, an input image depicting a human subject that includes lighting effects;
- generating, by the processing device, a segmentation mask that includes multiple segments each representing a different portion of the human subject depicted in the input image;
- generating, by the processing device, a skin tone mask identifying one or more color values for a skin region of the human subject depicted in the input image;
- and
- generating, by the processing device and using a machine learning lighting removal network, an unlit image by removing the lighting effects from the input image based on the segmentation mask and the skin tone mask.
A system, comprising:
- a processing device;
- and
- a computer-readable storage media storing instructions that, responsive to execution by the processing device, cause the processing device to perform operations including:
- receiving user input specifying a skin tone color value for a human subject depicted in an input image that includes shadows and highlights;
- generating a skin tone mask having a skin region of the human subject filled with the skin tone color value;
- generating, using a machine learning lighting removal network, a first unlit image by removing the shadows and the highlights from the input image based on the skin tone mask;
- and
- generating a second unlit image by shifting color values in the skin region of the first unlit image to be closer to the skin tone color value.
A non-transitory computer-readable medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:
- receiving an input image that includes lighting effects;
- generating, using a machine learning lighting removal network, an unlit image by removing the lighting effects from the input image;
- generating a lighting representation that represents the lighting effects removed from the input image;
- receiving user input editing the lighting representation;
- and
- updating the unlit image based on the edited lighting representation, the updated unlit image having the lighting effects represented by the edited lighting representation removed from the input image.
Dependencies are inferred from the claim text.