Eyeglass reflection synthesis for reflection removal

A computer-implemented method comprising:

• obtaining a plurality of face images having eyeglasses without reflections;
• obtaining a plurality of reflection images;
• generating a plurality of composite images from the face images and the reflection images, each composite image having a reflection image from the plurality of reflection images composited in a reflection area of eyeglasses in a face image from the plurality of face images;
• and
• training a machine learning model using the face images and the composite face images to provide a trained machine learning model that removes reflections from eyeglasses in input images.

A computer system comprising:

• one or more processors;
• and
• one or more computer storage media storing computer-useable instructions that, when used by the one or more processors, causes the one or more processors to perform operations comprising:
• generating a training dataset having paired image data, the paired image data including a first image pair comprising a first face image and a first composite image, the first image pair generated by:
• generating, using a generator model, the first face image, the first face image having eyeglasses without a reflection,
• obtaining a first reflection image,
• determining a reflection area in the eyeglasses of the first face image, and
• compositing the first reflection image in the reflection area of the first face image to generate the first composite image;
• and
• training a machine learning model using the paired image data to provide a trained machine learning model that performs eyeglass reflection removal on input face images.