Object relighting using neural networks

A system comprising:

• one or more computer processors;
• and
• one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the system to perform operations comprising:
• receiving an input image with first lighting properties comprising an object with second lighting properties;
• processing the input image using a convolutional neural network to generate an output image with the first lighting properties and comprising the object with third lighting properties, wherein the convolutional neural network is trained to modify the second lighting properties to be consistent with lighting conditions indicated by the first lighting properties to generate the third lighting properties;
• modifying the second lighting properties of the object to lighten areas that are above a first threshold of brightness and darken areas that are below a second threshold of brightness to generate the object with modified second lighting properties;
• blending the third lighting properties with the modified second lighting properties to generate a modified output image comprising the object with fourth lighting properties;
• and
• causing the modified output image to be stored.

A non-transitory computer-readable storage medium including instructions that, when processed by a computer, configure the computer to perform operations comprising:

• receiving an input image with first lighting properties comprising an object with second lighting properties;
• processing the input image using a convolutional neural network to generate an output image with the first lighting properties and comprising the object with third lighting properties, wherein the convolutional neural network is trained to modify the second lighting properties to be consistent with lighting conditions indicated by the first lighting properties to generate the third lighting properties;
• modifying the second lighting properties of the object to lighten areas that are above a first threshold of brightness and darken areas that are below a second threshold of brightness to generate the object with modified second lighting properties;
• blending the third lighting properties with the modified second lighting properties to generate a modified output image comprising the object with fourth lighting properties;
• and
• causing the modified output image to be stored.