Digital image inpainting utilizing global and local modulation layers of an inpainting neural network

A system comprising:

• one or more memory devices;
• and
• one or more processors configured to cause the system to:
• extracting, from a digital image comprising a replacement region, an image feature vector utilizing an encoder of a cascaded modulation inpainting neural network;
• generate a first feature map from the image feature vector of the digital image utilizing a first modulation block of a first cascaded modulation layer of a decoder of the cascaded modulation inpainting neural network;
• generate a second feature map from the first feature map utilizing a second modulation block of the first cascaded modulation layer of the decoder;
• and
• generate an inpainted digital image by determining replacement pixels for the replacement region utilizing additional cascaded modulation layers of the decoder from the first feature map and second feature map.

A non-transitory computer readable medium storing executable instructions which, when executed by a processing device, cause the processing device to perform operations comprising:

• receiving, based on user interaction at a client device, a digital image comprising a replacement region;
• generating a first local feature map from the digital image utilizing a first spatial modulation block of a first modulation layer of a decoder of an inpainting neural network;
• generating a second local feature map from the first local feature map utilizing a second spatial modulation block of a second modulation layer of the decoder;
• generating an inpainted digital image by generating replacement pixels for the replacement region from the second local feature map utilizing additional modulation layers of the decoder;
• and
• providing, for display via the client device, the inpainted digital image comprising the replacement pixels.