Cloud based content aware fill for images

A method implemented in a service that includes one or more computing devices, the method comprising:

• receiving, from a computing device separate from the service, a reduced-size version of an image;
• receiving, from the computing device, an indication of a first one or more regions of the reduced-size version of the image to be filled based on values of pixels in a second one or more regions of the reduced-size version of the image;
• determining, for each pixel in the first one or more regions, one or more pixels in the second one or more regions the values of which are to be used to generate the value for the pixel;
• generating a map identifying, for each pixel in the first one or more regions, one or more pixels in the second one or more regions the values of which are to be used to generate the value for the pixel;
• and
• returning the map to the computing device without returning a version of the image to the computing device.

A computing device comprising:

• an input module configured to obtain an image and an indication of a first one or more regions of the image to be filled based on values of pixels in a second one or more regions of the obtained image;
• a content aware fill module configured to down sample the obtained image to generate a down sampled version of the obtained image;
• a communication module configured to send the down sampled version of the image obtained image to a remote service, the remote service being implemented in one or more devices separate from the computing device, and further configured to receive from the remote service a map identifying, for each pixel in the first one or more regions, one or more pixels in the second one or more regions the values of which are to be used to generate the value for the pixel;
• and
• the content aware fill module being further configured to generate an output image by using the map to determine values of pixels in the first one or more regions.