Device, method, and program for image processing

An image processing method of an image processing device, the device including

• subject region detection means for detecting a region, where a subject is present, as a subject region from an input image,
• cutting means for cutting an image of the subject region from the input image,
• priority calculation means for calculating a priority of each of predetermined regions on a boundary with respect to the subject region, for the input image,
• retrieval means for retrieving a region similar to an image of a predetermined region with a top priority from among the priorities of the predetermined regions on the boundary with respect to the subject region, from the input image after the image of the subject region is cut,
• recovery means for recovering the subject region by copying an image of an adjacent region that is adjacent to the region similar to the predetermined region retrieved by the retrieval means and includes a region corresponding to a region cut as the subject region, and by pasting the image obtained by copying the adjacent region onto the region that is adjacent to the predetermined region with the top priority and cut as the subject region, and
• composition means for combining the image of the subject region cut by the cutting means with the image with the subject region recovered by the recovery means,
• the method comprising the steps of:
• detecting the region, where the subject is present, as the subject region from the input image, by the subject region detection means;
• cutting the image of the subject region from the input image, by the cutting means;
• calculating the priority of each of the predetermined regions on the boundary with respect to the subject region, for the input image, by the priority calculation means;
• retrieving the region similar to the image of the predetermined region with the top priority from among the priorities of the predetermined regions on the boundary with respect to the subject region, from the input image after the image of the subject region is cut, by the retrieval means;
• recovering the subject region by copying the image of the adjacent region that is adjacent to the region similar to the predetermined region retrieved by the retrieving and includes the region corresponding to the region cut as the subject region, and by pasting the image obtained by copying the adjacent region onto the region that is adjacent to the predetermined region with the top priority and cut as the subject region, by the recovery means;
• and
• combining the image of the subject region cut by the cutting with the image with the subject region recovered by the recovering, by the composition means.

A non-transitory computer-readable medium storing a program executable by a computer that controls an image processing device, the device including

• subject region detection means for detecting a region, where a subject is present, as a subject region from an input image,
• cutting means for cutting an image of the subject region from the input image,
• priority calculation means for calculating a priority of each of predetermined regions on a boundary with respect to the subject region, for the input image,
• retrieval means for retrieving a region similar to an image of a predetermined region with a top priority from among the priorities of the predetermined regions on the boundary with respect to the subject region, from the input image after the image of the subject region is cut,
• recovery means for recovering the subject region by copying an image of an adjacent region that is adjacent to the region similar to the predetermined region retrieved by the retrieval means and includes a region corresponding to a region cut as the subject region, and by pasting the image obtained by copying the adjacent region onto the region that is adjacent to the predetermined region with the top priority and cut as the subject region, and
• composition means for combining the image of the subject region cut by the cutting means with the image with the subject region recovered by the recovery means,
• the program causing the computer to execute processing comprising the steps of:
• detecting the region, where the subject is present, as the subject region from the input image, by the subject region detection means;
• cutting the image of the subject region from the input image, by the cutting means;
• calculating the priority of each of the predetermined regions on the boundary with respect to the subject region, for the input image, by the priority calculation means;
• retrieving the region similar to the image of the predetermined region with the top priority from among the priorities of the predetermined regions on the boundary with respect to the subject region, from the input image after the image of the subject region is cut, by the retrieval means;
• recovering the subject region by copying the image of the adjacent region that is adjacent to the region similar to the predetermined region retrieved by the retrieving and includes the region corresponding to the region cut as the subject region, and by pasting the image obtained by copying the adjacent region onto the region that is adjacent to the predetermined region with the top priority and cut as the subject region, by the recovering;
• and
• combining the image of the subject region cut by the cutting with the image with the subject region recovered by the recovering, by the composition means.

An image processing device comprising:

• a subject region detector configured to detect a region, where a subject is present, as a subject region from an input image;
• a cutting unit configured to cut an image of the subject region from the input image;
• a priority calculator configured to calculate a priority of each of predetermined regions on a boundary with respect to the subject region, for the input image;
• a retrieval unit configured to retrieve a region similar to an image of a predetermined region with a top priority from among the priorities of the predetermined regions on the boundary with respect to the subject region, from the input image after the image of the subject region is cut;
• a recovery unit configured to recover the subject region by copying an image of an adjacent region that is adjacent to the region similar to the predetermined region retrieved by the retrieval unit and includes a region corresponding to a region cut as the subject region, and by pasting the image obtained by copying the adjacent region onto the region that is adjacent to the predetermined region with the top priority and cut as the subject region;
• and
• a composition unit configured to combine the image of the subject region cut by the cutting unit with the image with the subject region recovered by the recovery unit.