Dictionary creation device, image processing device, image processing system, dictionary creation method, image processing method, and program

An image processing device comprising:

• a processor configured to:
• estimate a value of a blur parameter indicating a blurring state with respect to an input image that is an image received from outside;
• divide the input image and generate a plurality of input patches;
• refer to a dictionary storing two or more sets of data in which a blurred patch generated from a learning image, a restoration patch, and the blur parameter of the blurred patch are associated with each other and select the restoration patch for each input patch based on a value indicating a feature similarity and a value indicating a similarity of the blur parameter between the input patch and the blurred patch in the dictionary;
• and
• combine the restoration patches selected for each input patch and generate the restored image.

An image processing system including a dictionary creation device and an image processing device wherein

• the dictionary creation device configured to:
• output a blurred image generated by performing a blurring process to a learning image together with a blur parameter indicating a blurring state of the blurred image,
• generate a restoration patch and a blurred patch as a patch pair that is composed of the patches located at the corresponding positions of the learning image and the blurred image, and
• associate the patch pair with the blur parameter and register the patch pair and the blur parameter in a dictionary and
• the image processing device is configured to:
• estimate value of a blur parameter indicating the blurring state with respect to an input image that is an image received from outside,
• divide the input image and generate a plurality of input patches,
• refer to the dictionary created by the dictionary creation device and select the restoration patch for each input patch based on a value indicating a feature similarity and a value indicating a similarity of the blur parameter between the input patch and the blurred patch in the dictionary, and
• combine the restoration patches selected for each input patch and generate the restored image.

A method for creating a dictionary comprising:

• outputting a blurred image generated by performing a blurring process to a learning image together with a blur parameter indicating a blurring state of the blurred image;
• generating a restoration patch and a blurred patch as a patch pair that is composed of the patches located at the corresponding positions of the learning image and the blurred image;
• and
• associating the patch pair with the blur parameter and register the patch pair and the blur parameter in a dictionary.

A method for processing an image comprising:

• estimating a value of a blur parameter indicating a blurring state with respect to an input image that is an image received from outside;
• dividing the input image and generating a plurality of input patches;
• referring to a dictionary storing two or more sets of data in which a blurred patch that is a patch of a blurred image generated from a learning image, a restoration patch, and the blur each input patch based on a value indicating a feature similarity and a value indicating a similarity of the blur parameter between the input patch and the blurred patch in the dictionary;
• and
• combining the restoration patches selected for each input patch and generating a restored image.

A non-transitory computer-readable storage medium storing a program for causing a computer to execute, comprising:

• outputting a blurred image generated by performing a blurring process to a learning image together with a blur parameter indicating a blurring state of the blurred image;
• generating a restoration patch and a blurred patch as a patch pair that is composed of the patches located at the corresponding positions of the learning image and the blurred image;
• and
• associating the patch pair with the blur parameter and register the patch pair and the blur parameter in a dictionary.

Anon-transitory computer-readable storage medium storing a program for causing a computer to execute, comprising:

• estimating a value of a blur parameter indicating a blurring state with respect to an input image that is an image received from outside;
• dividing the input image and generating a plurality of input patches;
• referring to a dictionary storing two or more sets of data in which a blurred patch that is a patch of a blurred image generated from a learning image, a restoration patch that is a patch of the learning image, and the blur parameter of the blurred patch are associated with each other and selecting the restoration patch for each input patch based on a value indicating a feature similarity and a value indicating a similarity of the blur parameter between the input patch and the blurred patch in the dictionary;
• and
• combining the restoration patches selected for each input patch and generating the restored image.