Image processing apparatus and image processing method for performing image restoration using restoration filter

An image processing apparatus processing an image generated by image pickup using an optical system, comprising:

• a memory part configured to store an image restoration filter created such that its filter values have a two-dimensional distribution based on aberration information of the optical system;
• and
• an image restoring part configured to perform image restoration processing on the image using the image restoration filter,
• wherein the image restoration filter is created by performing inverse Fourier transformation on a function created based on an inverse function of an optical transfer function of the optical system, and
• wherein the image restoration filter is a filter in which a position of a cell having a maximum absolute value among the filter values is shifted with respect to a position of a center cell of the image restoration filter by a shift amount according to at least one of an amount of distortion aberration of the optical system and an amount of chromatic aberration of magnification of the optical system, and which reduces a blur component of the image and at least one of a component of distortion aberration and a component of chromatic aberration of magnification of the image.

An image pickup apparatus comprising:

• an image pickup system configured to photoelectrically convert an object image formed by an optical system to generate an image;
• and
• an image processing apparatus configured to process the image,
• wherein the image processing apparatus comprising:
• a memory part configured to store an image restoration filter created such that its filter values have a two-dimensional distribution based on aberration information of the optical system;
• and
• an image restoring part configured to perform image restoration processing on the image using the image restoration filter,
• wherein the image restoration filter is created by performing inverse Fourier transformation on a function created based on an inverse function of an optical transfer function of the optical system, and
• wherein the image restoration filter is a filter in which a position of a cell having a maximum absolute value among the filter values is shifted with respect to a position of a center cell of the image restoration filter by a shift amount according to at least one of an amount of distortion aberration of the optical system and an amount of chromatic aberration of magnification of the optical system, and which reduces a blur component of the image and at least one of a component of distortion aberration and a component of chromatic aberration of magnification of the image.

A non-transitory recording medium stored therein an image processing computer program causing a computer to process an image generated by image pickup using an optical system, comprising:

• a step of acquiring the image;
• and
• a step of performing image restoration processing on the image using an image restoration filter created such that its filter values have a two-dimensional distribution based on aberration information of the optical system,
• wherein the image restoration filter is created by performing inverse Fourier transformation on a function created based on an inverse function of an optical transfer function of the optical system, and
• wherein the image restoration filter is a filter in which a position of a cell having a maximum absolute value among the filter values is shifted with respect to a position of a center cell of the image restoration filter by a shift amount according to at least one of an amount of distortion aberration of the optical system and an amount of chromatic aberration of magnification of the optical system, and which reduces a blur component of the image and at least one of a component of distortion aberration and a component of chromatic aberration of magnification of the image.

An image processing method for processing an image generated by image pickup using an optical system, comprising:

• a step of acquiring the image;
• and
• a step of performing image restoration processing on the image using an image restoration filter created such that its filter values have a two-dimensional distribution based on aberration information of the optical system,
• wherein, in the step of performing the image restoration processing, plural image restoration filters for plural colors are used as the image restoration filter, the image restoration filters having different two-dimensional distributions of the filter values from each other, and
• wherein the shift amount of the position of the cell having the maximum absolute value with respect to the position of the center cell in each image restoration filter corresponds to the amount of chromatic aberration of magnification, and which reduces a blur component of the image and a component of chromatic aberration of magnification of the image.

An image processing method for processing an image generated by image pickup using an optical system, comprising:

• a step of acquiring the image;
• and
• a step of performing image restoration processing on the image using an image restoration filter created such that its filter values have a two-dimensional distribution based on aberration information of the optical system,
• wherein the image restoration filter is created by performing inverse Fourier transformation on a function created based on an inverse function of an optical transfer function of the optical system, and
• wherein the image restoration filter is a filter in which a position of a cell having a maximum absolute value among the filter values is shifted with respect to a position of a center cell of the image restoration filter by a shift amount according to at least one of an amount of distortion aberration of the optical system and an amount of chromatic aberration of magnification of the optical system, and which reduces at least one of a component of distortion aberration and a component of chromatic aberration of magnification of the image.