Image processing apparatus for reconstructing an image, image pickup apparatus, image processing method, and non-transitory computer-readable storage medium

An image pickup apparatus comprising:

• an imaging optical system;
• an image pickup element including a plurality of pixels;
• a lens array configured such that rays from the same position of an object plane are incident on different pixels of the image pickup element depending on a pupil region of the imaging optical system through which the ray passes;
• and
• an image processing apparatus which generates an output image using a captured input image including object space information containing information of a two-dimensional light intensity distribution and an angle of the ray, the image processing apparatus comprising:
• a non-transitory memory storing a program;
• and
• a processor configured to execute the program stored in the non-transitory memory to implement a region dividing unit and a reconstructed image generating unit, wherein:
• the region dividing unit is configured to divide an output image region into at least a first region and a second region by using the captured input image;
• and
• the reconstructed image generating unit is configured to reconstruct the captured input image based on the object space information included in the captured input image to generate the output image, the reconstructed image generating unit applying different shooting conditions from each other to the first region and the second region, respectively, after the input image is captured,
• wherein the lens array is disposed in an image-side conjugate plane of the imaging optical system with respect to the object plane.

An image pickup apparatus comprising:

• an imaging optical system;
• an image pickup element including a plurality of pixels;
• a lens array configured such that rays from the same position of an object plane are incident on different pixels of the image pickup element depending on a pupil region of the imaging optical system through which the ray passes;
• and
• an image processing apparatus which generates an output image using a captured input image including object space information containing information of a two-dimensional light intensity distribution and an angle of the ray, the image processing apparatus comprising:
• a non-transitory memory storing a program;
• and
• a processor configured to execute the program stored in the non-transitory memory to implement a region dividing unit and a reconstructed image generating unit, wherein:
• the region dividing unit is configured to divide an output image region into at least a first region and a second region by using the captured input image;
• and
• the reconstructed image generating unit is configured to reconstruct the captured input image based on the object space information included in the captured input image to generate the output image, the reconstructed image generating unit applying different shooting conditions from each other to the first region and the second region, respectively, after the input image is captured,
• wherein the lens array is disposed such that the image pickup element is conjugate with an image-side conjugate plane of the imaging optical system with respect to the object plane.

An image pickup apparatus comprising:

• an imaging optical system including a plurality of optical systems having a positive refractive power;
• at least one image pickup element including a plurality of pixels;
• and
• an image processing apparatus which generates an output image using a captured input image including object space information containing information of a two-dimensional light intensity distribution and an angle of the ray, the image processing apparatus comprising:
• a non-transitory memory storing a program;
• and
• a processor configured to execute the program stored in the non-transitory memory to implement a region dividing unit and a reconstructed image generating unit, wherein:
• the region dividing unit is configured to divide an output image region into at least a first region and a second region by using the captured input image;
• and
• the reconstructed image generating unit is configured to reconstruct the captured input image based on the object space information included in the captured input image to generate the output image, the reconstructed image generating unit applying different shooting conditions from each other to the first region and the second region, respectively, after the input image is captured,
• wherein the plurality of optical systems are arrayed such that rays from the same position of an object plane are incident on different pixels of the image pickup element depending on a pupil region of the imaging optical system through which the ray passes, and
• wherein a pupil of the imaging optical system is a combined pupil that is obtained by combining pupils of the plurality of optical systems.