Image processing apparatus, image processing method, and program
AssigneeCanon Kabushiki Kaisha
InventorYuichi Nakada
Life of this patent
Estimating the term…
Abstract
An image processing device that sets weighting factors for captured image data and interpolation image data region by region based on in-focus state information indicating in-focus states of the respective regions, and synthesizes the captured image data and the interpolation image data based on the weighting factors. A weighting factor for interpolation image data in an in-focus region is smaller than a weighting factor for interpolation image data in at least a part of a region other than the in-focus region.
Claims11
An image processing apparatus comprising:
- a memory;
- a processor coupled to the memory which executes the following:
- inputting captured image data which includes a plurality of captured images obtained by capturing an object from a plurality of viewpoints;
- generating, based on the captured image data, interpolation image data which includes an interpolation image to be obtained in capturing the object from a viewpoint other than the plurality of viewpoints;
- setting weighting factors of the plurality of captured images and the interpolation image used for weighted synthesis of the plurality of captured images and the interpolation image, wherein the setting is configured to set the weighting factors region by region of a synthesized image to be generated by the weighted synthesis, based on in-focus state information indicating an in-focus region of the synthesized image, wherein the in-focus region is an image region that is in focus;
- and
- synthesizing, based on the weighting factors set, the plurality of captured images and the interpolation image to generate synthesized image data which includes the synthesized image,
- wherein the setting is configured to set the weighting factors so that a weighting factor of the interpolation image in the in-focus region of the synthesized image is smaller than a weighting factor of the interpolation image in at least a part of a region in the synthesized image other than the in-focus region.
An image processing method comprising:
- inputting captured image data which includes a plurality of captured images obtained by capturing an object from a plurality of viewpoints;
- generating, based on the captured image data, interpolation image data which includes an interpolation image to be obtained in capturing the object from a viewpoint other than the plurality of viewpoints;
- setting weighting factors of the plurality of captured images and the interpolation image region by region of a synthesized image to be generated by a weighted synthesis, based on in-focus state information indicating an in-focus region of the synthesized image, so that a weighting factor of the interpolation image in the in-focus region of the synthesized image is smaller than a weighting factor of the interpolation image in at least a part of a region in the synthesized image other than the in-focus region, wherein the in-focus region is an image region that is in focus;
- and
- synthesizing, based on the weighting factors set, the plurality of captured images and the interpolation image to generate synthesized image data which includes the synthesized image.
A non-transitory computer-readable storage medium storing a computer-executable program, the program comprising code for:
- inputting captured image data which includes a plurality of captured images obtained by capturing an object from a plurality of viewpoints;
- generating, based on the captured image data, interpolation image data which includes an interpolation image to be obtained in capturing the object from a viewpoint other than the plurality of viewpoints;
- setting weighting factors of the plurality of captured images and the interpolation image region by region of a synthesized image to be generated by a weighted synthesis, based on in-focus state information indicating an in-focus region of the synthesized image, so that a weighting factor of the interpolation image in the in-focus region of the synthesized image is smaller than a weighting factor of the interpolation image in at least a part of a region in the synthesized image other than the in-focus region, wherein the in-focus region is an image region that is in focus;
- and
- synthesizing, based on the weighting factors set, the plurality of captured images and the interpolation image to generate synthesized image data which includes the synthesized image.
An image processing apparatus comprising:
- a memory;
- a processor coupled to the memory which executes the following:
- generating, by performing image synthesis, a synthesized image whose pixel value is a weighted sum of pixel values of corresponding pixels in a plurality of captured images obtained by capturing an object from a plurality of viewpoints and an interpolation image which is to be obtained in capturing the object from a viewpoint other than the plurality of viewpoints and generated based on the plurality of images;
- and
- inputting in-focus state information indicating an in-focus region of the synthesized image,
- wherein the generating is configured to perform the image synthesis based on the in-focus state information so that a weight of the interpolation image in the in-focus region of the synthesized image is smaller than a weight of the interpolation image in at least a part of a region in the synthesized image other than the in-focus region, wherein the in-focus region is an image region that is in focus.
Dependencies are inferred from the claim text.