Image pickup apparatus, image processing apparatus, image pickup method, and image processing method
AssigneeFUJIFILM Corporation
InventorMasaya TAMARU
Life of this patent
Estimating the term…
Abstract
The present invention, which transforms multiple images so that positions of corresponding points will coincide between the images and composites the images with the corresponding points matched, provides an image pickup apparatus, image processing apparatus, image pickup method, and image processing method which make it possible to obtain an intended all-in-focus image or blur-emphasized image even if there is camera shake or subject movement.
Claims18
An image pickup apparatus, comprising:
- a focus bracketing device which shoots images successively by discretely moving a focus position by a predetermined amount of movement and thereby obtains a plurality of images;
- a corresponding point detecting device which detects corresponding points on subjects among the plurality of images shot by the focus bracketing device;
- an image transformation device which transforms the plurality of images excluding one reference image so that positions of the corresponding points will coincide between the reference image and the plurality of images excluding the reference image, the reference image being selected from the plurality of images based on a predetermined criterion;
- an image compositing device which composites a plurality of images including the transformed images;
- and
- a recording device which records an image obtained by the image compositing device on a recording medium.
An image pickup apparatus, comprising:
- an automatic focusing device which determines an in-focus position of a main subject based on image data;
- a focus bracketing device which shoots images successively by discretely moving a focus position by a predetermined amount of movement and thereby obtains a plurality of images;
- a focus position control device which performs control such that the moving focus position will include focus positions at and around the in-focus position of the main subject determined by the automatic focusing device;
- a corresponding point detecting device which detects corresponding points on subjects among the plurality of images shot by the focus bracketing device including an image shot at the in-focus position of the main subject and images shot at the focus positions around the in-focus position of the main subject;
- an image transformation device which transforms the plurality of images excluding a reference image so that positions of the corresponding points will coincide between the reference image and the plurality of images excluding the reference image using the image shot at the in-focus position of the main subject as the reference image;
- an image compositing device which composites the plurality of images including the transformed images;
- and
- a recording device which records an image obtained by the image compositing device on a recording medium.
An image pickup apparatus, comprising:
- an automatic focusing device which determines an in-focus position of a main subject based on image data;
- a focus bracketing device which shoots images successively by discretely moving a focus position by a predetermined amount of movement and thereby obtains a plurality of images;
- a focus position control device which performs control such that the moving focus position will include focus positions at and around the in-focus position of the main subject determined by the automatic focusing device;
- a corresponding point detecting device which detects corresponding points on subjects among the plurality of images;
- an image transformation device which transforms the plurality of images excluding a reference image so that positions of the corresponding points will coincide between the reference image and the plurality of images excluding the reference image using the image shot at the in-focus position of the main subject as the reference image;
- a blur calculating device which calculates blur amounts in the plurality of images including the transformed images according to coordinates of pixels;
- a filtering device which determines a filter characteristics based on calculation results produced by the blur calculating device and applies digital filtering to the reference image shot at the in-focus position of the main subject;
- and
- a recording device which records an image obtained by the filtering device on a recording medium.
An image processing apparatus, comprising:
- an input device which allows inputs of a plurality of images of a same scene shot at different focus positions;
- a corresponding point detecting device which detects corresponding points on subjects among the plurality of images;
- an image transformation device which transforms the plurality of images excluding one reference image so that positions of the corresponding points will coincide between the reference image and the plurality of images excluding the reference image, the reference image being selected from the plurality of images based on a predetermined criterion;
- an image compositing device which composites the plurality of images including the transformed images;
- and
- an output device which outputs an image obtained by the image compositing device.
An image processing apparatus, comprising:
- an input device which allows inputs of a plurality of images of a same scene shot at different focus positions including an in-focus position of the main subject and focus positions around the in-focus position of the main subject;
- a corresponding point detecting device which detects corresponding points on subjects among the plurality of images;
- an image transformation device which transforms the plurality of images excluding a reference image so that positions of the corresponding points will coincide between the reference image and the plurality of images excluding the reference image using the image shot at the in-focus position of the main subject as the reference image;
- an image compositing device which composites the plurality of images including the transformed images;
- and
- an output device which outputs an image obtained by the image compositing device.
An image processing apparatus, comprising:
- an input device which allows inputs of a plurality of images of a same scene shot at different focus positions including an in-focus position of the main subject and focus positions around the in-focus position of the main subject;
- a corresponding point detecting device which detects corresponding points on subjects among the plurality of images;
- an image transformation device which transforms the plurality of images excluding a reference image so that positions of the corresponding points will coincide between the reference image and the plurality of images excluding the reference image using the image shot at the in-focus position of the main subject as the reference image;
- a blur calculating device which calculates blur amounts in the plurality of images including the transformed images according to coordinates of pixels;
- a filtering device which determines a filter characteristics based on calculation results produced by the blur calculating device and applies digital filtering to the reference image shot at the in-focus position of the main subject;
- and
- an output device which outputs an image obtained by the filtering device.
An image pickup method, comprising:
- a focus bracketing step of shooting images successively by discretely moving a focus position by a predetermined amount of movement and thereby obtains a plurality of images;
- a corresponding point detecting step of detecting corresponding points on subjects among the plurality of images;
- an image transformation step of transforming the plurality of images excluding one reference image so that positions of the corresponding points will coincide between the reference image and the plurality of images excluding the reference image, the reference image being selected from the plurality of images based on a predetermined criterion;
- an image compositing step of compositing the plurality of images including the transformed images;
- and
- a recording step of recording an image obtained by the image compositing step on a recording medium.
An image pickup method, comprising:
- an automatic focusing step of determining an in-focus position of a main subject;
- a focus bracketing step of shooting images successively by discretely moving a focus position by a predetermined amount of movement and thereby obtaining a plurality of images;
- a focus position control step of performing control such that the moving focus position will include focus positions at and around the in-focus position of the main subject determined by the automatic focusing step;
- a corresponding point detecting step of detecting corresponding points on subjects among the plurality of images shot by the focus bracketing step including an image shot at the in-focus position of the main subject and images shot at the focus positions around the in-focus position of the main subject;
- an image transformation step of transforming the plurality of images excluding a reference image so that positions of the corresponding points will coincide between the reference image and the plurality of images excluding the reference image using the image shot at the in-focus position of the main subject as the reference image;
- an image compositing step of compositing a plurality of images including the transformed images;
- and
- a recording step of recording an image obtained by the image compositing step on a recording medium.
An image pickup method, comprising:
- an automatic focusing step of determining an in-focus position of a main subject;
- a focus bracketing step of shooting images successively by discretely moving a focus position by a predetermined amount of movement and thereby obtaining a plurality of images;
- a focus position control step of performing control such that the moving focus position will include focus positions at and around the in-focus position of the main subject determined by the automatic focusing step;
- a corresponding point detecting step of detecting corresponding points on subjects among the plurality of images shot by the focus bracketing step including an image shot at the in-focus position of the main subject and images shot at the focus positions around the in-focus position of the main subject;
- an image transformation step of transforming the plurality of images excluding a reference image so that positions of the corresponding points will coincide between the reference image and the plurality of images excluding the reference image using the image shot at the in-focus position of the main subject as the reference image;
- a blur calculating step of calculating blur amounts in the plurality of images including the transformed images according to coordinates of pixels;
- a filtering step of determining a filter characteristics based on calculation results produced by the blur calculating step and applying digital filtering to the reference image shot at the in-focus position of the main subject;
- and
- a recording step of recording an image obtained by the filtering step on a recording medium.
An image processing method, comprising:
- an input step of allowing inputs of a plurality of images of a same scene shot at different focus positions;
- a corresponding point detecting step of detecting corresponding points on subjects among the plurality of images;
- an image transformation step of transforming the plurality of images excluding one reference image so that positions of the corresponding points will coincide between the reference image and the plurality of images excluding the reference image, the reference image being selected from the plurality of images based on a predetermined criterion;
- an image compositing step of compositing the plurality of images including the transformed images;
- and
- an output step of outputting an image obtained by the image compositing step.
An image processing method, comprising:
- an input step of allowing inputs of a plurality of images of a same scene shot at different focus positions including an in-focus position of the main subject and focus positions around the in-focus position of the main subject;
- a corresponding point detecting step of detecting corresponding points on subjects among the plurality of images;
- an image transformation step of transforming the plurality of images excluding a reference image so that positions of the corresponding points will coincide between the reference image and the plurality of images excluding the reference image using the image shot at the in-focus position of the main subject as the reference image;
- an image compositing step of compositing the plurality of images including the transformed images;
- and
- an output step of outputting an image obtained by the image compositing step.
An image processing method, comprising:
- an input step of allowing inputs of a plurality of images of a same scene shot at different focus positions including an in-focus position of the main subject and focus positions around the in-focus position of the main subject;
- a corresponding point detecting step of detecting corresponding points on subjects among the plurality of images;
- an image transformation step of transforming the plurality of images excluding a reference image so that positions of the corresponding points will coincide between the reference image and the plurality of images excluding the reference image using the image shot at the in-focus position of the main subject as the reference image;
- a blur calculating step of calculating blur amounts in the plurality of images including the transformed images according to coordinates of pixels;
- a filtering step of determining a filter characteristics based on calculation results produced by the blur calculating step and applying digital filtering to the reference image shot at the in-focus position of the main subject;
- and
- an output step of outputting an image obtained by the filtering step.
Dependencies are inferred from the claim text.