# US 11,445,118 B2 · Image pickup apparatus, an image processing method and a non-transitory computer-readable medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,445,118 B2 - Document ID: US11445118B2 - Status: Granted - Kind: B2 - Application number: 17/109,927 - Filed: 2020-12-02 - Published: 2021-03-25 - Granted: 2022-09-13 - Earliest claimed: 2016-12-11 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Takuya Masamura - Web page: https://patentgrep.com/patent/US11445118B2 ## CPC - H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters} - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 7/11: Region-based segmentation - H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation} - H04N 5/265: Mixing - H04N 23/60: Control of cameras or camera modules - H04N 23/635: {Region indicators; Field of view indicators} - H04N 23/675: {comprising setting of focusing regions} - H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming - G06T 2207/10052: Images from lightfield camera - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Image pickup apparatuses, control methods and storage mediums for use therewith are provided herein. At least one image pickup apparatus includes: a display unit that displays an image generated by an imaging unit; an image processing unit that extracts in-focus areas from a plurality of images different in in-focus position that are generated by the imaging unit and that composites the extracted areas; and a control unit. The control unit acquires, out of image magnifications corresponding to the plurality of images different in in-focus position, a reference image magnification, and the image processing unit corrects the image to be displayed on the display unit based on an image magnification corresponding to the image to be displayed on the display unit and the reference image magnification. ## Claims ### Claim 1 An image processing method comprising: displaying a plurality of images obtained by picking up in different in-focus positions, the plurality of images having the different in-focus positions being used for generating a composite image; and performing a control of displaying of the obtained images corresponding to the different in-focus positions before generating the composite image such that each display indicates a portion corresponding to a field angle of the composite image. ### Claim 2 (depends on 1) The image processing method according to claim 1, further comprising: generating the composite image using the plurality of images having the different in-focus positions. ### Claim 3 (depends on 2) The image processing method according to claim 2, wherein in the generating, the composite image is generated by compositing the plurality of images in respective notice areas with the highest contrast among the plurality of images. ### Claim 4 (depends on 3) The image processing method according to claim 3, wherein a depth field of the composite image is deeper than the depth field of any of the plurality of images. ### Claim 5 (depends on 1) The image processing method according to claim 1, wherein a field angle of at least one of the plurality of images is different from a field angle of the composite image. ### Claim 6 (depends on 1) The image processing method according to claim 1, wherein field angles of the plurality of images are different according to the in-focus positions of the plurality of images. ### Claim 7 (depends on 6) The image processing method according to claim 6, wherein the field angle of the composite image is equal to a narrowest field angle among the field angles of the plurality of images. ### Claim 8 (depends on 6) The image processing method according to claim 6, further comprising: acquiring a reference field angle out of the field angles of the plurality of images as the field angle corresponding to the field angle of the composite image, wherein in the performing the control of displaying, the each display is performed in accordance with the reference angle. ### Claim 9 (depends on 8) The image processing method according to claim 8, wherein in the acquiring the reference field angle, optical system information relating to an optical system used for picking up the plurality of images is acquired and the reference field angle in accordance with the optical system information and the in-focus position is acquired. ### Claim 10 (depends on 1) The image processing method according to claim 1, wherein in the performing the control of displaying, the portion corresponding to the field angle of the composite image is cut off from the obtained image and the cut-off portion is displayed. ### Claim 11 A non-transitory computer-readable medium for causing a computer to execute an image processing method, the image processing method comprising: displaying a plurality of images obtained by picking up in different in-focus positions, the plurality of images having the different in-focus positions being used for generating a composite image; and performing a control of displaying of the obtained images corresponding to the different in-focus positions before generating the composite image such that each display indicates a portion corresponding to a field angle of the composite image.