# US 12,114,070 B2 · Image pickup apparatus, image pickup method, and non-transitory computer-readable storage medium for correcting influence caused by an effective F-number > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,114,070 B2 - Document ID: US12114070B2 - Status: Granted - Kind: B2 - Application number: 17/866,338 - Filed: 2022-07-15 - Published: 2022-11-10 - Granted: 2024-10-08 - Earliest claimed: 2018-12-26 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Takeshi Yasutomi - Web page: https://patentgrep.com/patent/US12114070B2 ## CPC - H04N 23/676: {Bracketing for image capture at varying focusing conditions} - G06T 5/50: using two or more images, e.g. averaging or subtraction - H04N 23/63: by using electronic viewfinders - H04N 23/73: by influencing the exposure time - H04N 23/743: Bracketing, i.e. taking a series of images with varying exposure conditions - H04N 23/75: by influencing optical camera components - H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio - G06T 2207/20221: Image fusion; Image merging - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An image pickup apparatus includes a sensor configured to pick up a plurality of images different in in-focus position in an optical axis direction, an adjustment unit configured to adjust a parameter relating to image pickup to correct influence caused by an effective F-number varied depending on an in-focus position when at least a part of the plurality of images is picked up, and a synthesis unit configured to synthesize the plurality of images. ## Claims ### Claim 1 An apparatus, comprising: a sensor configured to pick up a plurality of images different in in-focus position in an optical axis direction via lenses; at least one memory configured to store instructions; and at least one processor in communication with the at least one memory and configured to execute the instructions to: adjust a parameter relating to image pickup so that an effective F-number of a first image and effective F-numbers of a plurality of images different in in-focus position to be picked up after the first image become equal; and synthesize the plurality of images, wherein the effective F-number is a parameter corresponding to brightness of a picked-up image and varies when the in-focus position is moved from an infinite end side to a closest end side while an aperture of the lens is opened at maximum. ### Claim 2 (depends on 1) The apparatus according to claim 1, wherein the at least one processor further executes instructions to adjust an aperture to make the effective F-number equal when the at least a part of the images is picked up. ### Claim 3 (depends on 1) The apparatus according to claim 1, wherein the at least one processor further executes instructions to adjust at least any one of an exposure time and a gain to correct influence on brightness caused by the effective F-number varied depending on the relative positions of the lenses. ### Claim 4 (depends on 1) The apparatus according to claim 1, wherein the at least one processor further executes instructions to adjust at least any one of an exposure time and a gain to correct influence on brightness caused by the effective F-number varied depending on relative positions of the lenses in a case where an aperture is not adjustable to make the effective F-number equal. ### Claim 5 (depends on 4) The apparatus according to claim 4, wherein the at least one processor further executes instructions to adjust the exposure time in preference to the gain. ### Claim 6 (depends on 1) The apparatus according to claim 1, wherein the plurality of images is overlapped in at least a part of angle of view. ### Claim 7 (depends on 1) The apparatus according to claim 1, wherein the at least one processor further executes instructions to generate a synthesized image with use of the plurality of images, and wherein a depth of field of the synthesized image is greater than a depth of field of each of the plurality of images. ### Claim 8 (depends on 1) The apparatus according to claim 1, wherein intervals of the in-focus positions of at least a part of the plurality of images are equal to each other. ### Claim 9 (depends on 1) The apparatus according to claim 1, wherein depths of field of at least a part of the plurality of images are equal to each other. ### Claim 10 (depends on 1) The apparatus according to claim 1, wherein the sensor picks up the plurality of images while the in-focus position is moved from a closest end side to an infinite end side. ### Claim 11 (depends on 1) The apparatus according to claim 1, further comprising a display configured to display the effective F-number. ### Claim 12 (depends on 1) The apparatus according to claim 1, wherein the at least one processor further executes instructions to issue warning in a case where the effective F-number when the sensor picks up the image is different from a nominal F-number. ### Claim 13 (depends on 1) The apparatus according to claim 1, wherein the at least one processor further executes instructions to adjust the parameter relating to image pickup based on variation estimated. ### Claim 14 A method, comprising: picking up a plurality of images different in in-focus position in an optical axis direction via lenses; adjusting a parameter relating so that an effective F-number of a first image and effective F-numbers of a plurality of images different in in-focus position to be picked up after the first image become equal; and synthesizing the plurality of images, wherein the effective F-number is a parameter corresponding to brightness of a picked-up image and varies when the in-focus position is moved from an infinite end side to a closest end side while an aperture of the lens is opened at maximum. ### Claim 15 A non-transitory computer-readable storage medium which stores a program for causing a computer of an image pickup apparatus to execute a method, the method comprising: picking up a plurality of images different in in-focus position in an optical axis direction via lenses; adjusting a parameter relating to image pickup so that an effective F- number of a first image and effective F-numbers of a plurality of images different in in-focus position to be picked up after the first image become equal; and synthesizing the plurality of images, wherein the effective F-number is a parameter corresponding to brightness of a picked-up image and varies when the in-focus position is moved from an infinite end side to a closest end side while an aperture of the lens is opened at maximum.