# US 10,873,701 B2 · Image pickup apparatus and control method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,873,701 B2 - Document ID: US10873701B2 - Status: Granted - Kind: B2 - Application number: 16/245,379 - Filed: 2019-01-11 - Published: 2019-07-18 - Granted: 2020-12-22 - Earliest claimed: 2018-01-15 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Hitoshi Miyazawa - Web page: https://patentgrep.com/patent/US10873701B2 ## CPC - H04N 23/683: {performed by a processor, e.g. controlling the readout of an image memory} - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 5/73: Deblurring; Sharpening - H04N 23/60: Control of cameras or camera modules - H04N 23/6812: {based on additional sensors, e.g. acceleration sensors} - H04N 23/687: {by shifting the lens or sensor position} - H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture - H04N 23/73: by influencing the exposure time - G06T 2200/32: involving image mosaicing - G06T 2207/20221: Image fusion; Image merging - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An image pickup apparatus capable of compositing a plurality of continuously captured images is provided that includes a first detection unit configured to detect shake of the image pickup apparatus; a second detection unit configured to detect a moving amount of a captured image captured by an imaging unit; a correction unit configured to correct image blur of an image caused by shake of the image pickup apparatus; a control unit configured to calculate a blur amount of a background in the captured image from a shake detection signal detected by the first detection unit and the moving amount detected by the second detection unit and to control image blur correction performed by the correction unit; and a combining unit configured to combine a plurality of captured images with corrected image blur. ## Claims ### Claim 1 An image pickup apparatus capable of combining a plurality of continuously captured images, comprising: at least one processor and at least one memory functioning as: a first detection unit configured to detect shake of the image pickup apparatus; a second detection unit configured to detect a moving amount of a captured image captured by an imaging unit; a correction unit configured to correct image blur of an image caused by shake of the image pickup apparatus; a control unit configured to calculate a blur amount of a target in the captured image from a shake detection signal detected by the first detection unit and the moving amount detected by the second detection unit and to control image blur correction performed by the correction unit; and a combining unit configured to combine a plurality of captured images with corrected image blur, wherein the control unit switches first control of controlling the correction unit using a correction amount calculated from the shake detection signal and second control of controlling the correction unit using a correction amount calculated from the shake detection signal and the moving amount, depending on detection reliability of the moving amount or a continuous shooting speed. ### Claim 2 (depends on 1) The image pickup apparatus according to claim 1, wherein, in the first control, the control unit calculates the blur amount of the target using the average of the shake detection signal detected by the first detection unit in synchronization with a detection period of the second detection unit. ### Claim 3 (depends on 1) The image pickup apparatus according to claim 1, wherein, in the second control, the control unit calculates the blur amount of the target using the average of the shake detection signal detected by the first detection unit in synchronization with a detection period of the second detection unit and the moving amount detected by the second detection unit. ### Claim 4 (depends on 3) The image pickup apparatus according to claim 3, wherein the second detection unit detects motion vectors from data of a plurality of captured images, and wherein the control unit performs a process of extracting a target vector corresponding to a target region in the captured images from the plurality of motion vectors. ### Claim 5 (depends on 1) The image pickup apparatus according to claim 1, wherein the control unit performs the first control if the detection reliability of the moving amount is lower than a threshold value and performs the second control if the detection reliability of the moving amount is equal to or greater than the threshold value. ### Claim 6 (depends on 1) The image pickup apparatus according to claim 1, wherein the control unit performs the first control if the continuous shooting speed is less than a threshold value and performs the second control if the continuous shooting speed is equal to or greater than the threshold value. ### Claim 7 (depends on 1) The image pickup apparatus according to claim 1, wherein the control unit changes the number of detection times when the second detection unit detects the moving amount if changes in the blur amount of the target are less than a threshold value in continuous imaging. ### Claim 8 (depends on 7) The image pickup apparatus according to claim 7, wherein the control unit decreases the number of detection times when the second detection unit detects the moving amount in the second and subsequent imaging and following imaging to below the number of times the second detection unit detects a moving amount in first imaging. ### Claim 9 (depends on 7) The image pickup apparatus according to claim 7, wherein the control unit sets the number of times the number of detection times of the moving amount as a first number of detection times if the magnitude of a difference between a detected previous blur amount of the target and a current blur amount of the target is equal to or greater than a threshold value and sets the number of times the moving amount is detected to a second number of times of detection less than the first number of times of detection if the magnitude of the difference is less than the threshold value. ### Claim 10 (depends on 7) The image pickup apparatus according to claim 7, wherein the control unit determines the number of times the moving amount is detected using a frame rate corresponding to the detection period of the second detection unit, an exposure time and a continuous shooting speed of the imaging unit. ### Claim 11 (depends on 1) The image pickup apparatus according to claim 1, wherein the blur amount of the target is a blur amount of a background. ### Claim 12 A control method performed in an image pickup apparatus capable of combining a plurality of continuously captured images, comprising: detecting, by a first detection unit, shake of the image pickup apparatus and detecting, by a second detection unit, a moving amount of a captured image captured by the image pickup apparatus; correcting image blur of an image caused by shake of the image pickup apparatus by calculating a blur amount of a target in the captured image from a shake detection signal detected by the first detection unit and the moving amount detected by the second detection unit and controlling a correction unit; combining a plurality of captured images with corrected image blur; and switching first control of controlling the correction unit using a correction amount calculated from the shake detection signal and second control of controlling the correction unit using a correction amount calculated from the shake detection signal and the moving amount, depending on detection reliability of the moving amount or a continuous shooting speed.