# US 2023/0144310 A1 · Image capturing apparatus capable of obtaining high-quality image, method of controlling same, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0144310 A1
- Document ID: US20230144310A1
- Status: Published application
- Kind: A1
- Application number: 17/982,738
- Filed: 2022-11-08
- Published: 2023-05-11
- Earliest claimed: 2021-11-11
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Kazuki Konishi; Minami Furuta
- Web page: https://patentgrep.com/patent/US20230144310A1

## CPC

- H04N 23/663: for controlling interchangeable camera parts based on electronic image sensor signals
- H04N 23/682: {Vibration or motion blur correction}
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/73: Deblurring; Sharpening
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/215: Motion-based segmentation
- H04N 5/2625: {for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect (sequence generated by event triggered capturing H04N7/188)}
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- H04N 23/6811: {based on the image signal}
- H04N 23/6812: {based on additional sensors, e.g. acceleration sensors}
- H04N 23/684: {performed by controlling the image sensor readout, e.g. by controlling the integration time}
- H04N 23/72: Combination of two or more compensation controls
- H04N 23/73: by influencing the exposure time
- H04N 23/76: by influencing the image signals
- G06T 2207/10144: Varying exposure
- G06T 2207/20201: Motion blur correction
- G06T 2207/20208: High dynamic range [HDR] image processing
- G06T 2207/20221: Image fusion; Image merging
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image capturing apparatus capable of obtaining a high-quality image according to a continuous photographing mode and a shake state. In the image capturing apparatus, a plurality of types of a continuous photographing mode which are different in continuous photographing speed are set, a motion of an object is acquired from an input image, and shake information concerning a shake of the image capturing apparatus is acquired. Exposure conditions for photographing are controlled based on a type of the continuous photographing mode, the motion of the object, and the shake information, and in a case where image combination is performed, the number of images to be combined is determined.

## Claims

### Claim 1

An image capturing apparatus comprising:
at least one processor; and
a memory coupled to the at least one processor, the memory having instructions that, when executed by the processor, perform the operations as:
a setting unit configured to set a plurality of types of a continuous photographing mode which are different in continuous photographing speed;
a first acquisition unit configured to acquire a motion of an object from an input image;
a second acquisition unit configured to acquire shake information concerning a shake of the image capturing apparatus; and
a control unit configured to control exposure conditions for photographing, based on a type of the continuous photographing mode, a motion of the object, and the shake information, and determine, in a case where image combination is performed, the number of images to be combined.

### Claim 2 (depends on 1)

The image capturing apparatus according to claim 1, wherein in a case where the continuous photographing mode is set, when the continuous photographing mode is a second continuous photographing mode in which the continuous photographing speed is lower than in a first continuous photographing mode, the control unit performs at least one of processing operations for making exposure time longer, making the number of images to be combined smaller, and making ISO sensitivity lower, than in the first continuous photographing mode.

### Claim 3 (depends on 1)

The image capturing apparatus according to claim 1, wherein in a case where the motion of the object is a second motion larger than a first motion, the control unit makes exposure time shorter than in a case where the object motion is the first motion.

### Claim 4 (depends on 3)

The image capturing apparatus according to claim 3, wherein the control unit determines a limit value of the exposure time which can be set on a longer side based on a magnitude of the motion of the object.

### Claim 5 (depends on 3)

The image capturing apparatus according to claim 3, wherein the control unit estimates a shake amount after correction to occur during exposure, based on an object distance and determines a limit value of the exposure time which can be set on a longer side based on an estimated shake amount.

### Claim 6 (depends on 1)

The image capturing apparatus according to claim 1, wherein the first acquisition unit acquires the motion of the object by separating vectors indicating a motion of a background and vectors indicating a motion of an object from motion vectors in the input image.

### Claim 7 (depends on 6)

The image capturing apparatus according to claim 6, wherein the second acquisition unit acquires the shake information based on the vector indicating the motion of the background separated from the motion vectors in the input image and a detection signal from a sensor for detecting a shake of the image capturing apparatus.

### Claim 8 (depends on 1)

The image capturing apparatus according to claim 1, wherein the first acquisition unit and the second acquisition unit acquire the object motion and the shake information, which occur in a predetermined time period before start of photographing, respectively.

### Claim 9 (depends on 1)

The image capturing apparatus according to claim 1, wherein in a case where the continuous photographing mode is set, the control unit determines to perform image combination.

### Claim 10 (depends on 1)

The image capturing apparatus according to claim 1, wherein in a case where a single photographing mode is set, the control unit determines not to perform image combination.

### Claim 11 (depends on 1)

The image capturing apparatus according to claim 1, wherein the setting unit sets a type of the continuous photographing mode based on a user operation.

### Claim 12 (depends on 1)

The image capturing apparatus according to claim 1, wherein in a case where a type of the continuous photographing mode has not been set by a user operation, the setting unit determines a scene at least based on the motion of the object and sets a type of the continuous photographing mode according to a determined scene.

### Claim 13 (depends on 12)

The image capturing apparatus according to claim 12, wherein the setting unit sets a type of the continuous photographing mode, by further taking into consideration a battery remaining amount or a stroke of a sensor driving system for shake correction.

### Claim 14 (depends on 1)

The image capturing apparatus according to claim 1, wherein the memory having instructions that, when executed by the processor, perform the operations further as:
a combining unit configured to combine photographed images corresponding in number to the number of images to be combined, in the continuous photographing mode.

### Claim 15 (depends on 2)

The image capturing apparatus according to claim 2, wherein in a case where the continuous photographing mode is set, the control unit switches a program line to be used between a case of the first continuous photographing mode and a case of the second continuous photographing mode.

### Claim 16

A method of controlling an image capturing apparatus, comprising:
setting a plurality of types of a continuous photographing mode which are different in continuous photographing speed;
acquiring a motion of an object from an input image;
acquiring shake information concerning a shake of the image capturing apparatus; and
controlling exposure conditions for photographing, based on a type of the continuous photographing mode, the motion of the object, and the shake information, and determining, in a case where image combination is performed, the number of images to be combined.

### Claim 17

A non-transitory computer-readable storage medium storing a program for causing a computer to execute a method of controlling an image capturing apparatus,
wherein the method comprises:
setting a plurality of types of a continuous photographing mode which are different in continuous photographing speed;
acquiring a motion of an object from an input image;
acquiring shake information concerning a shake of the image capturing apparatus; and
controlling exposure conditions for photographing, based on a type of the continuous photographing mode, the motion of the object, and the shake information, and determining, in a case where image combination is performed, the number of images to be combined.
