# US 9,883,105 B2 · Image processing apparatus and control method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,883,105 B2
- Document ID: US9883105B2
- Status: Granted
- Kind: B2
- Application number: 15/222,313
- Filed: 2016-07-28
- Published: 2017-02-09
- Granted: 2018-01-30
- Earliest claimed: 2015-08-06
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Kohta Haruna
- Web page: https://patentgrep.com/patent/US9883105B2

## CPC

- H04N 23/6811: {based on the image signal}
- H04N 23/6812: {based on additional sensors, e.g. acceleration sensors}
- H04N 23/683: {performed by a processor, e.g. controlling the readout of an image memory}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In an image processing apparatus, a first motion detector calculates an angular velocity indicating a motion of an imaging apparatus body. A second motion detector calculates a movement amount of a motion of an object based on successively captured images. In addition, a motion vector calculating unit corrects the movement amount of the motion of the object based on the angular velocity, and calculates a motion vector of a main object based on the corrected movement amount.

## Claims

### Claim 1

An image processing apparatus comprising:
at least one processor executing computer executable instructions or at least one circuit which functions as:
a first calculation unit configured to calculate first motion detection information indicating a motion of an imaging apparatus body based on information detected by an angular velocity detection unit;
a second calculation unit configured to calculate second motion detection information indicating a motion of an object based on successively captured images; and
a control unit configured to correct a movement amount relating to the motion of the object indicated by the second motion detection information in the images of a plurality of frames corresponding to a predetermined period based on the first motion detection information corresponding to each frame based on the first motion detection information, and calculate a motion vector of a main object based on the corrected movement amount, and
wherein the control unit adds a frequency of the corrected movement amount relating to the motion of the object for the images of the plurality of frames and calculates the motion vector of the main object based on a frequency distribution obtained through the addition.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein the control unit extracts the movement amount relating to the motion of the main object and calculates the motion vector of the main object based on the frequency distribution obtained through addition of the movement amount and the motion of the imaging apparatus body indicated by the first motion detection information.

### Claim 3 (depends on 2)

The image processing apparatus according to claim 2, wherein the control unit determines the movement amount relating to the motion of the imaging apparatus body indicated by the first motion detection information as a movement amount of a background and extracts, as the movement amount relating to the motion of the main object, a movement amount corresponding to a peak different from a peak corresponding to the movement amount of the background among peaks exhibited in the frequency distribution obtained through the addition.

### Claim 4 (depends on 2)

The image processing apparatus according to claim 2, wherein the control unit determines whether or not the, movement amount of the main object is detectable from the frequency distribution of the movement amount corresponding to the latest frame among the plurality of frames, and
wherein, if the movement amount of the main object is not detectable from the frequency distribution of the movement amount corresponding to the latest frame, the control unit sequentially adds the corrected movement amount corresponding to the previous frame to the movement amount corresponding to the image of the latest frame until the movement amount of the main object is detectable from the frequency distribution obtained through the addition of the movement amount.

### Claim 5 (depends on 1)

The image processing apparatus according to claim 1, wherein the first calculation unit is a gyroscopic sensor configured to calculate an angular velocity as the first motion detection information.

### Claim 6 (depends on 1)

The image processing apparatus according to claim 1, wherein the second calculation unit is configured to divide the successively captured images into blocks and calculate the second motion detection information indicating the motion of the object by comparing each block on a pixel basis.

### Claim 7

A method of controlling processing apparatus, the method comprising:
calculating first motion detection information indicating a motion of an imaging apparatus body based on information detected by an angular velocity detection unit;
calculating second motion detection information indicating a motion of an object based on successively captured images; and
correcting a movement amount relating to the motion of the object indicated by the second motion detection information in the images of a plurality of frames corresponding to a predetermined period based on the first motion detection information corresponding to each frame based on the first motion detection information, and calculating a motion vector of a main object based on the corrected movement amount; and
adding a frequency of the corrected movement amount relating to the motion of the object for the images of the plurality of frames and calculating the motion vector of the main object based on a frequency distribution obtained through the addition.