# US 2014/0152862 A1 · Image processing apparatus, image pickup apparatus, image pickup system, image processing method, and non-transitory computer-readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0152862 A1
- Document ID: US20140152862A1
- Status: Published application
- Kind: A1
- Application number: 14/087,382
- Filed: 2013-11-22
- Published: 2014-06-05
- Earliest claimed: 2012-11-30
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Shin Takagi
- Web page: https://patentgrep.com/patent/US20140152862A1

## CPC

- H04N 23/6811: {based on the image signal}
- G06T 7/215: Motion-based segmentation
- G06T 7/32: using correlation-based methods
- G06T 2207/10148: Varying focus
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing apparatus includes a calculator configured to calculate coordinate conversion information for associating a position of a first image with a position of a second image, a region setting portion configured to set a first region in the first image and set a second region associated with the first region in the second image based on the coordinate conversion information, and an evaluation value obtaining portion configured to compare the first region with the second region to obtain an evaluation value.

## Claims

### Claim 1

An image processing apparatus comprising:
a calculator configured to calculate coordinate conversion information for associating a position of a first image with a position of a second image;
a region setting portion configured to set a first region in the first image and set a second region associated with the first region in the second image based on the coordinate conversion information; and
an evaluation value obtaining portion configured to compare the first region with the second region to obtain an evaluation value.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein the calculator calculates the coordinate conversion information based on a motion vector between the first image and the second image.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1, wherein the coordinate conversion information is a projection transform coefficient indicating a deformation of an object image.

### Claim 4 (depends on 1)

The image processing apparatus according to claim 1, wherein the evaluation value obtaining portion obtains the evaluation value without interpolating pixels included in the first region and the second region.

### Claim 5 (depends on 1)

The image processing apparatus according to claim 1, wherein the evaluation value obtaining portion normalizes the evaluation value in accordance with sizes of the first region and the second region.

### Claim 6 (depends on 1)

The image processing apparatus according to claim 1, wherein the evaluation value obtaining portion changes a weight for each pixel included in the second region to obtain the evaluation value.

### Claim 7 (depends on 1)

The image processing apparatus according to claim 1, wherein the evaluation value obtaining portion compares edge integral values of the in region and the second region with each other to obtain the evaluation value.

### Claim 8 (depends on 1)

The image processing apparatus according to claim 1, wherein the evaluation value obtaining portion compares differences between signal values of the first region and the second region to obtain the evaluation value.

### Claim 9 (depends on 1)

The image processing apparatus according to claim 1, wherein the region setting portion sets a region, which has each vertex at points obtained using the coordinate conversion information with respect to each vertex of the first region, as the second region.

### Claim 10 (depends on 1)

The image processing apparatus according to claim 1, wherein the region setting portion sets a region, which includes a pixel obtained using the coordinate conversion information with respect to a pixel included in the first region, as the second region.

### Claim 11 (depends on 1)

The image processing apparatus according to claim 1, wherein the evaluation value is used to obtain distance information.

### Claim 12 (depends on 1)

The image processing apparatus according to claim 1, wherein the evaluation value is used to determine a moving object region.

### Claim 13 (depends on 1)

An image pickup apparatus comprising:
an image pickup element configured to perform photoelectric conversion of an object image to obtain a first image and a second image; and
an image processing apparatus according to claim 1.

### Claim 14 (depends on 13)

An image pickup system comprising:
an image pickup optical system; and
an image pickup apparatus according to claim 13, configured to obtain the object image via the image pickup optical system.

### Claim 15

An image processing method comprising the steps of:
calculating coordinate conversion information for associating a position of a first image with a position of a second image;
setting a first region in the first image and setting a second region associated with the first region in the second image based on the coordinate conversion information; and
comparing the first region with the second region to obtain an evaluation value.

### Claim 16

A non-transitory computer-readable storage medium which stores an image processing program for causing an image processing apparatus to execute the steps of:
calculating coordinate conversion information for associating a position of a first image with a position of a second image;
setting a first region in the first image and setting a second region associated with the first region in the second image based on the coordinate conversion information; and
comparing the first region with the second region to obtain an evaluation value.
