# US 2016/0253780 A1 · Image processing apparatus, image processing method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253780 A1
- Document ID: US20160253780A1
- Status: Published application
- Kind: A1
- Application number: 15/051,462
- Filed: 2016-02-23
- Published: 2016-09-01
- Earliest claimed: 2015-02-26
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Kazunari Iwamoto
- Web page: https://patentgrep.com/patent/US20160253780A1

## CPC

- G06T 5/80: Geometric correction
- G06T 3/08: Projecting images onto non-planar surfaces, e.g. geodetic screens
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing apparatus includes an acquisition unit configured to acquire information for identifying a position of a plane in a captured image, where the captured image includes a structure composed of a plurality of planes as an object, a determination unit configured to determine a correspondence relationship between a region corresponding to the plane in the captured image and a region in an overhead image to be created, according to the information acquired by the acquisition unit, and a generation unit configured to correct an image of the region corresponding to the plane in the captured image so that the corrected image corresponds to the region in the overhead image to be created, according to the correspondence relationship determined by the determination unit, and generate an overhead image composed of a plurality of corrected images that are combined with each other.

## Claims

### Claim 1

An image processing apparatus comprising:
an acquisition unit configured to acquire information for identifying a position of a plane in a captured image, the captured image including a structure composed of a plurality of planes as an object;
a determination unit configured to determine a correspondence relationship between a region corresponding to the plane in the captured image and a region in an overhead image to be created, according to the information acquired by the acquisition unit; and
a generation unit configured to correct an image of the region corresponding to the plane in the captured image so that the corrected image corresponds to the region in the overhead image to be created, according to the correspondence relationship determined by the determination unit, and generate an overhead image composed of a plurality of corrected images that are combined with each other.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein the acquisition unit acquires information for identifying a position of a vertex of the plane as the information for identifying a position of the plane.

### Claim 3 (depends on 2)

The image processing apparatus according to claim 2,
wherein, based on the information acquired by the acquisition unit, the determination unit identifies points corresponding to positions of vertexes of the plane on a spherical coordinate that corresponds to an image-capturing range of an image-capturing unit that captures the captured image,
wherein the determination unit corrects positions of the points on the spherical coordinate to form a three-dimensional shape having the points on the spherical coordinate as the vertexes, into a predetermined three-dimensional shape, and
wherein the generation unit generates the overhead image by making a region in the captured image corresponding to the positions of the points corrected by the determination unit, as a region corresponding to the plane.

### Claim 4 (depends on 3)

The image processing apparatus according to claim 3, wherein the determination unit corrects the positions of the points on the spherical coordinate to form the three-dimensional shape having the points on the spherical coordinate as the vertexes into a rectangular parallelepiped.

### Claim 5 (depends on 3)

The image processing apparatus according to claim 3, further comprising a storage unit configured to store information of a plurality of three-dimensional shapes,
wherein the determination unit selects a predetermined three-dimensional shape from the plurality of the three-dimensional shapes.

### Claim 6 (depends on 5)

The image processing apparatus according to claim 5, wherein the determination unit selects the predetermined three-dimensional shape based on a number of points corresponding to the positions of the vertexes of the plane.

### Claim 7 (depends on 3)

The image processing apparatus according to claim 3, wherein the generation unit corrects images of regions corresponding to a plurality of planes in the captured image so that the images correspond to the planes of the predetermined three-dimensional shape formed by connecting the plurality of the points corrected by the correction unit.

### Claim 8 (depends on 1)

The image processing apparatus according to claim 1, wherein the acquisition unit acquires a position specified by a user with respect to the captured image as the information for identifying a position of the plane.

### Claim 9 (depends on 1)

The image processing apparatus according to claim 1, wherein the acquisition unit detects an object having a predetermined color or pattern from the captured image and acquires a position of the object having the predetermined color or pattern as the information for identifying a position of the plane.

### Claim 10 (depends on 1)

The image processing apparatus according to claim 1, wherein the generation unit generates the overhead image on which an image representing a position of the image-capturing unit for capturing the captured image is superimposed.

### Claim 11 (depends on 1)

The image processing apparatus according to claim 1, wherein the generation unit generates the overhead image on which an image representing an image-capturing direction of the image-capturing unit for capturing the captured image is superimposed.

### Claim 12 (depends on 1)

The image processing apparatus according to claim 1, further comprising a transmission unit configured to transmit the overhead image generated by the generation unit to the image-capturing unit for capturing the captured image, via a network.

### Claim 13

An image processing method comprising:
acquiring information for identifying a position of a plane in a captured image, the captured image including a structure composed of a plurality of planes as an object;
determining a correspondence relationship between a region corresponding to the plane in the captured image and a region in an overhead image to be created, according to the information acquired by the acquisition unit; and
correcting an image of the region corresponding to the plane in the captured image so that the corrected image corresponds to the region in the overhead image to be created, according to the correspondence relationship determined by the determination unit, and generating an overhead image composed of a plurality of corrected images that are combined with each other.

### Claim 14

A non-transitory computer readable storage medium storing a program for causing a computer to function as:
an acquisition unit configured to acquire information for identifying a position of a plane in a captured image, the captured image including a structure composed of a plurality of planes as an object;
a determination unit configured to determine a correspondence relationship between a region corresponding to the plane in the captured image and a region in an overhead image to be created, according to the information acquired by the acquisition unit; and
a generation unit configured to correct an image of the region corresponding to the plane in the captured image so that the corrected image corresponds to the region in the overhead image to be created, according to the correspondence relationship determined by the determination unit, and generate an overhead image composed of a plurality of corrected images that are combined with each other.
