US 10,097,772 B2Granted

Image processing device and image processing method

AssigneeMitsubishi Electric Corporation

InventorsYohei Miki, Ichiro Furuki, Toshiharu Aiura

Life of this patent

Estimating the term…

Loading patent…

Abstract

A subject detecting unit 107 calculates a subject position on the basis of a subject region obtained by calculating the difference between an overhead image generated from an image for difference calculation stored in an image for difference calculation storage unit 106 and an overhead image generated by an overhead image generating unit 105. A projection plane calculating unit 108 forms a projection plane at the subject position, and a subject image generating unit 109 projects camera images of image taking devices 1a to 1c onto the projection plane, and generates a subject image. A display image generating unit 110 outputs to a display 2 an image formed by synthesizing the subject image with the overhead images generated by the overhead image generating unit 105.

Claims3

Dependent claims

An image processing device comprising:

an image acquirer acquiring an image taken with at least one image taking device;
a processor configured to perform the functions of:
an overhead image generator calculating on a basis of image taking device information regarding the at least one image taking device and space information regarding a space whose image is taken with the at least one image taking device, correspondence between pixel data constituting the image and the space, and generating overhead image from the image based on the correspondence;
an object detector detecting a position of an object on which corresponding information does not exist in the space information;
a projection plane calculator calculating a projection plane at the position of the object;
an object image generator generating an object image of the object looked at from a viewpoint position of the overhead image by setting the image onto the projection plane;
a display image generator generating an image by synthesizing the object image with the overhead image;
and
an overhead image for difference calculation generator generating overhead images for difference calculation from images for difference calculation by calculating correspondence between pixel data constituting the images for difference calculation taken with a plurality of image taking devices included in the at least one image taking device and taking a plurality of images respectively and the space on the basis of the image taking device information and the space information, wherein
the overhead image generator generates the overhead images from the images taken with the plurality of the image taking devices, respectively;
the overhead image for difference calculation generator generates the overhead images for difference calculation from the images for difference calculation taken with the plurality of image taking devices;
and
the object detector obtains an object region from a difference between the overhead image and the overhead image for difference calculation for each of the at least one image taking device, and detects a superimposed portion of the object regions as the position of the object.

10 more elements

An image processing method comprising:

acquiring an image taken with at least one image taking device;
calculating on a basis of image taking device information regarding the at least one image taking device and space information regarding a space whose image is taken with the at least one image taking device, correspondence between pixel data constituting the image and the space, and generating overhead images from the image based on the correspondence;
detecting a position of an object which does not have the space information corresponding to the object;
calculating a projection plane at the position of the object;
setting the image onto the projection plane, and generating an object image of the object looked at from a viewpoint position of the overhead image;
and
generating an image by synthesizing the object image with the overhead image;
and
generating overhead images for difference calculation from images for difference calculation by calculating correspondence between pixel data constituting the images for difference calculation taken with a plurality of image taking devices included in the at least one image taking device and taking a plurality of images respectively and the space on the basis of the image taking device information and the space information, wherein
in the generating overhead images from the image based on the correspondence, the overhead images are generated from the images taken with the plurality of the image taking devices, respectively;
in the generating overhead images for difference calculation, the overhead images for difference calculation are generated from the images for difference calculation taken with the plurality of image taking devices;
and
in the detecting, an object region is obtained from a difference between the overhead image and the overhead image for difference calculation for each of the at least one image taking device, and a superimposed portion of the object regions is detected as the position of the object.

10 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/502,879Filed 31 Oct 2014
Published: US 2017/0237909 A117 Aug 2017
Granted: 9 Oct 2018
Term ends: Not estimatedThe source records don’t support an estimate.

Classification14 codes

H04N 5/2628
Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the…:…
G06T 3/053
Context-preserving transformations, e.g. by using an importance map: detail-in-context presentations
G06T 5/50
Image enhancement or restoration: using two or more images, e.g. averaging or subtraction
G06T 7/33
Determination of transform parameters for the alignment of images, i.e. image registration: using feature-based methods