US 9,436,986 B2 · Image processing apparatus and image processing method

Abstract

An image processing apparatus that obtains a synthesized image of a subject viewed from an arbitrary viewpoint includes a calculator, a storage, and a synthesizer. The calculator calculates a correction value for a pixel value of a pixel that partially constitutes the picked-up images on the basis of a brightness of each of the plurality of picked-up images. The storage stores the correction value for each of the pixels. The synthesizer obtains a pixel value of a pixel in the synthesized image that corresponds to the pixel that partially constitutes the picked-up images by correcting a pixel value of the pixel that partially constitutes the picked-up images on the basis of a positional relationship of the pixel in the picked-up images, a correspondence relationship between the picked-up images and the synthesized image, and the correction value, and thereby generates the synthesized image.

Claims15

Dependent claims

An image processing apparatus that generates a synthesized image of a subject viewed from an arbitrary viewpoint from a plurality of picked-up images obtained by picking up images of surroundings of the subject in different directions, the image processing apparatus comprising

a computer which includes a processor that performs a process including:
a calculation process that calculates a correction value for a pixel value of a pixel that partially constitutes the picked-up images on the basis of a brightness of each of the plurality of picked-up images;
a storage process that stores to a storage of the computer the correction value calculated by the calculation process for each of the pixels;
and
a synthesization process that corrects a pixel value of the pixel that partially constitutes the picked-up images on the basis of a positional relationship of the pixel in the picked-up images, a correspondence relationship between the picked-up images and the synthesized image, and the correction value stored in the storage to obtain a pixel value of a pixel in the synthesized image that corresponds to the pixel that partially constitutes the picked-up images, and thereby generates the synthesized image.

2 more elements

An image processing method by which a synthesized image of a subject viewed from an arbitrary viewpoint is generated from a plurality of picked-up images obtained by picking up images of surroundings of the subject in different directions, the image processing method comprising:

a processor, which included in a computer, that
calculates a correction value for a pixel value of a pixel that partially constitutes the picked-up images on the basis of a brightness of each of the plurality of picked-up images and storing the correction value in a storage of the computer for each of the pixels;
and
corrects a pixel value of the pixel that partially constitutes the picked-up images on the basis of a positional relationship of the pixel in the picked-up images, a correspondence relationship between the picked-up images and the synthesized image and the correction value stored in the storage, obtaining a pixel value of a pixel in the synthesized image that corresponds to the pixel that partially constitutes the picked-up images, and thereby generates the synthesized image.

1 more element

A computer-readable, non-transitory storage medium storing a program for causing a computer to execute a process of generating a synthesized image of a subject viewed from an arbitrary viewpoint from a plurality of picked-up images obtained by picking up images of surroundings of the subject in different directions, the process comprising:

calculating a correction value for a pixel value of a pixel that partially constitutes the picked-up images on the basis of a brightness of each of the plurality of picked-up images and storing the correction value in a storage of the computer for each of the pixels;
and
correcting a pixel value of the pixel that partially constitutes the picked-up images on the basis of a positional relationship of the pixel in the picked-up images, a correspondence relationship between the picked-up images and the synthesized image and the correction value stored in the storage, obtaining a pixel value of a pixel in the synthesized image that corresponds to the pixel that partially constitutes the picked-up images, and thereby generating the synthesized image.

Dependencies are inferred from the claim text.

Image processing apparatus and image processing method

Life of this patent

Image processing apparatus and image processing method

Life of this patent

Abstract

Claims15