Image processing device, image processing method, program, and integrated circuit
AssigneePanasonic Intellectual Property Management Co., Ltd.
InventorsMasaki Maeda, Naoki Ootani, Kazuhiro Nomura
Life of this patent
Estimating the term…
Abstract
A depth image conversion unit 101 moves an edge location in an input depth image towards the background. A pixel shift unit 102 generates an image from a different viewpoint by horizontally shifting the coordinates of each pixel in an image based on the converted depth image. A pixel interpolation unit 103 interpolates the missing pixel region yielded by pixel shifting.
Claims15
An image processing device for generating images from multiple viewpoints, by shifting coordinates of pixels in an original image, in order to provide depth indicated by a depth image composed of a pixel region formed by a plurality of pixels, a value of each pixel in the depth image indicating the depth of a corresponding pixel in the original image, the image processing device comprising:
- a depth image conversion unit configured to convert the depth image by searching within the pixel region composing the depth image for edge pixels that constitute an edge of an object and shifting, in a predetermined direction, coordinates of pixels in the depth image that are surrounded by the edge pixels;
- a pixel shift unit configured to generate a viewpoint image from a different viewpoint than the original image by calculating a parallax that provides the depth indicated by the depth image converted by the depth image conversion unit and shifting the coordinates of pixels in the original image by a number of pixels corresponding to the parallax;
- and
- a pixel interpolation unit configured to interpolate an occlusion, occurring due to pixel shifting, in the generated viewpoint image.
An image processing method for generating images from multiple viewpoints by shifting coordinates of pixels in an original image in order to provide depth indicated in a depth image composed of a pixel region formed by a plurality of pixels, a value of each pixel in the depth image indicating the depth of a corresponding pixel in the original image, the image processing method comprising the steps of:
- converting the depth image by searching within the pixel region composing the depth image for edge pixels that constitute an edge of an object and shifting, in a predetermined direction, coordinates of pixels in the depth image that are surrounded by the edge pixels;
- generating a viewpoint image from a different viewpoint than the original image by calculating a parallax that provides the depth indicated by the depth image converted by the depth image conversion unit and shifting the coordinates of pixels in the original image by a number of pixels corresponding to the parallax;
- and
- interpolating an occlusion, occurring due to pixel shifting, in the generated viewpoint image.
A program for causing a computer to perform image processing for generating images from multiple viewpoints by shifting coordinates of pixels in an original image in order to provide depth indicated in a depth image composed of a pixel region formed by a plurality of pixels, a value of each pixel in the depth image indicating the depth of a corresponding pixel in the original image, the program causing the computer to perform the steps of:
- converting the depth image by searching within the pixel region composing the depth image for edge pixels that constitute an edge of an object and shifting, in a predetermined direction, coordinates of pixels in the depth image that are surrounded by the edge pixels;
- generating a viewpoint image from a different viewpoint than the original image by calculating a parallax that provides the depth indicated by the depth image converted by the depth image conversion unit and shifting the coordinates of pixels in the original image by a number of pixels corresponding to the parallax;
- and
- interpolating an occlusion, occurring due to pixel shifting, in the generated viewpoint image.
An integrated circuit used in image processing for generating images from multiple viewpoints by shifting coordinates of pixels in an original image in order to provide depth indicated in a depth image composed of a pixel region formed by a plurality of pixels, a value of each pixel in the depth image indicating the depth of a corresponding pixel in the original image, the integrated circuit comprising:
- a depth image conversion unit configured to convert the depth image by searching within the pixel region composing the depth image for edge pixels that constitute an edge of an object and shifting, in a predetermined direction, coordinates of pixels in the depth image that are surrounded by the edge pixels;
- a pixel shift unit configured to generate a viewpoint image from a different viewpoint than the original image by calculating a parallax that provides the depth indicated by the depth image converted by the depth image conversion unit and shifting the coordinates of pixels in the original image by a number of pixels corresponding to the parallax;
- and
- a pixel interpolation unit configured to interpolate an occlusion, occurring due to pixel shifting, in the generated viewpoint image.
Dependencies are inferred from the claim text.