Back to results
US 2020/0288102 A1Published application
Image processing method and apparatus
AssigneeElectronics and Telecommunications Research Institute
InventorsGi Mun UM, Joung Il YUN
Life of this patent
Estimating the term…
Abstract
Provided are an image processing method and apparatus for generating a three-dimensional (3D) virtual viewpoint image by combining multi-view depth map on a 3D space through depth clustering. In the image processing method and apparatus, pieces of color and depth information are stored in units of depth clusters to minimize influences of occlusion regions and holes during generating of the virtual viewpoint image.
Claims15
An image processing method comprising:
- obtaining a multi-view depth map of a plurality of viewpoint images and determining depth reliability of each point on the multi-view depth map;
- mapping each of the plurality of viewpoint images to a three-dimensional (3D) point cloud on a reference coordinate system;
- generating at least one depth cluster by performing depth clustering of each 3D point on the 3D point cloud on the basis of the depth reliability;
- and
- creating a virtual viewpoint image by projecting each 3D point on the 3D point cloud to a virtual viewpoint for each depth cluster.
2 more elements
A depth clustering-based image processing method comprising:
- mapping a plurality of viewpoint images to a three-dimensional (3D) point cloud on a 3D coordinate space;
- and
- generating at least one depth cluster by grouping each 3D point on the basis of depth reliability and a chrominance of each 3D point on the 3D point cloud while moving an XY plane perpendicular to a depth axis of the 3D coordinate space along the depth axis.
An image processing apparatus comprising:
- a plurality of cameras configured to capture images of different viewpoints;
- and
- a processor,
- wherein the processor is configured to:
- obtain a multi-view depth map of a plurality of viewpoint images and determine depth reliability of each point on the multi-view depth map;
- map each of the plurality of viewpoint images to a three-dimensional (3D) point cloud on a reference coordinate system;
- generate at least one depth cluster by performing depth clustering of each 3D point on the 3D point cloud on the basis of the depth reliability;
- and
- create a virtual viewpoint image by projecting each 3D point on the 3D point cloud to a virtual viewpoint for each depth cluster.
6 more elements
Dependencies are inferred from the claim text.