View extrapolation method using epipolar plane image
AssigneeGIST(Gwangju Institute of Science and Technology)
InventorsHae-Gon Jeon, Hyunjun Jung
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to a method of inferring an epipolar plane image and extrapolating a view of a target image using the epipolar plane image. A view extrapolation method using an epipolar plane image according to an embodiment of the present disclosure includes: creating an Epipolar Plane Image (EPI) using a target image and a depth map corresponding to the target image; creating a super-resolution EPI and a disparity of the EPI on the basis of the EPI; creating an EPI mask by warping the super-resolution EPI in accordance with the disparity; and creating a restored EPI by applying the EPI mask to the warped super-resolution EPI, and creating an extrapolated image for the target image using the restored EPI.
Claims9
A view extrapolation method using an epipolar plane image, the view extrapolation method comprising:
- creating an Epipolar Plane Image (EPI) using a target image and a depth map corresponding to the target image;
- creating a super-resolution EPI and a disparity of the EPI on the basis of the EPI;
- creating an EPI mask by warping the super-resolution EPI in accordance with the disparity;
- and
- creating a restored EPI by applying the EPI mask to the warped super-resolution EPI, and creating an extrapolated image for the target image using the restored EPI,
- wherein the creating of an EPI mask includes creating an EPI mask of which a value is determined by a coordinate of a pixel that is propagated in accordance with the disparity when the super-resolution EPI is warped,
- wherein the creating of a restored EPI includes:
- creating a masked EPI by performing element-wise multiplication on the EPI mask and the warped super-resolution EPI;
- and
- creating the restored EPI by restoring the masked EPI, and
- wherein the creating of a restored EPI includes creating the restored EPI by inputting the masked EPI to a Generative Adversarial Network (GAN).
Dependencies are inferred from the claim text.