Apparatus and method for generating new viewpoint image using few-shot 2D images

A method of generating a new viewpoint image using few-shot 2D images, comprising:

• a full-image intrinsic decomposing operation of receiving the few-shot 2D images, intrinsically decomposing each input image, and extracting albedo representing intrinsic color information from each 2D input image;
• a patch image intrinsic decomposing operation of learning using the albedo extracted in the full-image intrinsic decomposing operation, and learning to minimize an albedo consistency loss, intrinsically decomposing a color value synthesized in the form of patch from a new viewpoint using the few-shot 2D input images during learning, and extracting patch-wise albedo;
• an aligning operation of performing geometric alignment necessary for pixel correspondence between a new viewpoint image and a 2D input image selected from the few-shot 2D input images using a depth value synthesized in the form of patch from the new viewpoint, calculating an albedo consistency loss between the albedo extracted in the full-image intrinsic decomposing operation and the patch-wise albedo extracted in the patch image intrinsic decomposing operation based on the pixel correspondence, and provide the albedo consistency loss to the patch image intrinsic decomposing operation;
• and
• an image generating operation of generating the new viewpoint image from the few-shot 2D input images by intrinsically decomposing the color value synthesized in the form of patch from the new viewpoint using the few-shot 2D input images and reflecting the extracted patch-wise albedo, after the learning is finished.