Method for synthesizing intermediate image using mesh based on multi-view square camera structure and device using the same and computer-readable medium having thereon program performing function embodying the same

An intermediate image-synthesizing device using a mesh based on a multi-view square camera structure, the device comprising:

• distance-matching means for identifying an overlapping area where an intermediate image to be synthesized and three reference images adjacent to the intermediate image overlap;
• mesh-mapping means for extracting a vertex based on an outline of an object by considering a position characteristic of a difference obtained according to the overlapping area to construct the mesh;
• block-matching means for performing block-matching based on an epipolar line for obtaining a disparity vector with respect to the vertex, the block-matching being carried out by a unit of a predetermined block designated on the epipolar line having the vertex as a center;
• image-compensating means for compensating an image of the overlapping area in which an image conversion and an image deformation is performed based on the reference images according to a result of the block-matching;
• and
• image-synthesizing means for synthesizing the intermediate image by integrating the compensated image of the overlapping area,
• wherein the mesh-mapping means performs:
• detecting the outline of the object in one of the reference images;
• extracting the vertex in the detected outline by scanning the one of the reference images adjacent to the outline by a window having a predetermined size so that a single vertex exists in the window;
• and
• forming the mesh with respect to the one of the reference images based on the extracted vertex.

A computer-readable medium having thereon a program performing function of embodying an intermediate image synthesis using mesh based on multi-view square camera structure, the program performing functions of:

• performing distance-matching in which an overlapping area where an intermediate image to be synthesized and three reference images adjacent to the intermediate image overlap is identified;
• performing mesh-mapping in which a vertex is extracted based on an outline of an object by considering a position characteristic of a difference obtained according to the overlapping area, and the mesh is constructed using the vertex;
• performing block-matching based on an epipolar line to obtain a disparity vector with respect to the vertex, the block-matching being carried out by a unit of a predetermined block designated on the epipolar line having the vertex as a center;
• performing image-compensating for compensating an image of the overlapping area in which an image conversion and an image deformation is performed based on the reference images according to a result of the block-matching;
• and
• performing image-synthesizing for synthesizing the intermediate image by integrating the compensated image of the overlapping area,
• wherein the performing mesh-mapping comprises:
• detecting the outline of the object in one of the reference images;
• extracting the vertex in the detected outline by scanning the one of the reference images adjacent to the outline by a window having a predetermined size so that a single vertex exists in the window;
• and
• forming the mesh with respect to the one of the reference images based on the extracted vertex.