Method of merging images and data processing device

A method of merging images, comprising:

• extracting feature points from input images and generating matching information indicating mapping relationships between feature points included in different input images;
• for each input image among the input images, determining a correlation value between feature points of the each input image and feature points of other input images among the input images based on the matching information;
• selecting, as a reference image, an input image among the input images having a highest correlation value;
• determining valid images among the input images by excluding noise images from the input images based on the matching information;
• determining a cost function based on the matching information such that coordinates of feature points of the reference image and homography matrices indicating transformations between the reference image and the valid images are set as independent parameters of the cost function;
• determining optimal homography matrices and optimal feature points corresponding to a minimum value of the cost function by adjusting feature points of the reference image and the homography matrices;
• determining a correction matrix indicating transformation between feature points of the reference image and the optimal feature points;
• generating synchronized images by aligning feature points of the valid images to a two-dimensional plane corresponding to the reference image using the correction matrix and the optimal homography matrices;
• and
• generating a merged image by merging the reference image and the synchronized images.

A data processing device comprising:

• a feature point generator configured to extract feature points from input images and generate matching information indicating mapping relationships between feature points included in different input images;
• a reference image selector configured to select a reference image among the input images based on the matching information;
• an image filter configured to determine valid images among the input images by excluding noise images from the input images based on the matching information;
• a synchronizer configured to perform a two-dimensional bundle adjustment to generate synchronized images by aligning the valid images to the reference image;
• and
• an image merger configured to generate a merged image by merging the reference image and the synchronized images.