Image fusion method for multiple lenses and device thereof

An image fusion method for multiple lenses, adapted for an image fusion device with a plurality of lenses, and the image fusion method comprising:

• taking a plurality of parallax images with different focal distances through the lenses;
• analysing a plurality of feature points of the parallax images;
• calculating matching relationships among the feature points of the parallax images;
• moving each parallax image according to the matching relationships, to adjust a same image portion of each parallax image to a same image position;
• and
• fusing the moved result of the parallax images, to generate a fusion image;
• wherein in the step of moving each parallax image, further comprises:
• respectively selecting two of the parallax images as an image group to be matched, wherein each parallax image is at least selected once;
• in each image group to be matched, selecting one of the parallax images as a first image, selecting the other of the parallax images as a second image, and the first image and the second image having a same sub-image;
• in each image group to be matched, calculating a first movement quantity of the second image according to the matching relationships, wherein the first movement quantity is related to a distance of the sub-image of the second image moving to the sub-image of the first image;
• in each image group to be matched, moving the second image according to the first movement quantity;
• in each image group to be matched, fusing the moved result of the image group to be matched, to generate a fusion sub-image, wherein each of the fusion sub-images has the same image portion;
• analyzing a plurality of feature sub-points of the fusion sub-images, and calculating matching sub-relationships among the feature sub-points of the fusion sub-images;
• and
• moving each fusion sub-image according to the matching sub-relationships, to adjust the same image portion of each fusion sub-image to the image position.

An image fusion device for multiple lenses, comprising:

• a plurality of lenses;
• an image capture, electrically connected to the lenses, and configured for taking a plurality of parallax images with different focal distances through the lenses;
• an image processor, electrically connected to the image capture, configured for receiving the parallax images, and executing the following steps:
• analyzing a plurality of feature points of the parallax images;
• calculating matching relationships among the feature points of the parallax images;
• moving each parallax image according to the matching relationships, to adjust a same image portion of each parallax image to a same image position;
• fusing the moved result of the parallax images, to generate a fusion image;
• and
• removing an unnecessary image configured in the edge of the fusion image, to generate the corrected fusion image;
• wherein in the step of the image processor moving each parallax image, further comprises:
• selecting one of the parallax images as a primary image, and the same image portion of the primary image being located on the image position;
• calculating a movement quantity of each unselected parallax image according to the matching relationships, wherein the movement quantity is related to a distance of the same image portion of the corresponding parallax image moving to the image position;
• and
• moving the corresponding parallax image according to each movement quantity.

An image fusion device for multiple lenses, comprising:

• a plurality of lenses;
• an image capture, electrically connected to the lenses, and configured for taking a plurality of parallax images with different focal distances through the lenses;
• an image processor, electrically connected to the image capture, configured for receiving the parallax images, and executing the following steps:
• analyzing a plurality of feature points of the parallax images;
• calculating matching relationships among the feature points of the parallax images;
• moving each parallax image according to the matching relationships, to adjust a same image portion of each parallax image to a same image position;
• fusing the moved result of the parallax images, to generate a fusion image;
• and
• removing an unnecessary image configured in the edge of the fusion image, to generate the corrected fusion image;
• wherein in the step of the image processor moving each parallax image, further comprises:
• respectively selecting two of the parallax images as an image group to be matched, wherein each parallax image is at least selected once;
• in each image group to be matched, selecting one of the parallax image as a first image, selecting the other of the parallax image as a second image, and the first image and the second image having a same sub-image;
• in each image group to be matched, calculating a first movement quantity of the second image according to the matching relationships, wherein the first movement quantity is related to a distance of the sub-image of the second image moving to the sub-image of the first image;
• in each image group to be matched, moving the second image according to the first movement quantity;
• in each image group to be matched, fusing the moved result of the image group to be matched, to generate a fusion sub-image, wherein each of the fusion sub-images has the same image portion;
• analyzing a plurality of feature sub-points of the fusion sub-images, and calculating matching sub-relationships among the feature sub-points of the fusion sub-images;
• and
• moving each fusion sub-image according to the matching sub-relationships, to adjust the same image portion of each fusion sub-image to the image position.