Image fusion method and apparatus using multi-spectral filter array sensor

An image fusion apparatus using a multi-spectral filter array sensor, the image fusion apparatus comprising at least one processor to implement:

• a separation unit configured to separate an input image input through the multi-spectral filter array sensor into an RGB image and a near infrared (NIR) image;
• a color reconstruction unit configured to extract an RGB image in a visible band by removing an NIR value incident together with R, G and B values through the multi-spectral filter array sensor from the R, G and B values;
• and
• an image fusion unit configured to fuse the RGB image in the visible band with the NIR image, in which a fusion rate of the RGB image and the NIR image is based on a size of each of the R, G and B values of the RGB image in the visible band,
• wherein the image fusion unit is further configured to adjust the fusion rate according to local or global characteristics of the input image, and
• wherein respective color channels R′, G′, and B′ fused by the image fusion unit are given by:
• R′=N×(1−α)×R/(R+G+B)+N×α
• G′=N×(1−α)×G/(R+G+B)+N×α
• B′=N×(1−α)×B/(R+G+B)+N×α,
• where α is implemented to be changed according to the local or global characteristics of the input image.

An image fusion method using a multi-spectral filter array sensor, the image fusion method comprising:

• extracting an RGB image in a visible band from an RGB image input through the multi-spectral filter array sensor;
• receiving input of an NIR image through an NIR filter of the multi-spectral filter array sensor;
• calculating a size of each of R, G and B values of the RGB image in the visible band;
• and
• fusing the RGB image in the visible band with the NIR image according to the calculated size of each of R, G, and B pixels,
• wherein respective color channels R′, G′, and B′ fused in the fusing are given by:
• (
• R
• ′
• G
• ′
• B
• ′
• )
• =
• (
• 1
• +
• k
• 0
• 0
• 0
• 1
• +
• k
• 0
• 0
• 0
• 1
• +
• k
• )
• ·
• (
• R
• G
• B
• )
• ,
• where
• k
• =
• 3
• ⁢
• N
• R
• +
• G
• +
• B
• ,
• and N indicates the NIR image.

An image fusion method using a multi-spectral filter array sensor, the image fusion method comprising:

• extracting an RGB image in a visible band from an RGB image input through the multi-spectral filter array sensor;
• receiving input of an NIR image through an NIR filter of the multi-spectral filter array sensor;
• calculating a size of each of R, G and B values of the RGB image in the visible band;
• and
• fusing the RGB image in the visible band with the NIR image according to the calculated size of each of R, G, and B pixels,
• wherein in the fusing the RGB image in the visible band with the NIR image, a fusion rate of the two images is adjusted according to local or global characteristics of the input image, and
• wherein respective color channels R′, G′, and B′ fused by the fusing the RGB image in the visible band with the NIR image are given by:
• R′=N×(1−α)×R/(R+G+B)+N×α
• G′=N×(1−α)×G/(R+G+B)+N×α
• B′=N×(1−α)×B/(R+G+B)+N×α,
• where α is implemented to be changed according to the local or global characteristics of the input image.