Systems and methods for multi-spectral image super-resolution

A method for image processing for increasing resolution of a multi-spectral image, comprising:

• acquiring a multi-spectral image including a set of images of a scene generated by sensors and either acquired by an input interface or from a computer readable memory, each image represents a channel defining a frequency band, such that an image of a channel has its frequencies within a frequency band of the channel;
• storing in a database of the computer readable memory, a set of dictionaries trained for different channels, such that a dictionary trained for a channel convolved with a structure of the image, produces a high-resolution image of the channel having a resolution greater than a resolution of the image of the channel;
• storing in another database of the computer readable memory, a set of filters trained for the different channels, such that a filter trained for a channel convolved with each image in the set of images, produces the structure of the image of the channel;
• processing the set of images of the different channels with the stored set of filters to produce a set of structures using a hardware processor in communication with the computer readable memory and the input interface;
• using the hardware processor to fuse, for each channel, the set of structures to produce a set of fused structures, wherein a fused structure of the channel is fused as a weighted combination of the set of structures using weights corresponding to the channel, such that the fused structures of the different channels are combined with different weights,
• processing the set of fused structures with corresponding dictionaries from the set of dictionaries, to produce a super-resolution multi-spectral image of the scene;
• and
• outputting the super-resolution multi-spectral image by an output interface to a communication network, or storing the super-resolution multi-spectral image in the computer readable memory.

A non-transitory computer readable storage medium embodied thereon a program executable by a computer for performing a method, the method is for image processing of images of a scene, comprising:

• acquiring a multi-spectral image including a set of images of a scene generated by sensors and either acquired by an input interface or from the storage medium, each image represents a channel defining a frequency band, such that an image of a channel has its frequencies within a frequency band of the channel;
• storing in a database of the storage medium, a set of dictionaries trained for different channels, such that a dictionary trained for a channel convolved with a structure of the image, produces a high-resolution image of the channel having a resolution greater than a resolution of the image of the channel;
• storing in another database of the storage medium, a set of filters trained for the different channels, such that a filter trained for a channel convolved with each image in the set of images, produces the structure of the image of the channel;
• processing the set of images of the different channels with the stored set of filters to produce a set of structures using the computer in communication with the storage medium and the input interface;
• using the computer to fuse, for each channel, the set of structures to produce a set of fused structures, wherein a fused structure of the channel is fused as a weighted combination of the set of structures using weights corresponding to the channel, such that the fused structures of the different channels are combined with different weights;
• processing the set of fused structures with corresponding dictionaries from the set of dictionaries, to produce a super-resolution multi-spectral image of the scene;
• and
• outputting the super-resolution multi-spectral image by an output interface to a communication network, or storing the super-resolution multi-spectral image in the storage medium.