Method and apparatus to compress multi-spectral images to a single color image for display
AssigneeLockheed Martin Missiles & Space Company
InventorDonald F. Specht
Life of this patent
Estimating the term…
Loading patent…
AssigneeLockheed Martin Missiles & Space Company
InventorDonald F. Specht
Estimating the term…
A method and apparatus enhance visible contrast within an acquired image for display. The contrast enhancement utilizes all N bands of an original N-band spectral image to produce an M-dimensional enhanced image for display. The method creates an enhanced image from an original image in which the visible contrast in the original image is improved. The original image includes pixels, each pixel having N spectral intensities. The display or printer device which must display the relevant information may be limited to a number of bands M which is smaller than N. Maximum contrast of objects is obtained by emphasizing differences in the N-dimensional pixels by as large differences as possible within the dynamic range of the M-band display space. When M=N=3, this means moving pixels in the display space to utilize the full color palette available on a color monitor or printer. When N>M, a mapping from N space to M space must also be accomplished. In the methods of this patent, the mapping process and the spreading process are accomplished in the same algorithms. Clustering of the raw pixel data is usually used to reduce the computational requirements of the spreading step. Finally, in a creating step, an enhanced image is produced based on the N spectral intensities of each pixel and the N to M mapping developed by the algorithms.
A method of enhancing visible contrast in an image, comprising the steps of:
An apparatus for improving the contrast of images, comprising:
A computer program product for causing an image processor to enhance visible contrast in an image, the image including a plurality of pixels, each pixel having N spectral intensities, comprising a computer useable medium having computer program logic stored therein, wherein the computer program logic comprises:
Dependencies are inferred from the claim text.
No related US applications are recorded in the indexed filing history.
The present invention relates generally to image processing techniques. In particular, the invention relates to techniques for gathering image data at N different frequencies or frequency bands and mapping the non-redundant image data into a format suitable for display on a color display screen or printer using a finite number of colors, such as combinations of red, green and blue or on a black and white display or printer as gray-scales.
Image processing is commonly used to acquire, manipulate, store and display images. It has many useful applications, which illustratively include the areas of photographic processing, photographic restoration and enhancement, medical imaging using x-ray and other frequencies of interest, and satellite imaging for capturing features on the earth's surface, to name a few. The images acquired are typically digitized into imaging data prior to processing, either directly through the use of a digital camera or indirectly by scanning a pre-existing image.
Imaging data generally consists of an array of pixels, where each pixel represents a position on the image and a spectral profile of the position. The spectral profile is represented by an N-dimensional vector having N spectral intensities. For many applications, N is 3 and each of the three spectral intensities represents a respective intensity in the visible light portion of the spectrum, such as red, green or blue color. Combinations of red, green and blue intensities may be perceived as a large range of colors in the visible spectrum. For other applications, N may be greater or less than 3 and the respective spectral intensities may be measured within and outside of the visible portion of the electromagnetic spectrum. For example, in the case of the TMS and MAMS imaging sensors, N is 11 and includes frequencies in the infra-red portion of the electromagnetic spectrum. In the case of AVIRIS imaging data, N is 224 and includes a wide range of frequencies. AVIRIS and similar sensor data may include sufficient spectral information on the materials represented in the imaging data to allow classification of the materials.
These and other objects, features and advantages of the invention will be more fully appreciated with reference to the detailed description and appended drawing figures.
FIG. 1 depicts an image processor coupled to peripheral devices.
FIG. 2 depicts a method of mapping N spectral bands to M bands with contrast enhancement according to the present invention.
In the following sections, several embodiments of image contrast enhancement according to the present invention are illustratively described. Three different neural network approaches will be described to accomplish these objectives. The three are Input Training using the General Regression Neural Network (IT-GRNN), Input Training using the Back-Propagation Neural Networks (IT-BPNN), and the Auto Associative Neural Network (AANN). The same concept of mapping image data to a lower dimensional space and/or spreading the data to fill the display space can be expressed in terms of Fuzzy Logic, Genetic Algorithms, applied Statistics, and other neural networks.
Image Processing and Multi-Dimensional Contrast Enhancement
N co-registered spectral bands of an object captured by a camera can contain more useful information than the number of bands, M, which can be conveniently displayed on a monitor or a printer. The number of available bands is typically 3 for a color monitor or printer. However, the number may be 1 for a black and white monitor or printer, or possibly just 2 bands if one band is dedicated to overlay information, for example. What is desired is to distill as much as possible of the non-redundant information from the N spectral bands into M color planes for display, where N is greater than or equal to M. There are several methods to achieve this according to the present invention. One preferred method is to use a neural network to compress the information from N dimensions to M dimensions under the control of a fidelity constraint.
Image enhancement or restoration: using two or more images, e.g. averaging or subtraction
Image enhancement or restoration: using machine learning, e.g. neural networks
Dynamic range modification of images or parts thereof: based on global image properties
Processing of colour picture signals: colour correction or control
Term ended 11 Mar 2019 (estimated)
USPTO file history isn’t available for this patent, so only indexed dates are shown.