Method and system for super resolution
AssigneeRamot at Tel-Aviv University Ltd.
InventorsDavid Mendlovic, Zeev Zalevsky
Life of this patent
Estimating the term…
Abstract
A method and system for enhancing the resolution of an image sensing device, including the steps of attaching a mask to a panel of detectors in an image sensing device, generating multiple fields of view, related to one another by sub-pixel shifts, acquiring multiple images with the image sensing device from the multiple fields of view, and combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images.
Claims65
A method for enhancing the resolution of an image sensing device, comprising the steps of:
- applying a periodically patterned mask to an image sensing device having a pixel sensitivity function, the device comprising a periodic array of detectors having at least one of a horizontal periodic spacing and a vertical periodic spacing,
- the periodically patterned mask having at least one of a horizontal period which is an integer multiple of said detectors' horizontal periodic spacing and a vertical period which is an integer multiple of the detectors' vertical periodic spacing,
- the mask modifying the pixel sensitivity function of the image sensing device, thereby to define a modified pixel sensitivity function of the device whose Fourier transform does not have zeros at frequencies that are between 0 and the maximal frequency at which no significant aliasing occurs;
- using the image sensing device with the mask to acquire multiple images of a scene from corresponding multiple fields of view related to one another by sub-pixel shifts, the multiple images defining sub-pixel samples;
- and
- combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images, including:
- computing a Fourier transform of said samples;
- dividing said Fourier transform of said samples by a Fourier transform of said modified pixel sensitivity function, thereby to define a quotient;
- and
- computing an inverse Fourier transform of the quotient, thereby to define the enhanced image.
A method for enhancing the resolution of an image sensing device, comprising the steps of:
- attaching a mask to a panel of detectors in an image sensing device, the mask being a fine transmission grating, the panel of detectors comprising a periodic array of detectors, and the mask being periodic with period equal to that of the periodic array of detectors;
- generating multiple fields of view, the multiple fields of view being related to one another by sub-pixel shifts;
- acquiring multiple images with the image sensing device from the multiple fields of view;
- and
- combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images.
A method for enhancing the resolution of an image sensing device, comprising the steps of:
- attaching a mask to a panel of detectors in an image sensing device, the mask being a fine transmission grating, the panel of detectors comprising a periodic array of detectors, and the mask being periodic with period twice that of the periodic array of detectors;
- generating multiple fields of view, the multiple fields of view being related to one another by sub-pixel shifts;
- acquiring multiple images with the image sensing device from the multiple fields of view;
- and
- combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images.
A method for enhancing the resolution of an image sensing device, comprising the steps of:
- attaching a periodic to a panel of detectors in an image sensing device, the mask being a fine transmission grating;
- generating multiple fields of view, the multiple fields of view being related to one another by sub-pixel shifts;
- acquiring multiple images with the image sensing device from the multiple fields of view;
- combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images, and
- determining the number of slits, the positions of the slits and the widths of the slits in the fine transmission grating.
A method for enhancing the resolution of an image sensing device, comprising the steps of:
- attaching a periodic to a panel of detectors in an image sensing device;
- generating multiple fields of view, the multiple fields of view being related to one another by sub-pixel shifts;
- acquiring multiple images with the image sensing device from the multiple fields of view;
- and
- combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images,
- wherein said generating step uses natural vibrations of a platform supporting the sensing device.
A method for enhancing the resolution of an image sensing device, comprising the steps of:
- attaching a periodic to a panel of detectors in an image sensing device;
- generating multiple fields of view, the multiple fields of view being related to one another by sub-pixel shifts;
- acquiring multiple images with the image sensing device from the multiple fields of view;
- and
- combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images,
- wherein said generating step uses at least one mirror to shift fields of view of the image sensing device by sub-pixel shifts.
A method for enhancing the resolution of an image sensing device, comprising the steps of:
- attaching a periodic to a panel of detectors in an image sensing device:
- generating multiple fields of view, the multiple fields of view being related to one another by sub-pixel shifts;
- acquiring multiple images with the image sensing device from the multiple fields of view;
- and
- combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images,
- wherein said combining step is applied separately to rows and columns of pixel data.
A system for enhancing the resolution of an image sensing device, comprising:
- an image sensing device comprising a periodic array of detectors having at least one of a horizontal periodic spacing and a vertical periodic spacing, said image sensing device having a pixel sensitivity function;
- a periodically patterned mask attached to said image sensing device, said mask having at least one of a horizontal period which is an integer multiple of said detectors' horizontal periodic spacing and a vertical period which is an integer multiple of the detectors' vertical periodic spacing, said mask being operative to modify said pixel sensitivity function of said image sensing device, thereby to define a modified pixel sensitivity function of said device whose Fourier transform does not have zeros at frequencies that are between 0 and the maximal frequency at which no significant aliasing occurs;
- image acquisition circuitry, operative to acquire multiple images of a scene from corresponding multiple fields of view related to one another by sub-pixel shifts, said multiple images defining sub-pixel samples;
- and
- a combiner combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images, said combiner being operative
- to compute a Fourier transform of said samples;
- to divide said Fourier transform of said samples by a Fourier transform of said modified pixel sensitivity function, thereby to define a quotient;
- and
- to compute an inverse Fourier transform of the quotient, thereby to define the enhanced image.
A system for enhancing the resolution of an image sensing device, comprising:
- an image sensing device comprising a panel of detectors said panel of detectors comprising a periodic array of detectors;
- a mask attached to said panel of detectors said mask being a fine transmission grating, and said mask being periodic with period equal to that of said periodic array of detectors;
- a motion generator generating multiple fields of view the multiple fields of view being related to one another by sub-pixel shifts;
- image acquisition circuitry housed within said image sensing device acquiring multiple images from the multiple fields of view;
- and
- a combiner combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images.
A system for enhancing the resolution of an image sensing device, comprising:
- an image sensing device comprising a panel of detectors, said panel of detectors comprising a periodic array of detectors;
- a mask attached to said panel of detectors, said mask being a fine transmission grating, and said mask being periodic with period twice that of said periodic array of detectors;
- a motion generator generating multiple fields of view, the multiple fields of view being related to one another by sub-pixel shifts;
- image acquisition circuitry housed within said image sensing device acquiring multiple images from the multiple fields of view;
- and
- a combiner combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images.
A system for enhancing the resolution of an image sensing device, comprising:
- an image sensing device comprising a panel of detectors;
- a periodic attached to said panel of detectors, said mask being a fine transmission grating;
- a motion generator generating multiple fields of view, the multiple fields of view being related to one another by sub-pixel shifts;
- image acquisition circuitry housed within said image sensing device acquiring multiple images from the multiple fields of view;
- a combiner combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images;
- and
- a grating generator determining the number of slits, the positions of the slits and the widths of the slits in the fine transmission grating.
A system for enhancing the resolution of an image sensing device, comprising:
- an image sensing device comprising a panel of detectors;
- a periodic attached to said panel of detectors;
- a motion generator generating multiple fields of view, the multiple fields of view being related to one another by sub-pixel shifts, said motion generator using natural vibrations of a platform supporting the sensing device;
- image acquisition circuitry housed within said image sensing device acquiring multiple images from the multiple fields of view;
- and
- a combiner combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images.
A system for enhancing the resolution of an image sensing device, comprising:
- an image sensing device comprising a panel of detectors;
- a periodic attached to said panel of detectors;
- a motion generator generating multiple fields of view, the multiple fields of view being related to one another by sub-pixel shifts, said motion generator using at least one mirror to shift fields of view of the image sensing device by sub-pixel shifts;
- image acquisition circuitry housed within said image sensing device acquiring multiple images from the multiple fields of view;
- and
- a combiner combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images.
A system for enhancing the resolution of an image sensing device, comprising:
- an image sensing device comprising a panel of detectors:
- a periodic attached to said panel of detectors:
- a motion generator generating multiple fields of view, the multiple fields of view being related to one another by sub-pixel shifts;
- image acquisition circuitry housed within said image sensing device acquiring multiple images from the multiple fields of view;
- and
- a combiner combining the multiple images into an enhanced image of higher pixel resolution than the pixel resolutions of the multiple images, said combiner being applied separately to rows and columns of pixel data.
Dependencies are inferred from the claim text.