# US 10,504,206 B2 · Method and system for processing images from a remote image detector > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,504,206 B2 - Document ID: US10504206B2 - Status: Granted - Kind: B2 - Application number: 15/643,080 - Filed: 2017-07-06 - Published: 2018-01-11 - Granted: 2019-12-10 - Earliest claimed: 2016-07-06 - Assignees: Micro Biz Ventures LLC - Applicants: Micro Biz Ventures LLC - Inventors: Richard C. Puetter - Web page: https://patentgrep.com/patent/US10504206B2 ## CPC - G06T 3/4053: based on super-resolution, i.e. the output image resolution being higher than the sensor resolution - G06T 5/50: using two or more images, e.g. averaging or subtraction - H04N 19/182: the unit being a pixel - G06T 2207/10032: Satellite or aerial image; Remote sensing - G06T 2207/20208: High dynamic range [HDR] image processing - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method and system for enhancing spatial resolution of an image of an object includes using an image detector with a sensor array of pixels configured for extended dynamic range detection. Multiple image sample are collected to assemble a stack of image samples and input into an image processor for processing using an image reconstruction engine to generate a single output image from the stack. In a preferred embodiment, the image reconstruction engine executes the Pixon method for image reconstruction. ## Claims ### Claim 1 A method for enhancing spatial resolution of an image of an object detected by an image detector located remotely from the object, wherein one of the object and the image detector moves relative to the other, the method comprising: providing within the image detector a sensor comprising an array of pixels at least a portion of which are smaller than a diffraction limit, wherein each smaller pixel of the portion of smaller pixels subtends an angle θ pixel = 1.2 ⁢ λ N · D , where λ is a wavelength used to acquire the image, D is a diameter of imaging optics within the image detector, and N is an oversampling of a diffraction pattern and is greater than 1; collecting multiple image samples; assembling a stack of image samples; inputting the stack of image samples into an image processor; processing the stack of images using an image reconstruction engine; and generating an output image. ### Claim 2 (depends on 1) The method of claim 1, wherein the image reconstruction engine comprises a processor programmed to execute a Pixon image reconstruction algorithm. ### Claim 3 (depends on 1) The method of claim 1, wherein the pixels in the array are selectable in subgroups, wherein at least one first image sample is obtained using each pixel of the array, and at least one second image sample is obtained using one or more groups of multiple pixels, wherein the at least one first image sample and the at least one second image sample are included in the stack of image samples. ### Claim 4 (depends on 3) The method of claim 3, wherein the one or more groups of multiple pixels are adaptively grouped according to lighting conditions. ### Claim 5 (depends on 3) The method of claim 3, wherein the one or more groups of pixels are arranged in configurations including square, rectangular, and irregular shapes. ### Claim 6 (depends on 1) The method of claim 1, wherein the multiple image samples are obtained from multiple, simultaneous exposures on the sensor by selecting different subgroups of pixels to generate a plurality of different resolutions in a single exposure. ### Claim 7 (depends on 1) The method of claim 1, wherein the multiple image samples are obtained at different times. ### Claim 8 (depends on 1) The method of claim 1, further comprising, prior to processing the stack of images, accessing and adding a pre-existing high-resolution image of the object to the stack of images. ### Claim 9 (depends on 1) The method of claim 1, wherein the image detector is mounted on a spacecraft, satellite or surveillance aircraft and the object is located on the Earth's surface. ### Claim 10 (depends on 1) The method of claim 1, wherein the sensor is configured for adaptive binning to enable extended dynamic range detection. ### Claim 11 An image processing system for enhancing spatial resolution of an image of an object, the system comprising: an image detector, wherein one of the object and the image detector is remotely located and moves relative to the other; a sensor disposed within the image detector, the sensor comprising an array of pixels configured for collecting image samples, wherein at least a portion of the array of pixels are smaller than a diffraction limit, wherein each smaller pixel of the portion of smaller pixels subtends an angle θ pixel = 1.2 ⁢ λ N · D , where λ is a wavelength used to acquire the image, D is a diameter of imaging optics within the image detector, and N is an oversampling of a diffraction pattern and is greater than 1; a storage medium configured for accumulating multiple image samples to assemble a stack of image samples; an image processor configured for receiving the stack of image samples and processing the stack of image samples using an image reconstruction algorithm to produce an improved image; and a display device for displaying the improved image. ### Claim 12 (depends on 11) The system of claim 11, wherein the image processor is programmed to execute a pixon image reconstruction algorithm. ### Claim 13 (depends on 11) The system of claim 11, wherein the pixels in the array are configured for selection in subgroups, wherein at least one first image sample is obtained using each pixel of the array, and at least one second image sample is obtained using one or more groups of multiple pixels, wherein the at least one first image sample and the at least one second image sample are included in the stack of image samples. ### Claim 14 (depends on 13) The system of claim 13, wherein the one or more groups of multiple pixels are adaptively grouped according to lighting conditions. ### Claim 15 (depends on 13) The system of claim 13, wherein the one or more groups of pixels are arranged in configurations including square, rectangular, and irregular shapes. ### Claim 16 (depends on 11) The system of claim 11, wherein the multiple image samples are obtained from multiple, simultaneous exposures on the sensor by selecting different subgroups of pixels to generate a plurality of different resolutions in a single exposure. ### Claim 17 (depends on 11) The system of claim 11, wherein the multiple image samples are obtained at different times and combined to generate a single output image. ### Claim 18 (depends on 11) The system of claim 11, wherein the image processor is further configured to access one or more pre-existing high-resolution images of the object and add the one or more pre-existing images to the stack of images for processing. ### Claim 19 (depends on 11) The system of claim 11, wherein the image detector is mounted on a spacecraft, satellite or surveillance aircraft, and the object is located on the Earth's surface. ### Claim 20 (depends on 11) The system of claim 11, wherein the sensor is configured for adaptive binning to enable extended dynamic range detection.