# US 11,893,706 B2 · Image correction device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,893,706 B2 - Document ID: US11893706B2 - Status: Granted - Kind: B2 - Application number: 17/494,937 - Filed: 2021-10-06 - Published: 2022-04-14 - Granted: 2024-02-06 - Earliest claimed: 2020-10-12 - Assignees: NEC Corporation - Applicants: NEC Corporation - Inventors: Akira Monden - Web page: https://patentgrep.com/patent/US11893706B2 ## CPC - G06T 3/4007: based on interpolation, e.g. bilinear interpolation (image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403) - H04N 9/646: {for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters} - G01C 11/025: {by scanning the object} - G06T 3/4061: by injecting details from different spectral ranges - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 7/74: {involving reference images or patches} - H04N 1/401: Compensating positionally unequal response of the pick-up or reproducing head (H04N1/403 takes precedence) - H04N 1/486: {with separate detectors, each detector being used for one specific colour component} - H04N 1/58: Edge or detail enhancement; Noise or error suppression, e.g. colour misregistration correction (H04N1/62 takes precedence) - H04N 23/15: Image signal generation with circuitry for avoiding or correcting image misregistration - H04N 25/135: {based on four or more different wavelength filter elements} - H04N 25/701: Line sensors - G06T 2207/20016: Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform - G06T 2207/20021: Dividing image into blocks, subimages or windows - G06T 2207/20224: Image subtraction - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) ## Abstract An image correction method includes: acquiring band images obtained by imaging a subject, and a high-resolution image having a resolution higher than that of the band images; acquiring a position difference between the object band image and the reference band image among the band images; by using a pixel of the object band image as an object pixel, for each object pixel, determining a pixel value of each sub-region obtained by dividing the imaging region of the object pixel into a plurality of regions, based on the pixel value of the object pixel and a relationship between pixel values of the pixels of the high-resolution image corresponding to the object pixel; and creating a corrected band image that holds a pixel value of light on the object band image at the pixel position of the reference band image, from the determined pixel value of each sub-region and the position difference. ## Claims ### Claim 1 An image correction device comprising: a memory containing program instructions; and a processor coupled to the memory, wherein the processor is configured to execute the program instructions to: acquire a plurality of band images obtained by imaging a subject; acquire a high-resolution image obtained by imaging the subject, the high-resolution image having a resolution that is higher than a resolution of the band images; by using at least one of the band images as a reference band image and at least one other of the band images as an object band image, acquire a position difference between the object band image and the reference band image; by respectively using one or more pixels of the object band image as one or more object pixels, for each object pixel, determine a pixel value of each of a plurality of sub regions obtained by dividing an imaging region of the object pixel, on a basis of a pixel value of the object pixel and a relationship between pixel values of a plurality of pixels of the high-resolution image corresponding to the object pixel, and create a corrected band image that has a pixel value of light on the object band image at a pixel position of the reference band image from the determined pixel value of each of the sub regions and the position difference; and output the corrected band image, wherein when creating the corrected band image, a ratio of the pixel values of the plurality of pixels of the high-resolution image corresponding to the object pixel is used as the relationship between the pixel values, and each pixel value of the high-resolution image is adjusted by using a minimum pixel value of the high-resolution image. ### Claim 2 (depends on 1) The image correction device according to claim 1, wherein when creating the corrected band image, the pixel position of the reference band image is determined by shifting the object pixel by the position difference, and a total sum of the pixel values of the sub regions included in the determined pixel position is determined to be the pixel value of light on the object band image at the determined pixel position. ### Claim 3 (depends on 1) The image correction device according to claim 1, wherein when creating the corrected band image, as each of the sub regions obtained by dividing an imaging region of the object pixel of the object band image into a plurality of regions, an imaging region of each pixel of an enlarged object band image is used that is obtained by enlarging the object band image so as to have a resolution that is same as the resolution of the high-resolution image. ### Claim 4 An image correction device comprising: a memory containing program instructions; and a processor coupled to the memory, wherein the processor is configured to execute the program instructions to: acquire a plurality of band images obtained by imaging a subject; acquire a high-resolution image obtained by imaging the subject, the high-resolution image having a resolution that is higher than a resolution of the band images; by using at least one of the band images as a reference band image and at least one other of the band images as an object band image, acquire a position difference between the object band image and the reference band image; by respectively using one or more pixels of the object band image as one or more object pixels, for each object pixel, determine a pixel value of each of a plurality of sub regions obtained by dividing an imaging region of the object pixel, on a basis of a pixel value of the object pixel and a relationship between pixel values of a plurality of pixels of the high-resolution image corresponding to the object pixel, and create a corrected band image that has a pixel value of light on the object band image at a pixel position of the reference band image from the determined pixel value of each of the sub regions and the position difference; and output the corrected band image, wherein when creating the corrected band image, a difference between the pixel values of the plurality of pixels of the high-resolution image corresponding to the object pixel is used as the relationship between the pixel values. ### Claim 5 (depends on 4) The image correction device according to claim 4, wherein when creating the corrected band image, each pixel value of the high-resolution image is adjusted by using a standard deviation of the pixel value of the high-resolution image and a standard deviation of the pixel value of the object band image. ### Claim 6 (depends on 1) The image correction device according to claim 1, wherein when acquiring the position difference, the position difference is calculated according to an image correlation between the reference band image and the object band image. ### Claim 7 (depends on 1) The image correction device according to claim 1, wherein when acquiring the position difference, the reference band image and the object band image are each divided into a plurality of regions, and for each of the regions, a shift quantity with which the region of the object band image most closely matches the region of the reference band image is calculated as the position difference of all pixels of the region of the object band image. ### Claim 8 An image correction device comprising: a memory containing program instructions; and a processor coupled to the memory, wherein the processor is configured to execute the program instructions to: acquire a plurality of band images obtained by imaging a subject; acquire a high-resolution image obtained by imaging the subject, the high-resolution image having a resolution that is higher than a resolution of the band images; by using at least one of the band images as a reference band image and at least one other of the band images as an object band image, acquire a position difference between the object band image and the reference band image; by respectively using one or more pixels of the object band image as one or more object pixels, for each object pixel, determine a pixel value of each of a plurality of sub regions obtained by dividing an imaging region of the object pixel, on a basis of a pixel value of the object pixel and a relationship between pixel values of a plurality of pixels of the high-resolution image corresponding to the object pixel, and create a corrected band image that has a pixel value of light on the object band image at a pixel position of the reference band image from the determined pixel value of each of the sub regions and the position difference; and output the corrected band image, wherein when acquiring the position difference, the reference band image and the object band image are each divided into a plurality of regions, and for each of the regions, a shift quantity with which the region of the object band image most closely matches the region of the reference band image is calculated as the position difference of a pixel at a center position in the region of the object band image, and the position difference of a pixel other than the pixel at the center position is calculated by interpolation processing from the position difference of the pixel at the center position. ### Claim 9 An image correction method comprising: acquiring, by a processor, a plurality of band images obtained by imaging a subject; acquiring, by the processor, a high-resolution image obtained by imaging the subject, the high-resolution image having a resolution that is higher than a resolution of the band images; by using at least one of the band images as a reference band image and at least one of rest of the band images as an object band image, acquiring, by the processor, a position difference between the object band image and the reference band image; by respectively using one or more pixels of the object band image as one or more object pixels, for each object pixel, determining, by the processor, a pixel value of each of a plurality of sub regions obtained by dividing an imaging region of the object pixel, on a basis of a pixel value of the object pixel and a relationship between pixel values of a plurality of pixels of the high-resolution image corresponding to the object pixel, and creating, by the processor, a corrected band image that has a pixel value of light on the object band image at a pixel position of the reference band image from the determined pixel value of each of the sub regions and the position difference; and outputting, by the processor, the corrected band image, wherein when creating the corrected band image, a ratio of the pixel values of the plurality of pixels of the high-resolution image corresponding to the object pixel is used as the relationship between the pixel values, and each pixel value of the high-resolution image is adjusted by using a minimum pixel value of the high-resolution image. ### Claim 10 (depends on 9) The image correction method according to claim 9, wherein when creating the corrected band image, the pixel position of the reference band image is determined by shifting the object pixel by the position difference, and a total sum of the pixel values of the sub regions included in the determined pixel position is determined to be the pixel value of light on the object band image at the determined pixel position. ### Claim 11 (depends on 9) The image correction method according to claim 9, wherein when creating the corrected band image includes, as each of the sub regions obtained by dividing an imaging region of the object pixel of the object band image into a plurality of regions, an imaging region of each pixel of an enlarged object band image is used that is obtained by enlarging the object band image so as to have a resolution that is same as the resolution of the high-resolution image. ### Claim 12 An image correction method comprising: acquiring, by a processor, a plurality of band images obtained by imaging a subject; acquiring, by the processor, a high-resolution image obtained by imaging the subject, the high-resolution image having a resolution that is higher than a resolution of the band images; by using at least one of the band images as a reference band image and at least one of rest of the band images as an object band image, acquiring, by the processor, a position difference between the object band image and the reference band image; by respectively using one or more pixels of the object band image as one or more object pixels, for each object pixel, determining, by the processor, a pixel value of each of a plurality of sub regions obtained by dividing an imaging region of the object pixel, on a basis of a pixel value of the object pixel and a relationship between pixel values of a plurality of pixels of the high-resolution image corresponding to the object pixel, and creating, by the processor, a corrected band image that has a pixel value of light on the object band image at a pixel position of the reference band image from the determined pixel value of each of the sub regions and the position difference; and outputting, by the processor, the corrected band image, wherein when creating the corrected band image, a difference between the pixel values of the plurality of pixels of the high-resolution image corresponding to the object pixel is used as the relationship between the pixel values. ### Claim 13 (depends on 12) The image correction method according to claim 12, wherein when creating the corrected band image includes adjusting each pixel value of the high-resolution image is adjusted by using a standard deviation of the pixel value of the high-resolution image and a standard deviation of the pixel value of the object band image. ### Claim 14 An image correction method comprising: acquiring, by a processor, a plurality of band images obtained by imaging a subject; acquiring, by the processor, a high-resolution image obtained by imaging the subject, the high-resolution image having a resolution that is higher than a resolution of the band images; by using at least one of the band images as a reference band image and at least one of rest of the band images as an object band image, acquiring, by the processor, a position difference between the object band image and the reference band image; by respectively using one or more pixels of the object band image as one or more object pixels, for each object pixel, determining, by the processor, a pixel value of each of a plurality of sub regions obtained by dividing an imaging region of the object pixel, on a basis of a pixel value of the object pixel and a relationship between pixel values of a plurality of pixels of the high-resolution image corresponding to the object pixel, and creating, by the processor, a corrected band image that has a pixel value of light on the object band image at a pixel position of the reference band image from the determined pixel value of each of the sub regions and the position difference; and outputting, by the processor, the corrected band image, wherein when acquiring the position difference, the reference band image and the object band image are each divided into a plurality of regions, and for each of the regions, calculating a shift quantity with which the region of the object band image most closely matches the region of the reference band image is calculated as the position difference of all pixels of the region of the object band image, and the position difference of a pixel other than the pixel at the center position is calculated by interpolation processing from the position difference of the pixel at the center position. ### Claim 15 A non-transitory computer readable medium storing a program comprising instructions for causing a computer to perform processing of: acquiring a plurality of band images obtained by imaging a subject; acquiring a high-resolution image obtained by imaging the subject, the high-resolution image having a resolution that is higher than a resolution of the band images; by using at least one of the band images as a reference band image and at least one of rest of the band images as an object band image, acquiring a position difference between the object band image and the reference band image; by respectively using one or more pixels of the object band image as one or more object pixels, for each object pixel, determining a pixel value of each of a plurality of sub regions obtained by dividing an imaging region of the object pixel, on a basis of a pixel value of the object pixel and a relationship between pixel values of a plurality of pixels of the high-resolution image corresponding to the object pixel, and creating a corrected band image that holds has a pixel value of light on the object band image at a pixel position of the reference band image from the determined pixel value of each of the sub regions and the position difference; and outputting the corrected band image, wherein when creating the corrected band image, a difference between the pixel values of the plurality of pixels of the high-resolution image corresponding to the object pixel is used as the relationship between the pixel values.