# US 9,519,958 B2 · Image processing method and image processing device with pixel correction > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,519,958 B2 - Document ID: US9519958B2 - Status: Granted - Kind: B2 - Application number: 14/396,061 - Filed: 2013-04-24 - Published: 2015-03-26 - Granted: 2016-12-13 - Earliest claimed: 2012-04-26 - Assignees: NEC Corporation - Applicants: NEC Corporation - Inventors: Kenta Senzaki; Masato Tsukada; Hiroaki Kawaguchi - Web page: https://patentgrep.com/patent/US9519958B2 ## CPC - G06T 5/20: using local operators - G06T 5/70: Denoising; Smoothing - H04N 25/60: Noise processing, e.g. detecting, correcting, reducing or removing noise - G06T 2207/20016: Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform - G06T 2207/20076: Probabilistic image processing - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method includes: calculating a pixel statistical value and edge of pixels for each of areas of a multi-layer, the areas each containing a target pixel and having a successively decreased range; correcting the edge based on a pixel statistical value of an area that is wider than a specific area; correcting difference between a pixel statistical value of the specific area and the pixel statistical value of the area that is wider than the specific area using the post-correction edge; correcting the pixel statistical value of the specific area using post-correction difference and the pixel statistical value of the area that is wider than the specific area; and correcting the target pixel by repeating correction of the pixel statistical value of the specific area successively in each area until the area reduces its range from the maximum range to the minimum range. ## Claims ### Claim 1 An image processing method comprising: calculating a pixel statistical value and an edge information of pixels for each of plural areas of a multi-layer structure to thereby obtain the pixel statistical value and the edge information for each of the areas, each of the areas containing a target pixel and having a successively decreased range; a difference information correction step of using the edge information to correct difference information between a pixel statistical value of a first area of a specific layer of the multi-layer structure and a pixel statistical value of a second area of another layer of the multi-layer structure to thereby obtain post-correction difference information, wherein the second area is wider than the first area; a recorrection step of recorrecting the post-correction difference information using the pixel statistical value of a third area of the multi-layer structure to thereby obtain recorrected difference information, wherein the third area is wider than the second area; a pixel statistical value correction step of correcting the pixel statistical value of the first area using the recorrected difference information and the pixel statistical value of the second area; and correcting the target pixel of the first area by successively repeating the recorrection step and the pixel statistical value correction step of the first area until a range of the first area is reduced from a maximum range to a minimum range. ### Claim 2 (depends on 1) The image processing method according to claim 1, wherein the correction is performed, when the pixel statistical value of the first area of the specific layer is corrected using the post-correction difference information, the pixel statistical value of the second area, and the pixel statistical value of the third area, in such a manner that: a correction amount is set to a large value when the third area is an area where a brightness value is smaller than a first value; correction is not performed when the third area is an area where the brightness value is larger than a second value; and the correction amount is set to a value according to the brightness when the third area is an area where the brightness value is larger than the first value and smaller than the second value. ### Claim 3 (depends on 1) The image processing method according to claim 1, wherein the difference information is calculated using the pixel statistical value of the area of the specific layer, the pixel statistical value of the second area, and the edge information in the second area. ### Claim 4 (depends on 3) The image processing method according to claim 3, wherein the pixel statistical value of the first area is not corrected when the edge information in the second area exceeds a predetermined threshold. ### Claim 5 (depends on 1) The image processing method according to claim 1, wherein a degree of correction is varied for each layer when the pixel statistical value of the first area is corrected using post-correction difference information and the pixel statistical value of the second area. ### Claim 6 (depends on 5) The image processing method according to claim 5, wherein the degree of correction is varied according to variation amounts of pixel values caused by noise of the first area when the pixel statistical value of the first area is corrected using the post-correction difference information and the pixel statistical value of the second area. ### Claim 7 (depends on 5) The image processing method according to claim 5, wherein the degree of correction is varied according to an edge amount of the second area when the pixel statistical value of the first area is corrected using the post-correction difference information and the pixel statistical value of the second area. ### Claim 8 (depends on 1) The image processing method according to claim 1, wherein the correction is performed in such a manner that a value close to zero is output as the difference information comes closer to zero, whereas, the degree of correction is made smaller as the difference information becomes larger when the pixel statistical value of the first area is corrected using the post-correction difference information and the pixel statistical value of the second area. ### Claim 9 (depends on 1) The image processing method according to claim 1, wherein a spatial average of pixels is used as the pixel statistical value. ### Claim 10 (depends on 9) The image processing method according to claim 9, wherein the spatial average is any one of an arithmetic mean, a geometric mean, or a weighted average efficiency of pixels. ### Claim 11 An image processing device comprising: a pixel statistical value calculation unit calculating a pixel statistical value of pixels for each of plural areas of a multi-layer structure to thereby obtain the pixel statistical value and the edge information for each of the areas, each of the areas containing a target pixel and having a successively decreased range; an edge information calculation unit calculating edge information for each of the areas of the multi-layer structure, each of the areas containing a target pixel and having a successively decreased range; and a correction unit that i) uses the edge information in correcting difference information between a pixel statistical value of a first area of a specific layer and a pixel statistical value of a second area of another layer that is wider than the first area, ii) recorrecting post-correction difference information using a pixel statistical value of a third area of the multi-layer structure to obtain recorrected difference information, wherein the third area is wider than the second area, iii) correcting the pixel statistical value of the first area using the recorrected difference information and the pixel statistical value of the second area, and iv) correcting the target pixel of the first area by successively repeating recorrecting the post-correction difference information and correcting the pixel statistical value of the first area until a range of the first area is reduced from a maximum range to a minimum range. ### Claim 12 (depends on 11) The image processing device according to claim 11, wherein, when performing correction of the pixel statistical value of the first area using the post-correction difference information, the pixel statistical value of the second area, and the pixel statistical value of the third area, the correction unit performs the correction in such a manner that: a correction amount is set to a large value when the third area is an area where a brightness value is smaller than a first value; correction is not performed when the third area is an area where the brightness value is larger than a second value; and the correction amount is set to a value according to brightness when the third area is an area where the brightness value is larger than the first value and smaller than the second value. ### Claim 13 (depends on 11) The image processing device according to claim 11, wherein the correction unit calculates the difference information using the pixel statistical value of the first area, the pixel statistical value of the area of the second layer, and the edge information in the second area. ### Claim 14 (depends on 13) The image processing device according to claim 13, wherein the correction unit does not correct the pixel statistical value of the first area when the edge information in the second area exceeds a predetermined threshold. ### Claim 15 (depends on 11) The image processing device according to claim 11, wherein the correction unit causes the degree of correction to vary for each layer when the pixel statistical value of the first area is corrected using post-correction difference information and the pixel statistical value of the second area. ### Claim 16 (depends on 15) The image processing device according to claim 15, wherein the correction unit causes the degree of correction to vary according to variation amounts of pixel values caused by noise of the first area when the pixel statistical value of the first area is corrected using the post-correction difference information and the pixel statistical value of the second area. ### Claim 17 (depends on 15) The image processing device according to claim 15, wherein the correction unit causes the degree of correction to vary according to an edge amount of the second area when the pixel statistical value of the first area is corrected using the post-correction difference information and the pixel statistical value of the second area. ### Claim 18 (depends on 11) The image processing device according to claim 11, wherein the correction unit performs correction in such a manner that a value close to zero is output as the difference information comes closer to zero, whereas, the degree of correction is made smaller as the difference information becomes larger, when the pixel statistical value of the first area is corrected using the post-correction difference information and the pixel statistical value of the second area. ### Claim 19 (depends on 18) The image processing device according to claim 18, wherein a spatial average of pixels is used as the pixel statistical value. ### Claim 20 A non-transitory computer readable storage medium storing a program causing a computer to execute: pixel statistical value calculation processing for calculating a pixel statistical value of pixels for each of plural areas of a multi-layer structure to thereby obtain the pixel statistical value and the edge information for each of the areas, each of the areas containing a target pixel and having a successively decreased range; edge information calculation processing for calculating edge information for each of the areas of the multi-layer structure, each of the areas containing a target pixel and having a successively decreased range; and correction processing for i) using the edge information in correcting difference information between a pixel statistical value of a first area of a specific layer and a pixel statistical value of a second area of another layer that is wider than the first area, ii) recorrecting post-correction difference information using a pixel statistical value of a third area that of the multi-layer structure to obtain recorrected difference information, wherein the third area is wider than the second area, iii) correcting the pixel statistical value of the first area using the recorrected difference information and the pixel statistical value of the second area, and iv) correcting the target pixel of the first area by successively repeating recorrecting the post-correction difference information and correcting the pixel statistical value of the first area until a range of the first area is reduced from a maximum range to a minimum range.