# US 11,443,500 B2 · Image processing apparatus, image processing method, and program for detecting defect from image > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,443,500 B2 - Document ID: US11443500B2 - Status: Granted - Kind: B2 - Application number: 16/731,662 - Filed: 2019-12-31 - Published: 2020-04-30 - Granted: 2022-09-13 - Earliest claimed: 2017-07-07 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Kei Takayama; Masakazu Matsugu; Atsushi Nogami; Mahoro Anabuki - Web page: https://patentgrep.com/patent/US11443500B2 ## CPC - G06T 7/001: {using an image reference approach} - G01N 21/8851: {Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges (G01N21/8806 and G01N21/93 - G01N21/95692 take precedence; optical measurement of dimensions G01B11/00; optical scanning G02B26/10; image transformation G06T3/00; computerised image enhancement G06T5/00; image processing per se for flaw detection G06T7/0002)} - G06T 7/13: Edge detection - G06V 10/235: {based on user input or interaction} - G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G01N 2021/8887: {based on image processing techniques} - G06T 2207/20104: Interactive definition of region of interest [ROI] - G06T 2207/30132: Masonry; Concrete - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An image processing apparatus includes detecting means for detecting a first detected region and a second detected region from an input image, on the basis of a first detection criterion and a second detection criterion, respectively; image setting means for setting, as a target image subjected to correction, an image including the first detected region, and setting, as a reference image that is referred to in the correction, an image including the second detected region; accepting means for accepting, from a user, designation of a region in the target image and a correction instruction for the designated region; correction region setting means for identifying, in the reference image, a region corresponding to the designated region, and for setting a to-be-corrected region on the basis of the identified region and the second detected region; and correcting means for correcting the first detected region in the target image on the basis of the to-be-corrected region set in the reference image. ## Claims ### Claim 1 An image processing apparatus comprising: one or more processors configured to cause the image processing apparatus to: detect a first detected region from an input image on the basis of a first detection criterion and a second detected region from the input image on the basis of a second detection criterion, wherein the first detection criterion is based on a first threshold and the second detection criterion is based on a second threshold that is smaller in value than the first threshold; set, as a target image subjected to correction, an image including the first detected region, and set, as a reference image that is referred to in a correction process, an image including the second detected region; set a unit region in the detected region in each of the target image and the reference image by segmenting the detected region in each of the target image and the reference image, the unit region serving as a unit of processing in the correction process; set a to-be-corrected region in the reference image; and correct the unit region in the target image on the basis of the to-be-corrected region set in the reference image. ### Claim 2 (depends on 1) The image processing apparatus according to claim 1, wherein the one or more processors are further configured to cause the image processing apparatus to set, as the unit region, a continuous region in which it is determined that a detection target is detected. ### Claim 3 (depends on 2) The image processing apparatus according to claim 2, wherein the one or more processors are further configured to cause the image processing apparatus to set the unit region on the basis of a branch point in the continuous region in which it is determined that the detection target is detected. ### Claim 4 (depends on 1) The image processing apparatus according to claim 1, wherein the one or more processors are further configured to cause the image processing apparatus to set, in accordance with a second condition that is predetermined, a plurality of the unit regions included in the reference image as a continuous region, and set the to-be-corrected region on the basis of the continuous region. ### Claim 5 (depends on 2) The image processing apparatus according to claim 2, wherein the one or more processors are further configured to cause the image processing apparatus to set, as a correction region, a plurality of unit regions in the target image that correspond to the continuous region. ### Claim 6 An image processing method comprising: detecting a first detected region from an input image on the basis of a first detection criterion and a second detected region from the input image on the basis of a second detection criterion, wherein the first detection criterion is based on a first threshold and the second detection criterion is based on a second threshold that is smaller in value than the first threshold; setting, as a target image subjected to correction, an image including the first detected region, and setting, as a reference image that is referred to in a correction process, an image including the second detected region; setting a unit region in the detected region in each of the target image and the reference image by segmenting the detected region in each of the target image and the reference image, the unit region serving as a unit of processing in the correction process; setting a to-be-corrected region in the reference image; and correcting the unit region in the target image on the basis of the to-be-corrected region set in the reference image. ### Claim 7 A non-transitory computer readable storage medium storing a program that, when executed by one or more processors, causes a computer to: detect a first detected region from an input image on the basis of a first detection criterion and a second detected region from the input image on the basis of a second detection criterion, wherein the first detection criterion is based on a first threshold and the second detection criterion is based on a second threshold that is smaller in value than the first threshold; set, as a target image subjected to correction, an image including the first detected region, and set, as a reference image that is referred to in a correction process, an image including the second detected region; set a unit region in the detected region in each of the target image and the reference image by segmenting the detected region in each of the target image and the reference image, the unit region serving as a unit of processing in the correction process; set a to-be-corrected region in the reference image; and correct the unit region in the target image on the basis of the to-be-corrected region set in the reference image. ### Claim 8 (depends on 1) The image processing apparatus according to claim 1, wherein the one or more processors are further configured to cause the image processing apparatus to: accept, from a user, designation of a region in the target image and a correction instruction for the designated region. ### Claim 9 (depends on 8) The image processing apparatus according to claim 8, wherein the one or more processors are further configured to cause the image processing apparatus to set, in the reference image, the to-be-corrected region on the basis of the designated region. ### Claim 10 (depends on 9) The image processing apparatus according to claim 9, further comprising: a display for displaying, as a correction-target region, a region corresponding to the to-be-corrected region in the target image, wherein the one or more processors are further configured to cause the image processing apparatus to correct the correction-target region in response to accepting, from a user, confirmation of the correction-target region displayed by the display. ### Claim 11 (depends on 9) The image processing apparatus according to claim 9, wherein, as the correction process, the one or more processors are further configured to cause the image processing apparatus to couple a plurality of detected regions included in the correction region to correct the plurality of detected regions into a continuous detected region. ### Claim 12 (depends on 9) The image processing apparatus according to claim 9, wherein, as the correction process, the one or more processors are further configured to cause the image processing apparatus to delete a detected region included in the correction region. ### Claim 13 (depends on 9) The image processing apparatus according to claim 9, wherein the one or more processors are further configured to cause the image processing apparatus to: further accept a correction instruction for the correction region in response to a user operation; and modify the correction region in accordance with the correction instruction.