# US 10,311,559 B2 · Information processing apparatus, information processing method, and storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,311,559 B2 - Document ID: US10311559B2 - Status: Granted - Kind: B2 - Application number: 15/528,072 - Filed: 2015-12-03 - Published: 2017-11-09 - Granted: 2019-06-04 - Earliest claimed: 2014-12-12 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Masafumi Takimoto; Yusuke Mitarai; Katsuhiko Mori; Tomotaka Fujimori - Web page: https://patentgrep.com/patent/US10311559B2 ## CPC - G06T 7/0002: {Inspection of images, e.g. flaw detection} - G01N 21/8806: {Specially adapted optical and illumination features} - G06F 17/18: for evaluating statistical data {, e.g. average values, frequency distributions, probability functions, regression analysis (forecasting specially adapted for a specific administrative, business or logistic context G06Q10/04)} - G06F 18/2433: Single-class perspective, e.g. one-against-all classification; Novelty detection; Outlier detection - G06T 1/0007: {Image acquisition} - G06V 10/32: Normalisation of the pattern dimensions - G06V 10/446: {using Haar-like filters, e.g. using integral image techniques} - G06V 10/764: using classification, e.g. of video objects - G06T 2207/20081: Training; Learning - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract To present a determination result with respect to input data and also a reason of the determination result to a user, an extraction unit configured to extract a plurality of feature amounts from an image including an inspection target object, a determination unit configured to determine an anomaly degree of the inspection target object on the basis of the extracted feature amounts, and an image generation unit configured to generate a defect display image representing a defect included in the inspection target object on the basis of contribution degrees of the respective feature amounts with respect to the determined anomaly degree are provided. ## Claims ### Claim 1 An information processing apparatus comprising: one or more processors; and a memory coupled to the one or more processors, the memory having stored thereon instructions which, when executed by the one or more processors, cause the information processing apparatus to perform operations including: extracting a plurality of types of feature amounts from an image including an inspection target object, determining an anomaly degree of the inspection target object based on the extracted plurality of types of feature amounts, generating a plurality of feature amount maps each for representing a distribution of feature amounts of respective one of the extracted plurality of types of feature amounts, integrating the generated plurality of feature amount maps to obtain an integrated map based on contribution degrees of the respective plurality of feature amounts with respect to the determined anomaly degree, and displaying, on a display, the integrated map as a defect image representing a defect included in the inspection target object. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein executing the instructions further causes the information processing apparatus to perform operations including generating plural pieces of score information, each representing a score of each of the plurality of feature amounts from the image, wherein the anomaly degree is determined based on the plural pieces of score information. ### Claim 3 (depends on 2) The information processing apparatus according to claim 2, wherein the score information is two-dimensional array information having a number of dimensions that is the same as a number of dimensions of the image. ### Claim 4 An information processing apparatus comprising: one or more processors; and a memory coupled to the one or more processors, the memory having stored thereon instructions which, when executed by the one or more processors, cause the information processing apparatus to perform operations including: extracting a plurality of feature amounts from a plurality of images including an inspection target object, determining an anomaly degree of the inspection target object based on the extracted plurality of feature amounts, generating an image in which a defect included in the inspection target object is emphasized, by synthesizing the plurality of images to one another based on contribution degrees of the respective plurality of feature amounts with respect to the determined anomaly degree, and displaying, on a display, the generated image in which the defect included in the inspection target object is emphasized. ### Claim 5 (depends on 4) The information processing apparatus according to claim 4, wherein the plurality of images are images including the inspection target object which are respectively irradiated with different pattern illuminations. ### Claim 6 (depends on 1) The information processing apparatus according to claim 1, wherein executing the instructions further causes the information processing apparatus to perform operations including determining whether the inspection target object is normal or abnormal based on the anomaly degree. ### Claim 7 (depends on 1) The information processing apparatus according to claim 1, wherein executing the instructions further causes the information processing apparatus to perform operations including generating a plurality of hierarchical images having different resolutions by performing a predetermined conversion on the image, and wherein extracting includes extracting the plurality of feature amounts from the plurality of hierarchical images. ### Claim 8 (depends on 7) The information processing apparatus according to claim 7, wherein the plurality of feature amounts include at least one of the following: a maximum value, an average value, a variance, a kurtosis, a skewness, a contrast, and a maximum gradient of pixel values in the plurality of hierarchical images. ### Claim 9 (depends on 7) The information processing apparatus according to claim 7, wherein the predetermined conversion includes Wavelet conversion. ### Claim 10 A method for an information processing apparatus the method comprising: extracting a plurality of types of feature amounts from an image including an inspection target object; determining an anomaly degree of the inspection target object based on the extracted plurality of types of feature amounts; generating a plurality of feature amount maps each for representing a distribution of feature amounts of respective one of the extracted plurality of types of feature amounts; integrating the generated plurality of feature amount maps to obtain an integrated map based on contribution degrees of the respective plurality of feature amounts with respect to the determined anomaly degree; and displaying, on a display, the integrated map as a defect image representing a defect included in the inspection target object. ### Claim 11 A method for an information processing apparatus the method comprising: extracting a plurality of feature amounts from a plurality of images including an inspection target object; determining an anomaly degree of the inspection target object based on the extracted plurality of feature amounts; generating an image in which a defect included in the inspection target object is emphasized, by synthesizing the plurality of images to one another based on contribution degrees of the respective plurality of feature amounts with respect to the determined anomaly degree; and displaying, on a display, the generated image in which the defect included in the inspection target object is emphasized. ### Claim 12 (depends on 10) A non-transitory computer readable storage medium storing a program causing a computer to execute the method according to claim 10. ### Claim 13 (depends on 11) A non-transitory computer readable storage medium storing a program causing a computer to execute the method according to claim 11.