# US 12,112,462 B2 · Information processing apparatus, information processing method, and storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,112,462 B2 - Document ID: US12112462B2 - Status: Granted - Kind: B2 - Application number: 17/326,179 - Filed: 2021-05-20 - Published: 2021-09-02 - Granted: 2024-10-08 - Earliest claimed: 2018-11-30 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Atsushi Nogami - Web page: https://patentgrep.com/patent/US12112462B2 ## CPC - G06T 7/0002: {Inspection of images, e.g. flaw detection} - G01B 11/30: for measuring roughness or irregularity of surfaces - G01N 21/88: Investigating the presence of flaws or contamination - G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting - G06F 18/217: {Validation; Performance evaluation; Active pattern learning techniques} - G06F 18/22: Matching criteria, e.g. proximity measures - G06F 18/285: {Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system} - G06F 18/40: Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor - G06N 20/00: Machine learning - G06Q 10/00: Administration; Management - G06Q 50/08: Construction - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06V 10/764: using classification, e.g. of video objects - G06T 2207/20076: Probabilistic image processing - G06T 2207/20081: Training; Learning - G06T 2207/20084: Artificial neural networks [ANN] - G06T 2207/30132: Masonry; Concrete - G06V 2201/07: Target detection - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS - G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A detection unit configured to detect a detection target from an image to be processed by detection processing capable of adjusting at least one setting, a correction cost estimation unit configured to estimate a correction cost needed for correction needed in a case where a result of detection by the detection unit is corrected, an adjustment cost estimation unit configured to estimate an adjustment cost needed in a case where the setting of the detection processing is adjusted to the detection target, and a display control unit configured to perform control to display the correction cost and the adjustment cost on a display unit in a comparable manner are included. ## Claims ### Claim 1 An information processing apparatus comprising: one or more memories storing instructions; and one or more processors executing the instructions to: detect at least one deformation of a structure from an image to be processed by detection processing capable of adjusting at least one setting; set a defective portion of the detection processing; estimate, as a correction cost, a time or a fee needed to manually correct a result of detection of the defective portion by a user; estimate, as an adjustment cost, a time or a fee needed to perform a redetection processing depending on an adjustment of the setting of the detection processing, wherein the adjustment cost includes a cost needed to retrain a detection model; and control to display both the correction cost and the adjustment cost on a display unit in a comparable manner. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the correction cost refers to a cost needed in a case where the defective portion is reduced by making a correction without performing the detection processing again, and the adjustment cost refers to a cost needed in a case where the defective portion is reduced by performing the detection processing with the setting adjusted. ### Claim 3 (depends on 1) The information processing apparatus according to claim 1, wherein the detection processing is processing using the detection model trained with a training image and teaching data, the training image being known to include the detection target, the teaching data indicating a position of the detection target in the image. ### Claim 4 (depends on 3) The information processing apparatus according to claim 3, wherein the one or more processors further execute the instructions to: display a plurality of parameters to be set for the detection processing in a selectable manner, and estimate the adjustment cost needed in a case where a parameter selected by a user among the displayed parameters is adjusted. ### Claim 5 (depends on 4) The information processing apparatus according to claim 4, wherein the parameters include a parameter of image processing to be performed on the image to be processed before or after the detection processing using the detection model. ### Claim 6 (depends on 1) The information processing apparatus according to claim 1, wherein the one or more processors further execute the instructions to: display a result image obtained by superimposing the result of detection on the image to be processed, and set a region specified by the user on the result image as the defective portion. ### Claim 7 (depends on 1) The information processing apparatus according to claim 1, wherein the defective portion is set based on a result of the detection processing. ### Claim 8 (depends on 7) The information processing apparatus according to claim 7, wherein the detection processing is processing using the detection model trained with a training image and teaching data, the training image being known to include the deformation of the structure and the teaching data indicating a position of the deformation of the structure in the image, and wherein the defective portion is set based on a degree of similarity between an image of the deformation of the structure and the training image. ### Claim 9 (depends on 7) The information processing apparatus according to claim 7, wherein the deformation of the structure is a crack in a wall surface, and wherein the defective portion is set based on a length of a result of detection of the crack. ### Claim 10 (depends on 1) The information processing apparatus according to claim 1, wherein the correction cost is estimated based on an area of the defective portion. ### Claim 11 (depends on 1) The information processing apparatus according to claim 1, wherein the correction cost is estimated based on an image feature amount of the defective portion. ### Claim 12 (depends on 1) The information processing apparatus according to claim 1, wherein the one or more processors further execute the instructions to: detect, in a case where a re-execution instruction for the detection processing is accepted, the deformation of the structure by the detection processing with the setting adjusted, combine a result of detection obtained by the detection processing with the unadjusted setting and a result of detection obtained by the detection processing related to the re-execution instruction, and display the combined result of detection. ### Claim 13 (depends on 4) The information processing apparatus according to claim 4, wherein the one or more processors further execute the instructions to: identify a recommended adjustment method based on the defective portion, and display the identified adjustment method. ### Claim 14 (depends on 13) The information processing apparatus according to claim 13, wherein the one or more processors further execute the instructions to: estimate an expected value of improvement of the result of detection by the detection processing using the recommended adjustment method, and display the expected value. ### Claim 15 An information processing method to be performed by an information processing apparatus, the method comprising: detecting at least one deformation of a structure from an image to be processed by detection processing capable of adjusting at least one setting; setting a defective portion of the detection processing; estimating, as a correction cost, a time or a fee needed to manually correct a result of detection of the defective portion by a user; estimating, as an adjustment cost, a time or a fee needed to perform a redetection processing depending on an adjustment of the setting of the detection processing, wherein the adjustment cost includes a cost needed to retrain a detection model; and controlling to display both the correction cost and the adjustment cost on a display unit in a comparable manner. ### Claim 16 A computer-readable storage medium storing a computer-readable program to be read and executed by an information processing apparatus and thereby cause the information processing apparatus to: detect at least one deformation of a structure from an image to be processed by detection processing capable of adjusting at least one setting; set a defective portion of the detection processing; estimate, as a correction cost, a time or a fee needed to manually correct a result of detection of the defective portion by a user; estimate, as an adjustment cost, a time or a fee needed to perform a redetection processing depending on an adjustment of the setting of the detection processing, wherein the adjustment cost includes a cost needed to retrain a detection model; and control to display both the correction cost and the adjustment cost on a display unit in a comparable manner.