# US 12,112,467 B2 · Method of inspecting a fastener, and a system and apparatus for inspecting a fastener > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,112,467 B2 - Document ID: US12112467B2 - Status: Granted - Kind: B2 - Application number: 17/519,130 - Filed: 2021-11-04 - Published: 2022-05-05 - Granted: 2024-10-08 - Earliest claimed: 2020-11-04 - Assignees: The Boeing Company - Applicants: The Boeing Company - Inventors: Monica J. Brockway; Farahnaz Sisco - Web page: https://patentgrep.com/patent/US12112467B2 ## CPC - G06T 7/0004: {Industrial image inspection} - B21J 15/28: Control devices specially adapted to riveting machines not restricted to one of the preceding subgroups - G01N 21/9515: {Objects of complex shape, e.g. examined with use of a surface follower device (measuring contours and curvatures G01B11/24)} - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06V 10/40: Extraction of image or video features - G01B 11/02: for measuring length, width or thickness (G01B11/08 takes precedence) - G01N 2021/8887: {based on image processing techniques} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - B21J: FORGING; HAMMERING; PRESSING METAL; RIVETING; FORGE FURNACES (rolling of metal B21B; making particular products by forging or pressing B21K; cladding or plating B23K; finishing surfaces by hammering B23P9/04; compacting surfaces by blasting with particulate material B24C1/10; general features of presses, presses for consolidating scrap B30B; furnaces in general F27) - G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS ## Abstract One or more methods of inspecting one or more structural features of an installed fastener in a structure or substructure, and a manually-operated or automated inspection apparatus and an inspection system for inspecting one or more structural features of a fastener in a structure or substructure. ## Claims ### Claim 1 A method of inspecting a fastener installed in a fastening hole of a region of a structure that is enclosed or has limited access, the method comprising: positioning an inspection apparatus for entry along a longitudinal axis thereof through an adjacent fastening hole of the installed fastener to be inspected; detecting structural features of one or more of the fastener and an inspection environment external to the fastener as inspection data that comprises image data, measurement data, and position data; conducting an inspection evaluation of the inspection data by conducting a comparison based on one or more of the image data, the measurement data, and the position data of a retention feature of the installed fastener with one or more predetermined threshold inspection data; and making an inspection determination of the installed fastener in response to the inspection evaluation. ### Claim 2 (depends on 1) The method of claim 1, further comprising, before detecting the structural features, illuminating one or more of the installed fastener and the inspection environment external to the fastener. ### Claim 3 (depends on 1) The method of claim 1, wherein the inspection determination comprises determining, in response to the inspection evaluation, whether the retention feature satisfies one or more predetermined retention criteria. ### Claim 4 An inspection apparatus for inspecting a fastener installed in a fastening hole of a region of a structure that is enclosed or has limited access, the inspection apparatus comprising: an inspection member, positioned for entry along a longitudinal axis thereof through an adjacent fastening hole of the installed fastener to be inspected; a sensor array, arranged in the inspection member, the sensor array comprising one or more sensors to detect structural features of one or more of the installed fastener and an inspection environment external to the installed fastener as inspection data that comprises image data, measurement data, and position data; and a control module, arranged in the inspection member, the control module comprising one or more processors configured to control the inspection member and the sensor array, conduct an inspection evaluation of the inspection data by conducting a comparison based on one or more of the image data, the measurement data, and the position data of a retention feature of the installed fastener with one or more predetermined threshold inspection data, and make an inspection determination of the installed fastener in response to the inspection evaluation. ### Claim 5 (depends on 4) The inspection apparatus of claim 4, further comprising one or more light sources, controlled by the control module, to illuminate the installed fastener and the inspection environment. ### Claim 6 (depends on 5) The inspection apparatus of claim 5, wherein the one or more processors configured to control the one or more light sources by dynamically adjusting an illuminating intensity of light emitted by the one or more light sources. ### Claim 7 (depends on 5) The inspection apparatus of claim 5, wherein the inspection determination comprises determining, in response to the inspection evaluation, whether the retention feature satisfies one or more predetermined retention criteria. ### Claim 8 An inspection system for inspecting a fastener installed in a fastening hole of a region of a structure that is enclosed or has limited access, the inspection system comprising: an automation machine configured to conduct one or more of drilling one or more fastening holes in the structure, and installing a fastener in a corresponding fastening hole; and an inspection apparatus, operatively connected to the automation machine, the inspection apparatus including: an inspection member, positioned for entry along a longitudinal axis thereof through an adjacent fastening hole of the installed fastener to be inspected; and a sensor array, arranged in the inspection member, the sensor array comprising one or more sensors to detect structural features of one or more of the installed fastener and an inspection environment external to the installed fastener as inspection data that comprises image data, measurement data, and position data; and a control module, arranged in the inspection member, the control module comprising one or more processors configured to control the inspection member and the sensor array, conduct an inspection evaluation of the inspection data by conducting a comparison based on one or more of the image data, the measurement data, and the position data of a retention feature of the installed fastener with one or more predetermined threshold inspection data, and make an inspection determination of the installed fastener in response to the inspection evaluation. ### Claim 9 (depends on 8) The inspection system of claim 8, wherein the inspection apparatus further includes one or more light sources, controlled by the control module, to illuminate the installed fastener and the inspection environment. ### Claim 10 (depends on 9) The inspection system of claim 9, wherein the one or more processors configured to control the one or more light sources by dynamically adjusting an illuminating intensity of light emitted by the one or more light sources. ### Claim 11 (depends on 8) The inspection system of claim 8, wherein the inspection determination comprises determining, in response to the inspection evaluation, whether the retention feature satisfies one or more predetermined retention criteria.