# US 10,502,695 B2 · Automated inspection of foreign materials, cracks and other surface anomalies > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,502,695 B2 - Document ID: US10502695B2 - Status: Granted - Kind: B2 - Application number: 15/678,670 - Filed: 2017-08-16 - Published: 2019-02-21 - Granted: 2019-12-10 - Earliest claimed: 2017-08-16 - Assignees: The Boeing Company - Applicants: The Boeing Company - Inventors: Morteza Safai - Web page: https://patentgrep.com/patent/US10502695B2 ## CPC - G01N 21/8806: {Specially adapted optical and illumination features} - B32B 37/14: characterised by the properties of the layers - G01N 21/94: Investigating contamination, e.g. dust (G01N21/85 takes precedence) - G01N 21/956: Inspecting patterns on the surface of objects {(contactless testing of electronic circuits G01R31/308; testing currency G07D; manufacturing processes per se of semiconductor devices implementing a measuring step H10P74/20)} - G06T 7/001: {using an image reference approach} - H04N 23/56: provided with illuminating means - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - B32B 2605/18: Aircraft - G01N 2021/8472: {Investigation of composite materials} - G01N 2021/8816: {by using multiple sources, e.g. LEDs} - G01N 2021/8832: {Structured background, e.g. for transparent objects} - G01N 2021/8835: {Adjustable illumination, e.g. software adjustable screen} - G01N 2201/06146: Multisources for homogeneisation, as well sequential as simultaneous operation - G01N 2201/06153: the sources being LED's - G01N 2201/0628: Organic LED [OLED] - G06T 2207/10024: Color image - G06T 2207/10152: Varying illumination - G06T 2207/30164: Workpiece; Machine component - G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q) - B32B: LAYERED PRODUCTS, i.e. PRODUCTS BUILT-UP OF STRATA OF FLAT OR NON-FLAT, e.g. CELLULAR OR HONEYCOMB, FORM - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An inspection system for detecting defects in a workpiece can include an illumination source for illuminating a first section of the workpiece with a patterned light, wherein the illumination source does not illuminate a second section of the workpiece. The inspection system further includes a feedback camera for imaging the first section and producing a first output, and a background camera for imaging the second section and producing a second output. A processor compares the first output with the second output, and a controller alters the patterned light that is output by the illumination source based on the comparison. This feedback control continues until the background is suitably homogeneous or camouflaged compared to the defect, such that the visibility and/or detectability of the defect is increased. ## Claims ### Claim 1 A method for inspecting a workpiece, comprising: outputting a patterned light onto a first section of the workpiece using an illumination source, wherein: the illumination source comprises a plurality of illumination elements; the plurality of illumination elements of the illumination source comprises at least one million organic light emitting diodes (OLEDs); each illumination element of the plurality of illumination elements is individually controllable with respect to light intensity; and the first section of the workpiece reflects the patterned light; imaging the patterned light reflected from the first section of the workpiece using a feedback camera to generate a first output; imaging a second section of the workpiece that is not illuminated by the illumination source using a background camera to generate a second output; comparing the first output to the second output; and altering a light pattern of the patterned light output by the illumination source, wherein the altering of the patterned light comprises individually controlling a light intensity of each of the OLEDs, thereby changing one or more of an intensity, a hue, a saturation, and a color of the patterned light based on the comparing of the first output to the second output and increasing a contrast of one or more defects located in the first section of the workpiece. ### Claim 2 (depends on 1) The method of claim 1, wherein each OLED is configured to output at least 1000 lux. ### Claim 3 (depends on 1) The method of claim 1, further comprising displaying data obtained from the first output from the feedback camera onto a display for inspection by an operator. ### Claim 4 (depends on 1) The method of claim 1, further comprising: imaging the patterned light reflected from the first section of the workpiece using an inspection camera to generate a third output; sending data obtained from the third output from the inspection camera to a processor; and using the processor to analyze the data obtained from the third output to detect the one or more defects in the first section of the workpiece. ### Claim 5 (depends on 4) The method of claim 4, further comprising: detecting the one or more defects on or within the workpiece during the comparing; using a controller to position a pressure conveying system relative to the one or more defects; and activating the pressure conveying system to dislodge the one or more defects from the workpiece. ### Claim 6 (depends on 5) The method of claim 5, wherein the activating of the pressure conveying system comprises at least one of activating a blower to output a stream of air to dislodge the one or more defects and activating a vacuum to apply a vacuum force to the one or more defects. ### Claim 7 (depends on 1) The method of claim 1, wherein the altering of the patterned light results in homogenizing the light reflected from the second section of the workpiece, except for light reflected from the one or more defects. ### Claim 8 (depends on 1) The method of claim 1, further comprising: depositing a first composite layer of the workpiece onto a working surface using a composite layup system, wherein the first section of the workpiece is a first section of an aircraft subassembly and the second section of the workpiece is a second section of the workpiece; performing the imaging of the patterned light reflected from the first section of the aircraft subassembly; depositing a second composite layer of the aircraft subassembly onto the first composite layer; outputting the patterned light onto a first section of the second composite layer using the illumination source, wherein the first section of the second composite layer reflects the patterned light; and imaging the patterned light reflected from the first section of the second composite layer using the feedback camera to generate a third output. ### Claim 9 An inspection system, comprising: an illumination source configured to output a patterned light and to illuminate a first section of a workpiece with the patterned light, wherein: the illumination source comprises a plurality illumination elements and each illumination element of the plurality of illumination elements is individually controllable with respect to light intensity; the illumination source is an organic light emitting diode (OLED) display; and the plurality of illumination elements comprises a plurality of OLEDs; a feedback camera configured to image the patterned light from the illumination source that is reflected from the first section of the workpiece, and to generate a first output; a background camera configured to image a second section of the workpiece that is not illuminated by the illumination source, and to generate a second output; and a controller coupled to the illumination source, the feedback camera, and the background camera, wherein the controller is configured to alter a light pattern of the patterned light output by the illumination source by individually controlling each OLED of the plurality of OLEDs with respect to the light intensity, thereby changing one or more of an intensity, a hue, a saturation, and a color of the patterned light based on a comparison of the first output to the second output, thereby increasing a contrast of one or more defects located in the first section of the workpiece. ### Claim 10 (depends on 9) The inspection system of claim 9, wherein the plurality of illumination elements comprises at least one million OLEDs. ### Claim 11 (depends on 9) The inspection system of claim 9, wherein each OLED is configured to output an intensity of at least 1000 lux and to have a luminous efficiency of at least 100 lumens per Watt. ### Claim 12 (depends on 9) The inspection system of claim 9, further comprising a visual display for displaying data obtained from the first output generated by the feedback camera. ### Claim 13 (depends on 12) The inspection system of claim 12, wherein the visual display is configured to display an image of the one or more defects located in the first section of the workpiece imaged by the feedback camera for review by an operator. ### Claim 14 (depends on 9) The inspection system of claim 9, further comprising an inspection camera for imaging the second section of the workpiece during the illumination by the illumination source and to provide a third output to the controller. ### Claim 15 (depends on 14) The inspection system of claim 14, further comprising a pressure conveying system electrically coupled to, and controlled by, the controller, wherein the controller is configured to position the pressure conveying system relative to the one or more defects detected during the comparison using the third output from inspection camera, and to activate the pressure conveying system to dislodge the one or more defects from a surface of the workpiece. ### Claim 16 (depends on 15) The inspection system of claim 15, wherein the pressure conveying system comprises at least one of a blower configured to output a stream of air to dislodge the one or more defects and a vacuum configured to apply a vacuum force to the one or more defects. ### Claim 17 (depends on 9) The inspection system of claim 9, wherein the illumination source comprises an array of at least one million of the illumination elements, and the controller is configured to vary the intensity, hue, saturation, color, and the light pattern of the patterned light output by the illumination source such that the feedback camera images an illuminated surface of the workpiece that is homogenous with respect to intensity, hue, saturation, and color, except for the one or more defects on or within the surface of the workpiece. ### Claim 18 An aircraft manufacturing line, comprising: a composite layup system configured to deposit a plurality of layers of a composite aircraft subassembly onto a working surface; and an inspection system for inspecting the composite aircraft subassembly during a deposition of the plurality of layers, the inspection system comprising: an illumination source configured to output a patterned light and to illuminate a first section of a workpiece with the patterned light, wherein: the illumination source comprises a plurality of illumination elements and each illumination element of the plurality of illumination elements is individually controllable with respect to light intensity; the illumination source is an organic light emitting diode (OLED) display; and the plurality of illumination elements comprises a plurality of OLEDs; a feedback camera configured to image the patterned light from the illumination source that is reflected from the first section of the workpiece, and to generate a first output; a background camera configured to image a second section of the workpiece that is not illuminated by the illumination source, and to generate a second output; and a controller coupled to the illumination source, the feedback camera, and the background camera, wherein the controller is configured to alter a light pattern of the patterned light output by the illumination source by individually controlling each OLED of the plurality of OLEDs with respect to the light intensity, thereby changing one or more of an intensity, a hue, a saturation, and a color of the patterned light based on a comparison of the first output to the second output, thereby increasing a contrast of one or more defects located in the first section of the workpiece. ### Claim 19 (depends on 18) The aircraft manufacturing line of claim 18, wherein the plurality of illumination elements comprises at least one million OLEDs. ### Claim 20 (depends on 18) The aircraft manufacturing line of claim 18, wherein each OLED is configured to output an intensity of at least 1000 lux and to have a luminous efficiency of at least 100 lumens per Watt.