# US 10,119,866 B2 · In-process monitoring, automated decision-making, and process control for composite manufacturing using part-referenced ply-by-ply infrared thermography and other non-contact non-destructive inspection > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,119,866 B2 - Document ID: US10119866B2 - Status: Granted - Kind: B2 - Application number: 15/685,684 - Filed: 2017-08-24 - Published: 2017-12-07 - Granted: 2018-11-06 - Earliest claimed: 2015-12-07 - Assignees: The Boeing Company - Applicants: The Boeing Company - Inventors: Jeffrey G. Thompson; Gary E. Georgeson; Jill P. Bingham - Web page: https://patentgrep.com/patent/US10119866B2 ## CPC - G01J 5/10: using electric radiation detectors - G01N 25/72: Investigating presence of flaws - G01J 5/48: Thermography; Techniques using wholly visual means - G01J 2005/0077: {Imaging} - G01N 33/0003: {Composite materials} - G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N) - G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q) ## Abstract Method and apparatus for detecting defects in a composite is provided. After a ply of material for a workpiece is positioned, thermal energy is applied to a top surface of the ply of material, and a digital thermographic camera captures images of the top surface. A computer processor determines heat characteristics of the top surface to identify regions of the top surface with different heat characteristics. Such different areas are identified as regions that include a defect. The defect regions can be repaired prior to disposing additional plies of material over previously-applied plies. ## Claims ### Claim 1 A method, comprising: laying a first ply of material; applying thermal energy to a surface of the first ply of material; capturing at least one digital thermographic image of the surface of the first ply of material after applying the thermal energy; using a computer processor, analyzing at least one heat characteristic of regions of the first ply of material in the at least one digital thermographic image to identify defect regions in which the at least one heat characteristic is different than baseline data; based on the analyzing, making a determination as to whether the defect region includes a rejectable flaw or a sub-rejectable flaw, wherein: upon identifying a defect region including a rejectable flaw: outputting an alert; halting processing to allow the defect region to be corrected; resuming processing; and laying a second ply of material on the first ply of material after resuming processing; and upon identifying a defect region including a sub-rejectable flaw: laying a second ply of material on the first ply of material while the sub-rejectable flaw remains in the first ply of material. ### Claim 2 (depends on 1) The method of claim 1, further comprising curing the first ply of material and the second ply of material after laying the second ply of material. ### Claim 3 (depends on 1) The method of claim 1, wherein analyzing at least one heat characteristic in the at least one digital thermographic image comprises analyzing at least one heat characteristic of every pixel in the at least one digital thermographic image. ### Claim 4 (depends on 1) The method of claim 1, wherein the at least one heat characteristic comprises at least one of respective temperatures of the regions, respective first derivative rates of change of temperature of the regions over a plurality of digital thermographic images, and respective second derivative rates of change of temperature of the regions over a plurality of digital thermographic images, and wherein the at least one heat characteristic of a subject region is different than surrounding regions if a peak of a second derivative rate of change of temperature for the subject region differs in time from a peak of a second derivative rate of change of temperature of at least one surrounding regions by more than a threshold amount. ### Claim 5 (depends on 1) The method of claim 1, further comprising: determining that the second ply of material does not include a defect; and updating the baseline data based on a digital thermographic image of a surface of the second ply of material. ### Claim 6 (depends on 1) The method of claim 1, further comprising reinspecting the first ply of material after resuming processing. ### Claim 7 (depends on 1) The method of claim 1, wherein the alert includes an indication of a location of the defect region on the first ply of material. ### Claim 8 (depends on 1) The method of claim 1, wherein making the determination as to whether the defect region includes a rejectable flaw or a sub-rejectable flaw comprises performing a model-based assessment that determines the effect of the defect region with respect to one or more of structural, thermal, or adhesive qualities. ### Claim 9 A system, comprising: a work surface for arranging and compacting uncured composite layers; a heat source arranged relative to the surface and operable to provide thermal energy to a surface of a first ply of material on the work surface; a thermographic digital camera arranged relative to the surface and operable to capture at least one digital thermographic image of the surface of the first ply of material; a computer processor in communication with the thermographic digital camera and the heat source; and a computer memory containing a program that, when executed on the computer processor, performs an operation for processing data, comprising: applying thermal energy to a surface of the first ply of material; capturing at least one digital thermographic image of the surface of the first ply of material after applying the thermal energy; analyzing at least one heat characteristic of regions of the first ply of material in the at least one digital thermographic image to identify defect regions in which the at least one heat characteristic is different than baseline data; based on the analyzing, making a determination as to whether the defect region includes a rejectable flaw or a sub-rejectable flaw, wherein: upon identifying a defect region including a rejectable flaw: outputting an alert; halting processing to allow the defect region to be corrected; resuming processing; and laying a second ply of material on the first ply of material after resuming processing; and upon identifying a defect region including a sub-resectable flaw: laying a second ply of material on the first ply of material while the sub-rejectable flaw remains in the first ply of material. ### Claim 10 (depends on 9) The system of claim 9, wherein the program, when executed on the computer processor, performs an additional operation for processing data, comprising, upon receiving an indication of a correction being made to the defect region: outputting a second signal to the heat source to apply a second thermal energy to the surface of the first ply; capturing a second at least one digital thermographic image of the surface of the first ply after applying the second thermal energy; analyzing at least one heat characteristic of regions of the first ply in the second at least one digital thermographic image to identify defect regions in which the at least one heat characteristic is different than surrounding regions. ### Claim 11 (depends on 9) The system of claim 9, wherein analyzing at least one heat characteristic of the first ply in the at least one digital thermographic image to identify regions in which the at least one heat characteristic is different than surrounding regions comprises analyzing at least one heat characteristic of every pixel in the at least one digital thermographic image. ### Claim 12 (depends on 9) The system of claim 9, wherein the at least one heat characteristic of the first ply comprises at least one of respective temperatures of the regions, respective first derivative rates of change of temperature of the regions over a plurality of digital thermographic images, and respective second derivative rates of change of temperature of the regions over a plurality of digital thermographic images. ### Claim 13 (depends on 12) The system of claim 12, wherein the at least one heat characteristic of a subject region is different than surrounding regions if a peak of a second derivative rate of change of temperature for the subject region differs in time from a peak of a second derivative rate of change of temperature of at least one surrounding regions by more than a threshold amount. ### Claim 14 (depends on 8) The system of claim 8, wherein the alert includes an indication of a location of the defect region. ### Claim 15 A method, comprising: laying a first ply of material; applying thermal energy to a surface of the first ply of material; capturing at least one digital thermographic image of the surface of the first ply of material after applying the thermal energy; using a computer processor, analyzing at least one heat characteristic of regions of the first ply of material in the at least one digital thermographic image to identify defect regions in which the at least one heat characteristic is different than baseline data; based on the analyzing, making a determination as to whether the defect region includes a rejectable flaw or a sub-rejectable flaw, wherein: upon identifying a defect region including a rejectable flaw: outputting an alert; correcting the defect region; and laying a second ply of material on the first ply of material after correcting the defect region; and upon identifying a defect region including a sub-rejectable flaw: laying a second ply of material on the first ply of material while the sub-rejectable flaw remains in the first ply of material. ### Claim 16 (depends on 15) The method of claim 15, further comprising: capturing a digital thermographic image of a surface of the second ply of material; and comparing the digital thermographic image of a surface of the second ply of material to the baseline data. ### Claim 17 (depends on 16) The method of claim 16, wherein comparing the digital thermographic image of a surface of the second ply of material to the baseline data comprises determining whether a rejectable flaw exists and determining whether a sub-rejectable flaw exists. ### Claim 18 (depends on 17) The method of claim 17, wherein if a sub-rejectable flaw exists, further comprising laying a third ply of material on the second ply of material without issuing an alert or without halting processing. ### Claim 19 (depends on 15) The method of claim 15, further comprising: determining that the second ply of material does not include a defect; and updating the baseline model based on the digital thermographic image of a surface of the second ply of material. ### Claim 20 (depends on 15) The method of claim 15, further comprising reinspecting the first ply of material after correcting the defect and before laying the second ply of material.