# US 11,079,357 B2 · Method and apparatus for enhanced visualization of anomalies in a structure > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,079,357 B2 - Document ID: US11079357B2 - Status: Granted - Kind: B2 - Application number: 15/935,349 - Filed: 2018-03-26 - Published: 2019-09-26 - Granted: 2021-08-03 - Earliest claimed: 2018-03-26 - Assignees: The Boeing Company - Applicants: The Boeing Company - Inventors: Jeong-Beom Ihn; Jung-Ryul Lee - Web page: https://patentgrep.com/patent/US11079357B2 ## CPC - G01N 29/069: {Defect imaging, localisation and sizing using, e.g. time of flight diffraction [TOFD], synthetic aperture focusing technique [SAFT], Amplituden-Laufzeit-Ortskurven [ALOK] technique} - G01M 5/0033: {by determining damage, crack or wear} - G01N 19/08: Detecting presence of flaws or irregularities - G01N 21/1702: {with opto-acoustic detection, e.g. for gases or analysing solids} - G01N 29/043: {in the interior, e.g. by shear waves} - G01N 29/0672: {by acoustic tomography (medical tomography A61B8/13)} - G01N 29/2418: {using optoacoustic interaction with the material, e.g. laser radiation, photoacoustics (photoacoustic cells G01N21/1702; measuring characteristics of vibrations by using radiation-sensitive means G01H9/00; acousto-optical conversion techniques for short-range imaging G01S15/8965; sound-producing devices using laser bundle G10K15/046)} - G01N 29/265: by moving the sensor relative to a stationary material - G01N 2021/1706: {in solids} - G01N 2291/017: Doppler techniques - G01N 2291/0231: Composite or layered materials - G01N 2291/2632: flat - G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q) - G01M: TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR ## Abstract Methods and apparatus for enhanced visualization of anomalies in a structure. The method comprises: acquiring pulse-echo laser ultrasonic wave propagation imaging video data at a multiplicity of points in a scan area on a surface of a structure; post-processing the pulse-echo laser ultrasonic wave propagation imaging video data using multiple-time window amplitude mapping to create a multiple-time window amplitude map; and displaying the multiple-time window amplitude map on a graphical user interface. ## Claims ### Claim 1 A method for enhanced visualization of anomalies in a structure, comprising: (a) acquiring pulse-echo laser ultrasonic wave propagation imaging video data at a multiplicity of points in a scan area on a surface of a structure; (b) post-processing the pulse-echo laser ultrasonic wave propagation imaging video data using multiple-time window amplitude mapping to create a multiple-time window amplitude map, wherein the post-processing comprises: designating at least one time window comprising a multiplicity of video freeze-frames, wherein each of the video freeze-frames correlates with a respective depth in the structure based on the speed of the wave propagation; selecting the one or more time windows in which a maximum magnitude of the amplitude of the wave is greater than a predetermined threshold; and creating the multiple-time window amplitude map being defined as a single image based on summed amplitude magnitudes in the selected video freeze-frames of the one or more selected time windows; and (c) displaying the multiple-time window amplitude map on a graphical user interface. ### Claim 2 (depends on 1) The method of claim 1, wherein said selecting of the one or more time windows of operation (b) is repeated until all the time windows having said maximum magnitude of the amplitude are selected. ### Claim 3 (depends on 1) The method as recited in claim 1, further comprising: (d) selecting at least three points on the multiple-time window amplitude map by human interaction with the graphical user interface; (e) calculating an area of a polygon defined by the at least three points; and (f) displaying alphanumeric symbology representing the area calculated in step (e) on the graphical user interface. ### Claim 4 (depends on 3) The method as recited in claim 3, wherein the at least three points are positioned on a boundary of an image of an anomaly displayed on the graphical user interface. ### Claim 5 (depends on 3) The method as recited in claim 3, further comprising: (g) selecting a point on the multiple-time window amplitude map by human interaction with the graphical user interface; (h) converting pixel coordinates of the point selected in step (g) to spatial coordinates in a frame of reference of a positioner that supports a laser scanning head; (i) controlling the positioner to move the laser scanning head to a pointing position having the spatial coordinates resulting from step (h); and (j) activating the laser scanning head to emit a laser beam while the laser scanning head is in the pointing position. ### Claim 6 (depends on 5) The method as recited in claim 5, wherein steps (h) through (j) are performed automatically in response to step (g). ### Claim 7 (depends on 1) The method as recited in claim 1, further comprising: (d) selecting a point on the multiple-time window amplitude map by human interaction with the graphical user interface; (e) converting pixel coordinates of the point selected in step (d) to spatial coordinates in a frame of reference of a positioner that supports a laser scanning head; (f) controlling the positioner to move the laser scanning head to a pointing position having the spatial coordinates resulting from step (e); and (g) activating the laser scanning head to emit a laser beam while the laser scanning head is in the pointing position. ### Claim 8 (depends on 7) The method as recited in claim 7, wherein steps (e) through (g) are performed automatically in response to step (d). ### Claim 9 A method for enhanced visualization of anomalies in a structure, comprising: (a) acquiring pulse-echo laser ultrasonic wave propagation imaging video data at a multiplicity of points in a scan area on a surface of a structure; (b) post-processing the pulse-echo laser ultrasonic wave propagation imaging video data to create a video freeze-frame; (c) displaying the video freeze-frame on a graphical user interface; (d) selecting at least three points on the video freeze-frame by human interaction with the graphical user interface; (e) calculating an area of a polygon defined by the at least three points; and (f) displaying alphanumeric symbology representing the area calculated in step (e) on the graphical user interface. ### Claim 10 (depends on 9) The method as recited in claim 9, wherein the at least three points are positioned on a boundary of an image of an anomaly displayed on the graphical user interface. ### Claim 11 (depends on 9) The method as recited in claim 9, further comprising: (g) selecting a point on the freeze frame by human interaction with the graphical user interface; (h) converting pixel coordinates of the point selected in step (g) to spatial coordinates in a frame of reference of a positioner that supports a laser scanning head; (i) controlling the positioner to move the laser scanning head to a pointing position having the spatial coordinates resulting from step (h); and (j) activating the laser scanning head to emit a laser beam while the laser scanning head is in the pointing position. ### Claim 12 (depends on 11) The method as recited in claim 11, wherein steps (h) through (j) are performed automatically in response to step (g). ### Claim 13 A method for enhanced visualization of anomalies in a structure, comprising: (a) acquiring pulse-echo laser ultrasonic wave propagation imaging video data at a multiplicity of points in a scan area on a surface of a structure; (b) post-processing the pulse-echo laser ultrasonic wave propagation imaging video data to create a video freeze-frame; (c) displaying the video freeze-frame on a graphical user interface; (d) selecting a point on the video freeze-frame by human interaction with the graphical user interface; (e) converting pixel coordinates of the point selected in step (d) to spatial coordinates in a frame of reference of a positioner that supports a laser scanning head; (f) controlling the positioner to move the laser scanning head to a pointing position having the spatial coordinates resulting from step (e); and (g) activating the laser scanning head to emit a laser beam while the laser scanning head is in the pointing position. ### Claim 14 (depends on 13) The method as recited in claim 13, wherein steps (e) through (g) are performed automatically by a computer system executing an anomaly pointing function in response to step (d). ### Claim 15 An apparatus for enhanced visualization of anomalies in a structure, comprising: a pulse-echo laser ultrasonic wave propagation imaging system comprising a laser scanning head; a graphical user interface; and a computer system configured to perform the following operations: (a) receiving pulse-echo laser ultrasonic wave propagation imaging video data from pulse-echo laser ultrasonic wave propagation imaging system; (b) post-processing the pulse-echo laser ultrasonic wave propagation imaging video data using multiple-time window amplitude mapping to create a multiple-time window amplitude map, wherein the post-processing comprises: designating at least one time window comprising a multiplicity of video freeze-frames, wherein each of the video freeze-frames correlates with a respective depth in the structure based on the speed of the wave propagation; selecting the one or more time windows in which a maximum magnitude of the amplitude of the wave is greater than a predetermined threshold; and creating the multiple-time window amplitude map being defined as a single image based on summed amplitude magnitudes in the selected video freeze-frames of the one or more selected time windows; and (c) controlling the graphical user interface to display the multiple-time window amplitude map. ### Claim 16 (depends on 15) The apparatus as recited in claim 15, wherein the computer system performing the operation (b) is further configured to repeat the selection of the one or more time windows until all the time windows having the maximum magnitude of the amplitude are selected. ### Claim 17 (depends on 15) The apparatus as recited in claim 15, wherein the computer system is further configured to perform the following operations: (d) receiving data representing selections of at least three points from the multiple-time window amplitude map; (e) calculating an area of a polygon defined by the at least three points; and (f) controlling the graphical user interface to display alphanumeric symbology representing the area calculated in operation (e). ### Claim 18 (depends on 17) The apparatus as recited in claim 17, wherein the at least three points are positioned on a boundary of an image of an anomaly displayed on the graphical user interface. ### Claim 19 (depends on 17) The apparatus as recited in claim 17, wherein the pulse-echo laser ultrasonic wave propagation imaging system further comprises a positioner to which the laser scanning head is mounted, and the computer system is further configured to perform the following operations: (g) receiving data representing a selection of a point on the multiple-time window amplitude map; (h) converting pixel coordinates of the selected point to spatial coordinates in a frame of reference of the positioner; (i) controlling the positioner to move the laser scanning head to a pointing position having the spatial coordinates resulting from operation (h); and (j) activating the laser scanning head to emit a laser beam while the laser scanning head is in the pointing position. ### Claim 20 (depends on 19) The apparatus as recited in claim 19, wherein the positioner is a two-axis linear positioner.