US 11,635,408 B2Granted

Method for tracking location of two-dimensional non-destructive inspection scanner on target object using scanned structural features

AssigneeThe Boeing Company

InventorsJoseph L. Hafenrichter, James J. Troy, Gary E. Georgeson

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and methods for tracking the location of a non-destructive inspection (NDI) scanner using images of a target object acquired by the NDI scanner. The system includes a frame, an NDI scanner supported by the frame, a system configured to enable motorized movement of the frame, and a computer system communicatively coupled to receive sensor data from the NDI scanner and track the location of the NDI scanner. The NDI scanner includes a two-dimensional (2-D) array of sensors. Subsurface depth sensor data is repeatedly (recurrently, continually) acquired by and output from the 2-D sensor array while at different locations on a surface of the target object. The resulting 2-D scan image sequence is fed into an image processing and feature point comparison module that is configured to track the location of the scanner relative to the target object using virtual features visible in the acquired scan images.

Claims17

Dependent claims

A method for tracking a location of a scanner, the method comprising:

(a) placing a sensor array of a scanner adjacent to a surface of a target object so that the sensor array overlies a first structural feature of the target object with a reference point on the sensor array at a first position having first X and first Y position coordinates on the surface of the target object which are known, wherein the sensor array is two-dimensional;
(b) acquiring a first set of sensor data from a first portion of the target object confronting the sensor array while the reference point is at the first position;
(c) converting the first set of sensor data to first scan image data of a first scan image;
(d) translating the scanner over the surface of the target object until the reference point is at a second position at a distance from the first position while the sensor array again overlies the first structural feature;
(e) acquiring a second set of sensor data from a second portion of the target object confronting the sensor array while the reference point is at the second position;
(f) converting the second set of sensor data to second scan image data of a second scan image;
(g) finding feature points in the first and second scan images;
(h) determining which feature points found in step (g) are common feature points in the first and second scan images;
(i) computing pixel position differences between the common feature points;
and
(j) calculating a second Y position coordinate of the reference point at the second position on the surface of the target object based at least partly on the first Y position coordinate and the pixel position differences computed in step (i),
wherein step (i) comprises:
calculating a first pixel offset equal to a number of pixel rows of the sensor array by which the position of a common feature point in the second scan image is offset from the position of the common feature point in the first scan image;
and
wherein step (j) comprises:
multiplying the first pixel offset by a distance between adjacent sensor rows to form a product equal to a first distance translated by the scanner in a direction perpendicular to the sensor rows during step (d);
and
adding the first distance to the first Y position coordinate to derive the second Y position coordinate of the reference point.

15 more elements

A method for tracking a location of a scanner, the method comprising:

(a) placing a sensor array of a scanner adjacent to a surface of a target object so that the sensor array overlies a first structural feature of the target object with a reference point on the sensor array at a first position having first X and first Y position coordinates on the surface of the target object which are known, wherein the sensor array is two-dimensional;
(b) acquiring a first set of sensor data from a subsurface structure of a first portion of the target object confronting the sensor array while the reference point is at the first position;
(c) converting the first set of sensor data to first scan image data of a first scan image;
(d) translating the scanner over the surface of the target object until the reference point is at a second position at a distance from the first position while the sensor array again overlies the first structural feature;
(e) acquiring a second set of sensor data from a subsurface structure of a second portion of the target object confronting the sensor array while the reference point is at the second position;
(f) converting the second set of sensor data to second scan image data of a second scan image;
(g) finding subsurface feature points in the first and second scan images;
(h) determining which subsurface feature points found in step (g) are common feature points in the first and second scan images;
(i) computing pixel position differences between the common feature points;
(j) calculating a second Y position coordinate of the reference point at the second position on the surface of the target object based at least partly on the first Y position coordinate and the pixel position differences computed in step (i);
and
(k) calculating a second X position coordinate of the reference point on the surface of the target object based at least partly on the first X position coordinate and the pixel position differences computed in step (i),
wherein step (i) comprises:
calculating a first pixel offset equal to a number of pixel rows by which the position of a common feature point in the second scan image is offset from the position of the common feature point in the first scan image;
and
calculating a second pixel offset equal to a number of pixel columns by which the position of the common feature point in the second scan image is offset from the position of the common feature point in the first scan image,
wherein step (j) comprises:
multiplying the first pixel offset by a distance between adjacent sensor rows to form a product equal to a first distance translated by the scanner in a direction perpendicular to the sensor rows during step (d);
and
adding the first distance to the first Y position coordinate to derive the second Y position coordinate, and
wherein step (k) comprises:
multiplying the second pixel offset by a distance between adjacent sensor columns to form a product equal to a second distance translated by the scanner in a direction parallel to the sensor rows during step (d);
and
adding the second distance to the first X position coordinate to derive the second X position coordinate.

21 more elements

A method for tracking a location of a scanner, the method comprising:

(a) placing a sensor array of a scanner adjacent to a surface of a target object so that the sensor array overlies first and second structural features of the target object and is oriented at a first orientation angle which is known;
(b) acquiring a first set of sensor data from a subsurface structure of a first portion of the target object confronting the sensor array while the sensor array is oriented at the first orientation angle;
(c) converting the first set of sensor data to first scan image data of a first scan image;
(d) orienting the scanner so that the sensor array has a second orientation angle different than the first orientation angle and again overlies the first and second structural features;
(e) acquiring a second set of sensor data from a subsurface structure of a second portion of the target object confronting the sensor array while the sensor array is oriented at the first orientation angle;
(f) converting the second set of sensor data to second scan image data of a second scan image;
(g) finding subsurface feature points in the first and second scan images;
(h) determining which subsurface feature points found in step (g) are common feature points in the first and second scan images;
(i) computing pixel position differences between first and second common feature points;
and
(j) calculating the second orientation angle based at least partly on the first orientation angle and a difference of a first angle of a first line connecting respective positions of the first and second common feature points in the first scan image and a second angle of a second line connecting respective positions of the first and second common feature points in the second scan image,
wherein step (i) comprises:
calculating a first pixel offset equal to a number of pixel rows by which the position of the second common feature point in the first scan image is offset from the position of the first common feature point in the first scan image;
calculating a second pixel offset equal to a number of pixel columns by which the position of the second common feature point in the first scan image is offset from the position of the first common feature point in the first scan image;
calculating a third pixel offset equal to a number of pixel rows by which the position of the second common feature point in the second scan image is offset from the position of the first common feature point in the second scan image;
and
calculating a fourth pixel offset equal to a number of pixel columns by which the position of the second common feature point in the second scan image is offset from the position of the first common feature point in the second scan image,
wherein the first angle has a tangent equal to a ratio of the first pixel offset to the second pixel offset and the second angle has a tangent equal to a ratio of the third pixel offset to the fourth pixel offset.

15 more elements

A system comprising a frame, a scanner supported by the frame and comprising a two-dimensional array of sensors, a robotic system configured to enable motorized movement of the frame, and a computer system communicatively coupled to receive sensor data from the sensors and send control signals to the robotic system for controlling motorized movement of the frame and configured to perform operations comprising:

(a) activating the sensors while the sensor array overlies a first structural feature of a target object with a reference point on the sensor array at a first position having first X and first Y position coordinates on a surface of a target object which are known;
(b) receiving a first set of sensor data acquired from a subsurface structure of a first portion of the target object confronting the sensor array while the reference point is at the first position;
(c) converting the first set of sensor data to first scan image data of a first scan image;
(d) activating the sensors while the sensor array overlies the first structural feature of a target object with the reference point at a second position at a distance from the first position;
(e) receiving a second set of sensor data acquired from a subsurface structure of a second portion of the target object confronting the sensor array while the reference point is at the second position;
(f) converting the second set of sensor data to second scan image data of a second scan image;
(g) finding subsurface feature points in the first and second scan images;
(h) determining which subsurface feature points found in step (g) are common feature points in the first and second scan images;
(i) computing pixel position differences between the common feature points;
and
(j) calculating a second Y position coordinate of the reference point at the second position on the surface of the target object based at least partly on the first Y position coordinate and the pixel position differences computed in step (i),
wherein step (i) comprises:
calculating a first pixel offset equal to a number of pixel rows by which the position of a common feature point in the second scan image is offset from the position of the common feature point in the first scan image;
and
wherein step (j) comprises:
multiplying the first pixel offset by a distance between adjacent sensor rows to form a product equal to a first distance translated by the scanner in a direction perpendicular to the sensor rows during step (d);
and
adding the first distance to the first Y position coordinate to derive the second Y position coordinate of the reference point.

15 more elements

(a) activating the sensors while the sensor array overlies a first structural feature of a target object with a reference point on the sensor array at a first position having first X and first Y position coordinates on a surface of a target object which are known;
(b) receiving a first set of sensor data acquired from a subsurface structure of a first portion of the target object confronting the sensor array while the reference point is at the first position;
(c) converting the first set of sensor data to first scan image data of a first scan image;
(d) activating the sensors while the sensor array overlies the first structural feature of a target object with the reference point at a second position at a distance from the first position;
(e) receiving a second set of sensor data acquired from a subsurface structure of a second portion of the target object confronting the sensor array while the reference point is at the second position;
(f) converting the second set of sensor data to second scan image data of a second scan image;
(g) finding subsurface feature points in the first and second scan images;
(h) determining which subsurface feature points found in step (g) are common feature points in the first and second scan images;
(i) computing pixel position differences between the common feature points;
(j) calculating a second Y position coordinate of the reference point at the second position on the surface of the target object based at least partly on the first Y position coordinate and the pixel position differences computed in step (i);
and
(k) calculating a second X position coordinate of the reference point on the surface of the target object based at least partly on the first X position coordinate and the pixel position differences computed in step (i),
wherein step (i) comprises:
calculating a first pixel offset equal to a number of pixel rows by which the position of a common feature point in the second scan image is offset from the position of the common feature point in the first scan image;
and
calculating a second pixel offset equal to a number of pixel columns by which the position of the common feature point in the second scan image is offset from the position of the common feature point in the first scan image,
wherein step (j) comprises:
multiplying the first pixel offset by a distance between adjacent sensor rows to form a product equal to a first distance translated by the scanner in a direction perpendicular to the sensor rows during step (d);
and
adding the first distance to the first Y position coordinate to derive the second Y position coordinate, and
wherein step (k) comprises:
multiplying the second pixel offset by a distance between adjacent sensor columns to form a product equal to a second distance translated by the scanner in a direction parallel to the sensor rows during step (d);
and
adding the second distance to the first X position coordinate to derive the second X position coordinate.

21 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/580,200Filed 24 Sep 2019
Published: US 2021/0089817 A125 Mar 2021
Granted: 25 Apr 2023
Term ends: Not estimatedThe source records don’t support an estimate.

Classification18 codes

G01N 29/0645
Display arrangements, e.g. colour displays: display representation or displayed parameters, e.g. A-, B- or C-Scan
B64F 5/60
Designing, manufacturing, assembling, cleaning, maintaining or repairing aircraft, not otherwise provided for; Handling, transporting, testing…
G01N 22/02
Investigating or analysing materials by the use of microwaves or radio waves, i.e. electromagnetic waves with a wavelength of one millimetre or…
G01N 29/043
Analysing solids: in the interior, e.g. by shear waves