US 11,961,305 B2Granted

Enhanced vehicle navigation using non-destructive inspection one-dimensional sensor arrays

AssigneeThe Boeing Company

InventorsWalter J. Jarecki, Gregory J. Sweers, Gary E. Georgeson, James J. Troy, Phillip R. Riste, Armando X. Membrila

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and methods for tracking the location of a non-destructive inspection (NDI) scanner using scan data converted into images of a target object. Scan images are formed by aggregating successive scan strips acquired using one or two one-dimensional sensor arrays. An image processor computes a change in location of the NDI scanner relative to a previous location based on the respective positions of common features in partially overlapping scan images. The performance of the NDI scanner tracking system is enhanced by: (1) using depth and intensity filtering of the scan image data to differentiate features for improved landmark identification during real-time motion control; and (2) applying a loop-closure technique using scan image data to correct for drift in computed location. The enhancements are used to improve localization, which enables better motion control and coordinate accuracy for NDI scan data.

Claims20

Dependent claims

A method for tracking a location of a scanner having a one-dimensional sensor array in a frame of reference of a target object, the method comprising:

(a) setting filter threshold values for depth and intensity which are associated with a specific type of feature;
(b) moving the scanner across a surface of a target object from a starting location to an ending location along a path;
(c) acquiring successive sets of sensor data at a known capture rate as the scanner moves along the path during step (b);
(d) converting the successive sets of sensor data to respective scan strips of scan image data;
(e) constructing successive scan images from respective sequences of scan strips converted from sensor data acquired as the scanner moves along the path during step (b);
(f) filtering the successive scan images using the filter threshold values to isolate the feature of the specific type, wherein the path along which the scanner moves during step (b) is adjusted based on results of the filtering;
(g) finding feature points in respective pairs of successive scan images;
(h) determining which feature points found in step (g) are common feature points in the respective pairs of successive scan images;
(i) computing pixel position differences between respective positions of common feature points in the respective pairs of successive scan images;
(j) computing respective scanner displacements by multiplying the respective pixel position differences computed in step (i) by a scaling factor representing a distance traveled by the scanner per scan strip;
and
(k) computing coordinates of successive positions of points on respective portions of the surface of the target object corresponding to the successive scan images based on the respective scanner displacements.

9 more elements

A method for tracking a location of a motion platform carrying first and second scanners that respectively comprise first and second one-dimensional sensor arrays which have respective mutually parallel centerlines separated by a fixed distance, the method comprising:

(a) setting filter threshold values for depth and intensity which are associated with a specific type of feature;
(b) moving the first scanner across a surface of a target object from a starting location to an ending location along a path;
(c) operating the first scanner to acquire a first sequence of sets of sensor data at a known capture rate as the first scanner moves along the path;
(d) operating the second scanner to acquire a second sequence of sets of sensor data at the known capture rate as the first scanner moves along the path;
(e) converting the first sequence of sets of sensor data to a corresponding first sequence of scan strips of scan image data;
(f) converting the second sequence of sets of sensor data to a corresponding second sequence of scan strips of scan image data, wherein a number of scan strips in the second sequence of scan strips is the same as a number of scan strips in the first sequence of scan strips;
(g) constructing successive first scan images from the first sequence of scan strips;
(h) constructing successive second scan images from the second sequence of scan strips;
(i) filtering the first and second scan images using the filter threshold values to isolate the feature of the specific type, wherein the path along which the first scanner moves during step (b) is adjusted based on results of the filtering;
(j) finding feature points in the first and second scan images;
(k) determining which feature points found in step (j) are common feature points in the first and second scan images;
(l) computing a pixel position difference between the respective positions of a common feature point in the first and second scan images;
and
(m) computing a scanner displacement by multiplying the pixel position difference computed in step (l) by a scaling factor representing a distance traveled by the first scanner per scan strip.

11 more elements

A system comprising:

a motorized motion platform comprising a frame;
a scanner comprising a one-dimensional sensor array supported by the frame;
and
a computer system communicatively coupled to receive sensor data from the one-dimensional sensor array and send control signals for controlling movement of the motorized motion platform, the computer system being configured to perform operations comprising:
(a) controlling the motorized motion platform to move the scanner across a surface of a target object from a starting location to an ending location along a path;
(b) acquiring successive sets of sensor data at a known capture rate as the scanner moves along the path during operation (a);
(c) converting the successive sets of sensor data to respective scan strips of scan image data;
(d) constructing successive scan images from respective sequences of scan strips converted from sensor data acquired as the scanner moves along the path during operation (a);
(e) filtering the successive scan images to isolate a feature of a specific type using filter threshold values for depth and intensity which are associated with the feature, wherein the path along which the scanner moves during operation (a) is adjusted based on results of the filtering;
(f) finding feature points in respective pairs of successive scan images;
(g) determining which feature points found in operation (f) are common feature points in the respective pairs of successive scan images;
(h) computing pixel position differences between respective positions of common feature points in the respective pairs of successive scan images;
(i) computing respective scanner displacements by multiplying the respective pixel position differences computed in operation (h) by a scaling factor representing a distance traveled by the scanner per scan strip;
and
(j) computing coordinates of successive positions of points on respective portions of the surface of the target object corresponding to the successive scan images based on the respective scanner displacements.

12 more elements

A method for tracking a location of a scanner having a one-dimensional sensor array in a frame of reference of a target object, the method comprising:

(a) moving the scanner across a surface of a target object from a starting location to an ending location along a path;
(b) acquiring successive sets of sensor data at a known capture rate as the scanner moves along the path during step (a);
(c) converting the successive sets of sensor data to respective scan strips of scan image data;
(d) constructing successive scan images from respective sequences of scan strips converted from sensor data acquired as the scanner moves along the path during step (a);
(e) finding feature points in respective pairs of successive scan images;
(f) determining which feature points found in step (e) are common feature points in the respective pairs of successive scan images;
(g) computing pixel position differences between respective positions of common feature points in the respective pairs of successive scan images;
(h) computing respective scanner displacements by multiplying the respective pixel position differences computed in step (g) by a scaling factor representing a distance traveled by the scanner per scan strip;
(i) computing coordinates of successive positions of points on respective portions of the surface of the target object corresponding to the successive scan images based on the respective scanner displacements;
(j) comparing respective scan images corresponding to the start and ending locations of the scanner;
(k) determining a location offset of the ending location from the starting location;
(l) computing corrected coordinates of successive positions of points on the respective portions of the surface of the target object corresponding to successive scan images based on the location offset;
(m) associating the corrected coordinates with the successive scan images;
(n) computing corrected angles of successive orientations of the respective portions of the surface of the target object corresponding to the successive scan images based on the location offset;
(o) associating the corrected angles with the successive scan images;
and
(p) storing the successive scan images and associated corrected coordinates and corrected angles in a non-transitory tangible computer-readable storage medium.

14 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/469,167Filed 8 Sep 2021
Published: US 2023/0075574 A19 Mar 2023
Granted: 16 Apr 2024
Term ends: Not estimatedThe source records don’t support an estimate.

Classification13 codes

B64F 5/60
Designing, manufacturing, assembling, cleaning, maintaining or repairing aircraft, not otherwise provided for; Handling, transporting, testing…
G06V 20/56
Context or environment of the image: exterior to a vehicle by using sensors mounted on the vehicle
B64C 39/024
Characterised by special use: of the remote controlled vehicle type, i.e. RPV
G06F 18/2113
Selection of the most significant subset of features: by ranking or filtering the set of features, e.g. using a measure of variance or of feature…