# US 2023/0146712 A1 · Robotic system for inspecting a part and associated methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0146712 A1
- Document ID: US20230146712A1
- Status: Published application
- Kind: A1
- Application number: 17/523,382
- Filed: 2021-11-10
- Published: 2023-05-11
- Earliest claimed: 2021-11-10
- Assignees: The Boeing Company
- Applicants: The Boeing Company
- Inventors: Jason G. DeStories; Michael R. Mercer; Jeffery Peebles; Patrick C. Scofield; Basilio Penuelas
- Web page: https://patentgrep.com/patent/US20230146712A1

## CPC

- B25J 9/1664: {characterised by motion, path, trajectory planning}
- B25J 9/1653: {parameters identification, estimation, stiffness, accuracy, error analysis}
- B25J 9/1684: {Tracking a line or surface by means of sensors}
- B25J 9/1697: {Vision controlled systems}
- B25J 11/0055: {Cutting}
- B25J 13/086: {Proximity sensors}
- B25J 13/089: {Determining the position of the robot with reference to its environment}
- G05B 2219/37422: Distance and attitude detector
- G05B 2219/49231: Keep tool, probe at constant distance from workpiece surface
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

A robotic system for inspecting a part comprises a robot comprising an articulating arm and an end effector, coupled to the articulating arm. The robotic system further includes three or more proximity sensors on the end effector and spaced apart from each other. Each of the proximity sensors is configured to detect a measured distance from the proximity sensor to a surface, such that the end effector is displaced from the surface. The robotic system includes a controller configured to receive measured distances from the proximity sensors. The controller is also configured to orient the end effector to a predetermined orientation based on the measured distances. The controller is further configured to calculate an average of the measured distances. Additionally, the controller is configured to move the end effector to a predetermined operating distance from the surface based on the average of the measured distance.

## Claims

### Claim 1

A robotic system for inspecting a part, comprising:
a robot comprising an articulating arm and an end effector, coupled to the articulating arm;
three or more proximity sensors on the end effector and spaced apart from each other, wherein each one of the three or more proximity sensors is configured to detect a measured distance from the proximity sensor to a surface, such that the end effector is continuously displaced from the surface; and
a controller configured to:
receive measured distances from the three or more proximity sensors;
orient the end effector to a predetermined orientation based on the measured distances;
after orienting the end effector to the predetermined orientation, calculate an average of the measured distances; and
move the end effector to a predetermined operating distance from the surface based on the average of the measured distance.

### Claim 2 (depends on 1)

The robotic system of claim 1, wherein the controller is further configured to orient the end effector to a perpendicular orientation, normal to the surface, based on the measured distances.

### Claim 3 (depends on 1)

The robotic system of claim 1, wherein the controller is further configured to:
determine when the measured distance from at least one of the three or more proximity sensors is outside an allowable distance tolerance; and
automatically reorient the end effector to the predetermined orientation when the measured distance from the at least one of the three or more proximity sensors is determined to be outside of the allowable distance tolerance.

### Claim 4 (depends on 3)

The robotic system of claim 3, wherein the controller is further configured to:
determine when the average of the measured distances is outside an allowable average-distance tolerance from the surface, the allowable average-distance tolerance corresponding with the predetermined operating distance; and
automatically move the end effector to the predetermined operating distance when the average of the measured distances is determined to be outside of the allowable average-distance tolerance.

### Claim 5 (depends on 1)

The robotic system of claim 1, wherein the three or more proximity sensors comprise four proximity sensors spaced apart from each other on the end effector.

### Claim 6 (depends on 5)

The robotic system of claim 5, wherein the four proximity sensors comprise a first set of proximity sensors and a second set of proximity sensors wherein:
the first set of proximity sensors comprises two proximity sensors that are opposite each other on the end effector and spaced apart at a first length from each other;
the second set of proximity sensors comprises two other proximity sensors, that are opposite each other on the end effector and spaced apart at a second length from each other; and
the first length and the second length are equal.

### Claim 7 (depends on 1)

The robotic system of claim 1, further comprising a scanning apparatus disposed on the end effector and configured to scan the surface, wherein the controller is configured to maintain the end effector at the predetermined operating distance while the scanning apparatus is scanning the surface, the predetermined operating distance correlating with the distance of the scanning apparatus relative to the surface such that the scanning apparatus is displaced from the surface.

### Claim 8 (depends on 7)

The robotic system of claim 7, further comprising a machining tool disposed on the end effector and configured to machine the surface as the scanning apparatus is scanning the surface.

### Claim 9 (depends on 1)

The robotic system of claim 1, wherein the end effector further comprises manual input features, onboard the end effector and configured to be manually manipulated to adjust a location of the end effector relative to the surface.

### Claim 10 (depends on 1)

The robotic system of claim 1, wherein each one of the three or more proximity sensors:
generates a beam; and
is individually adjustable to adjust an angle of the beam relative to a central axis of the end effector.

### Claim 11

A system for inspecting a part, the system comprising:
a surface to be inspected; and
robotic system, comprising:
a robot comprising an articulating arm and an end effector, coupled to the articulating arm;
three or more proximity sensors on the end effector and spaced apart from each other, wherein each one of the three or more proximity sensors is configured to detect a measured distance from the proximity sensor to the surface, such that the end effector is continuously displaced from the surface; and
a controller configured to:
receive measured distances from the three or more proximity sensors;
orient the end effector to a predetermined orientation based on the measured distances;
after orienting the end effector to the predetermined orientation, calculate an average of the measured distances; and
move the end effector to a predetermined operating distance from the surface based on the average of the measured distance.

### Claim 12 (depends on 11)

The system of claim 11, wherein the controller is further configured to orient the end effector to a perpendicular orientation, normal to the surface, based on the measured distance from each of the three or more proximity sensors.

### Claim 13 (depends on 11)

The system of claim 11, wherein the controller is further configured to direct movement of the end effector to follow a scanning pattern along the surface wherein, as the end effector is following the scanning pattern, the controller is configured to:
determine when the measured distance from at least one of the three or more proximity sensors is outside an allowable distance tolerance;
automatically reorient the end effector to the predetermined orientation when the measured distance from the at least one of the three or more proximity sensors is determined to be outside of the allowable distance tolerance;
determine when the average of the measured distances is outside an allowable average-distance tolerance from the surface, the allowable average-distance tolerance corresponding with the predetermined operating distance; and
automatically move the end effector to the predetermined operating distance when the average of the measured distances is determined to be outside of the allowable average-distance tolerance.

### Claim 14 (depends on 11)

The system of claim 11, wherein the controller is further configured to maintain the end effector at the predetermined orientation and the predetermined operating distance as the surface is moved relative to the end effector wherein the controller is configured to:
determine when the measured distance from at least one of the three or more proximity sensors is outside an allowable distance tolerance;
automatically reorient the end effector to the predetermined orientation when the measured distance from the at least one of the three or more proximity sensors is determined to be outside of the allowable distance tolerance;
determine when the average of the measured distances is outside an allowable average-distance tolerance from the surface, the allowable average-distance tolerance corresponding with the predetermined operating distance; and
automatically move the end effector to the predetermined operating distance when the average of the measured distances is determined to be outside of the allowable average-distance tolerance.

### Claim 15

A method of inspecting a part, the method comprising steps of:
moving an end effector, via an articulating arm of a robot, relative to a target location on a surface;
detecting a measured distance from the target location on the surface to each one of three or more proximity sensors on the end effector and spaced apart from each other;
orienting the end effector at a predetermined orientation based on the measured distances;
after orientating the end effector to the predetermined orientation, calculating an average of the measured distances; and
moving the end effector to a predetermined distance from the surface based on the average of the measured distances.

### Claim 16 (depends on 15)

The method of claim 15, wherein the step of moving the end effector, via the articulating arm of the robot, further comprises manipulating manual input features, onboard the end effector, to adjust a location of the end effector relative to the surface, such that beams generated from the three or more proximity sensors align with the target location on the surface.

### Claim 17 (depends on 15)

The method of claim 15, further comprising the step of individually adjusting an angle of a beam generated from each of the three of more proximity sensors to align with the target location on the surface.

### Claim 18 (depends on 15)

The method of claim 15, further comprising steps of:
maintaining the end effector at the predetermined orientation and the predetermined operating distance as the end effector follows a scanning pattern along the surface;
determining when the measured distance from at least one of the three or more proximity sensors is outside an allowable distance tolerance;
automatically reorienting the end effector to the predetermined orientation when the measured distance from the at least one of the three or more proximity sensors is determined to be outside of the allowable distance tolerance;
determining when the average of the measured distances is outside an allowable average-distance tolerance from the surface, the allowable average-distance tolerance corresponding with the predetermined operating distance; and
automatically moving the end effector to the predetermined operating distance when the average of the measured distances is determined to be outside of the allowable average-distance tolerance.

### Claim 19 (depends on 15)

The method of claim 15, further comprising steps of:
maintaining the end effector at the predetermined orientation and the predetermined operating distance as the surface is moved relative to the end effector;
determining when the measured distance from at least one of the three or more proximity sensors is outside an allowable distance tolerance;
automatically reorienting the end effector to the predetermined orientation when the measured distance from the at least one of the three or more proximity sensors is determined to be outside of the allowable distance tolerance;
determining when the average of the measured distances is outside an allowable average-distance tolerance from the surface, the allowable average-distance tolerance corresponding with the predetermined operating distance; and
automatically moving the end effector to the predetermined operating distance when the average of the measured distances is determined to be outside of the allowable average-distance tolerance.

### Claim 20 (depends on 15)

The method of claim 15, further comprising the step of scanning the surface to detect anomalies in the surface, via a scanning apparatus disposed on the end effector, wherein the predetermined operating distance correlates with the distance of the scanning apparatus relative to the surface such that the scanning apparatus is displaced from the surface.
