# US 2013/0211782 A1 · Automated Testing and Verification of a Robotic System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0211782 A1
- Document ID: US20130211782A1
- Status: Published application
- Kind: A1
- Application number: 13/370,855
- Filed: 2012-02-10
- Published: 2013-08-15
- Earliest claimed: 2012-02-10
- Assignees: Ascent Ventures, LLC
- Inventors: Samuel Rosenberg; Todd Jackson
- Web page: https://patentgrep.com/patent/US20130211782A1

## CPC

- B25J 9/16: Program controls (total factory control, i.e. centrally controlling a plurality of machines, G05B19/418)
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})

## Abstract

Methods automatically and comprehensively self-test the operation, hardware, and programs of a robotic system to reveal problems in a robotic system. The system preferably evaluates repeatability of measurement by each distance sensor, an accuracy of measurement by each distance sensor, an accuracy of movement of any positioning joints used to position the robot arm, and an accuracy of at least one routine of the system control programs. The positioning joints may include one or more rotational joints or one or more translational joints. In some embodiments, the robotic system is a robotic pulse/echo layer thickness (PELT) system. When a robotic system has passed all of the tests, then the system performance has been verified. The inclusion of these self-tests allows a robotic PELT system owner to determine whether or not the robotic portion of a system is performing correctly.

## Claims

### Claim 1

A method of self-evaluating the performance of a robotic system comprising at least one robot arm, at least one positioning joint for positioning the robot arm, at least one distance sensor coupled to the robot arm, a robot controller with computer programs for directing movement of the positioning joint, and a position-determining mechanism for determining a position of the positioning joint or the robot arm, and system control programs, the method comprising the steps of:
a computer receiving a plurality of distance measurements by each distance sensor and storing the distance measurements in a repository;
the computer evaluating repeatability of the plurality of distance measurements by each distance sensor;
the computer evaluating accuracy of the plurality of distance measurements by each distance sensor;
the computer evaluating accuracy of movement of the positioning joint in positioning the robot arm; and
the computer evaluating accuracy of at least one routine of the system control programs.

### Claim 2 (depends on 1)

The method of claim 1, wherein the step of the computer directing a plurality of distance measurements by each distance sensor and storing the distance measurements in the repository comprises the substep of:
the computer receiving the plurality of distance measurements between a test surface and the distance sensor, with the distance sensor aimed at a point on the test surface stationary with respect to the distance sensor, for each distance sensor.

### Claim 3 (depends on 2)

The method of claim 2, wherein the step of the computer evaluating repeatability of the plurality of distance measurements by each distance sensor comprises the substep of:
the computer comparing a difference between the distance measurements for each distance sensor to a predetermined tolerance value to evaluate repeatability of distance measurement by the distance sensor for each distance sensor.

### Claim 4 (depends on 2)

The method of claim 2, wherein the step of the computer evaluating accuracy of the plurality of distance measurements by each distance sensor comprises the substeps of:
the computer positioning each distance sensor at a plurality of locations at discrete distances from the test surface for each distance sensor;
the computer directing a distance measurement to the test surface from the distance sensor at each of the locations for each distance sensor and storing the distance measurements in the repository;
the computer collecting positional data from the position-determining mechanism at each of the locations and storing the positional data in the repository;
the computer calculating a calculated distance to the test surface from the positional data for each of the locations; and
the computer comparing a difference of the distance measurement and the calculated distance for each location from the position-determining mechanism to a predetermined tolerance value to evaluate the accuracy of measurement by each distance sensor.

### Claim 5 (depends on 2)

The method of claim 2, wherein the positioning joint comprises at least one rotational joint, the step of the computer evaluating accuracy of movement of the positioning joint in positioning the robot arm further comprising the substeps of:
the computer positioning each rotational joint in a plurality of discrete rotational joint positions over a range of motion of the rotational joint;
the computer directing a distance measurement to the test surface from the distance sensor at each rotational joint position for each rotational joint and storing the distance measurements in the repository;
the computer collecting positional data from the position-determining mechanism at each of the rotational joint positions and storing the positional data in the repository;
the computer calculating a calculated distance to the test surface from the positional data for each of the rotational joint positions; and
the computer comparing a difference of the distance measurement and the calculated distance for each rotational joint position for each rotational joint to a predetermined tolerance value to evaluate the accuracy of movement of each rotational joint.

### Claim 6 (depends on 2)

The method of claim 2, wherein the positioning joint comprises at least one translational joint, the step of the computer evaluating accuracy of movement of the positioning joint in positioning the robot arm further comprising the substeps of:
the computer positioning each translational joint in a plurality of discrete translational joint positions over a range of motion of the translational joint;
the computer directing a distance measurement to the test surface from the distance sensor at each translational joint position for each translational joint and storing the distance measurements in the repository;
the computer collecting positional data from the position-determining mechanism at each of the translational joint positions and storing the positional data in the repository;
the computer calculating a calculated distance to the test surface from the positional data for each of the translational joint positions; and
the computer comparing a difference of the distance measurement and the calculated distance for each translational joint position of each translational joint to a predetermined tolerance value.

### Claim 7 (depends on 2)

The method of claim 2, wherein the step of the computer evaluating accuracy of at least one routine of the system control programs further comprises the substeps of:
a) the computer directing a normalization procedure to place the distance sensor in a normalized orientation with respect to the test surface, wherein the test surface is planar;
b) the computer directing a distance measurement to the test surface from the distance sensor with the distance sensor in the normalized orientation and storing the distance measurements in the repository;
c) the computer collecting positional data from the position-determining mechanism with the distance sensor in the normalized orientation and storing the positional data in the repository;
d) the computer calculating a location of the test surface at which the distance sensor is directed from the positional data with the distance sensor in the normalized orientation and storing the location in a repository; and
e) the computer repeating steps a)-d) for a plurality of normalized orientations; and
f) the computer comparing differences of the distance measurements, the positional data, and the locations for each normalized orientation to a predetermined tolerance value to evaluate the normalization procedure.

### Claim 8 (depends on 2)

The method of claim 2, wherein the step of the computer evaluating accuracy of at least one routine of the system control programs further comprises the substeps of:
a) the computer directing a normalization procedure to place the distance sensor in a normalized orientation with respect to the test surface, wherein the test surface is planar;
b) the computer directing a distance measurement to the test surface from the distance sensor with the distance sensor in the normalized configuration and storing the distance measurement in the repository;
c) the computer collecting positional data from the position-determining mechanism with the distance sensor in the normalized configuration and storing the positional data in the repository;
d) the computer adjusting the distance sensor to a predetermined angle with respect to the normalized configuration;
e) the computer directing a distance measurement to the test surface from the distance sensor with the distance sensor at the predetermined angle and storing the distance measurement in the repository;
f) the computer collecting positional data from the position-determining mechanism with the distance sensor at the predetermined angle and storing the positional data in the repository;
g) the computer calculating a calculated distance to the test surface based on the distance measurement and the predetermined angle;
h) the computer repeating steps d)-g) for a plurality of predetermined angles; and
i) the computer comparing a difference of the distance measurements to the calculated distances to a predetermined tolerance value.

### Claim 9 (depends on 2)

The method of claim 2, wherein the step of the computer evaluating accuracy of at least one routine of the system control programs further comprises the substeps of:
a) the computer directing a normalization procedure to place the distance sensor in a normalized orientation with respect to the test surface, wherein the test surface is planar;
b) the computer directing a distance measurement to the test surface from the distance sensor with the distance sensor in the normalized configuration and storing the distance measurement in the repository;
c) the computer moving the distance sensor in a direction parallel to the test surface to a parallel plane position;
d) the computer directing a distance measurement to the test surface from the distance sensor with the distance sensor in the parallel plane position and storing the distance measurement in the repository;
e) the computer repeating steps c)-d) for at least one additional parallel plane position; and
f) the computer comparing a difference of the distance measurements to a predetermined tolerance value.

### Claim 10 (depends on 2)

The method of claim 2, wherein the robotic system further comprises a tool coupled to the robot arm, the step of the computer evaluating accuracy of at least one routine of the system control programs further comprising the substeps of:
the computer directing a normalization procedure to place the distance sensor in a normalized orientation with respect to the test surface, wherein the test surface is planar;
the computer directing a distance measurement to the test surface from the distance sensor with the distance sensor in the normalized orientation and storing the distance measurement in the repository;
the computer collecting positional data from the position-determining mechanism with the distance sensor in the normalized orientation and storing the positional data in the repository;
the computer directing a tool change procedure to position the tool in place of the distance sensor;
the computer collecting positional data from the position-determining mechanism with the tool at the normalized orientation and storing the positional data in the repository; and
the computer comparing a difference of positional data for the distance sensor and for the tool to a predetermined tolerance value to evaluate the tool change procedure.

### Claim 11 (depends on 2)

The method of claim 2, wherein the robotic system further comprises a tool coupled to the robot arm, the step of the computer evaluating accuracy of at least one routine of the system control programs further comprising the substeps of:
the computer directing a normalization procedure to place the distance sensor in a normalized orientation with respect to the test surface, wherein the test surface is planar;
the computer directing a distance measurement to the test surface from the distance sensor with the distance sensor in the normalized orientation and storing the distance measurement in the repository;
the computer collecting positional data from the position-determining mechanism with the distance sensor in the normalized orientation and storing the positional data in the repository;
the computer moving the distance sensor away from the test surface to a position at an offset distance farther from the test surface;
the computer directing a tool change procedure to position the tool in place of the distance sensor;
the computer directing a tool placement procedure to position the tool at a position separated from the test surface by the difference between the offset distance and the distance measurement;
the computer collecting positional data from the position-determining mechanism with the tool offset from the test surface; and
the computer comparing a difference of positional data for the tool with a calculated tool position to a predetermined tolerance value to evaluate the tool placement procedure.

### Claim 12 (depends on 2)

The method of claim 2, wherein the step of the computer evaluating accuracy of at least one routine of the system control programs further comprises the substeps of:
a) the computer directing a normalization procedure to place the distance sensor in a normalized orientation with respect to the test surface, wherein the test surface is non-planar;
b) the computer directing a distance measurement to the test surface from the distance sensor with the distance sensor in the normalized orientation and storing the distance measurements in the repository;
c) the computer collecting positional data from the position-determining mechanism with the distance sensor in the normalized orientation and storing the positional data in the repository;
d) the computer calculating a location of the test surface at which the distance sensor is directed from the positional data with the distance sensor in the normalized orientation and storing the location in a repository; and
e) the computer repeating steps a)-d) for a plurality of normalized orientations; and
f) the computer comparing differences of the distance measurements, the positional data, and the locations for each normalized orientation to a predetermined tolerance value to evaluate the normalization procedure.

### Claim 13 (depends on 2)

The method of claim 2, wherein the step of the computer evaluating accuracy of at least one routine of the system control programs further comprises the substeps of:
a) the computer directing a normalization procedure to place the distance sensor in a normalized orientation with respect to the test surface, wherein the test surface is non-planar and of a predetermined contour;
b) the computer directing a distance measurement to the test surface from the distance sensor with the distance sensor in the normalized configuration and storing the distance measurement in the repository;
c) the computer collecting positional data from the position-determining mechanism with the distance sensor in the normalized configuration and storing the positional data in the repository;
d) the computer adjusting the distance sensor to a predetermined angle with respect to the normalized configuration;
e) the computer directing a distance measurement to the test surface from the distance sensor with the distance sensor at the predetermined angle and storing the distance measurement in the repository;
f) the computer collecting positional data from the position-determining mechanism with the distance sensor at the predetermined angle and storing the positional data in the repository;
g) the computer calculating a calculated distance to the test surface based on the distance measurement and the predetermined angle;
h) the computer repeating steps d)-g) for a plurality of predetermined angles; and
i) the computer comparing a difference of the distance measurements to the calculated distances to a predetermined tolerance value.

### Claim 14 (depends on 2)

The method of claim 2, wherein the robotic system further comprises a tool coupled to the robot arm, the step of the computer evaluating accuracy of at least one routine of the system control programs further comprising the substeps of:
the computer directing a normalization procedure to place the distance sensor in a normalized orientation with respect to the test surface, wherein the test surface is non-planar;
the computer directing a distance measurement to the test surface from the distance sensor with the distance sensor in the normalized orientation and storing the distance measurement in the repository;
the computer collecting positional data from the position-determining mechanism with the distance sensor in the normalized orientation and storing the positional data in the repository;
the computer directing a tool change procedure to position the tool in place of the distance sensor;
the computer collecting positional data from the position-determining mechanism with the tool at the normalized orientation and storing the positional data in the repository; and
the computer comparing a difference of positional data for the distance sensor and for the tool to a predetermined tolerance value to evaluate the tool change procedure.

### Claim 15 (depends on 2)

The method of claim 2, wherein the robotic system further comprises a tool coupled to the robot arm, the step of the computer evaluating accuracy of at least one routine of the system control programs further comprising the substeps of:
the computer directing a normalization procedure to place the distance sensor in a normalized orientation with respect to the test surface, wherein the test surface is non-planar;
the computer directing a distance measurement to the test surface from the distance sensor with the distance sensor in the normalized orientation and storing the distance measurement in the repository;
the computer collecting positional data from the position-determining mechanism with the distance sensor in the normalized orientation and storing the positional data in the repository;
the computer moving the distance sensor away from the test surface to a position at an offset distance farther from the test surface;
the computer directing a tool change procedure to position the tool in place of the distance sensor;
the computer directing a tool placement procedure to position the tool at a position separated from the test surface by the difference between the offset distance and the distance measurement;
the computer collecting positional data from the position-determining mechanism with the tool offset from the test surface; and
the computer comparing a difference of positional data for the tool with a calculated tool position to a predetermined tolerance value to evaluate the tool placement procedure.

### Claim 16 (depends on 2)

The method of claim 2, wherein the method runs automatically without human intervention.

### Claim 17 (depends on 2)

The method of claim 2, wherein the method is executed as a program routine.

### Claim 18 (depends on 2)

The method of claim 2, wherein the computer uses no calibrated reference standards in executing the method.

### Claim 19 (depends on 2)

The method of claim 2, wherein the computer uses no comparisons to stored baseline references in executing the method.

### Claim 20 (depends on 2)

The method of claim 2 further comprising the computer using distance sensor data to monitor an operating environment of the robotic system.

### Claim 21

A method of evaluating the performance of a robotic system comprising a robot, a plurality of robot sensors, a robot controller with control programs, and system control programs with robot program routines, the method comprising the steps of:
a) a computer directing a plurality of distance measurements by the robot sensors and storing the distance measurements in a repository without human intervention;
b) the computer analyzing data from the robot sensors automatedly without human intervention to evaluate the positional accuracy of the robot and to evaluate the system control programs; and
c) the computer analyzing robot positional data automatedly without human intervention to test the functionality of the robot sensors and robot program routines.
