# US 2022/0009100 A1 · Software Interface for Authoring Robotic Manufacturing Process

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0009100 A1
- Document ID: US20220009100A1
- Status: Published application
- Kind: A1
- Application number: 17/379,920
- Filed: 2021-07-19
- Published: 2022-01-13
- Earliest claimed: 2014-04-01
- Assignees: X Development LLC
- Applicants: X Development LLC
- Inventors: Jeffrey Linnell; Kendra Byrne; Matthew Bitterman
- Web page: https://patentgrep.com/patent/US20220009100A1

## CPC

- B25J 9/1664: {characterised by motion, path, trajectory planning}
- G05B 2219/35216: Program, generate nc program, code from cad data
- Y10S 901/41: Tool
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- Y10S: TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS

## Abstract

Example systems and methods allow for use of a graphical interface to cause one or more robotic devices to construct an output product. One example method includes causing a graphical interface to be displayed on a display device, receiving input data corresponding to one or more interactions with the graphical interface indicating at least one motion path and at least one sequence of tool actions to execute at one or more points within the at least one motion path for use in construction of an output product, generating a plurality of digital nodes including at least one robot node, at least one motion command node, and at least one tool command node, and providing instructions for the at least one robot actor to move according to the sequence of robot motion commands determined by the at least one motion command node and execute the sequence of tool commands determined by the at least one tool command node to construct the output product.

## Claims

### Claim 1

(canceled)

### Claim 2

A computer-implemented method comprising:
receiving first data representing a three-dimensional (3D) volume of a physical workcell that comprises one or more robot actors;
defining a variable safe zone, wherein the variable safe zone represents a particular volume within the 3D volume of the physical workcell, and wherein the particular volume is variable dependent on a state of the physical workcell; and
performing a safety check to determine, as the one or more robot actors move through a sequence of pre-programmed steps within the physical workcell, whether any robot actor exits the variable safe zone.

### Claim 3 (depends on 2)

The method of claim 2, further comprising receiving a 3D model that represents a 3D volume of a portion of the physical workcell that will be occupied through motion of the one or more robot actors as the one or more robot actors move through the sequence of pre-programmed steps.

### Claim 4 (depends on 2)

The method of claim 2, wherein receiving the first data representing the 3D volume of the physical workcell comprises receiving image data representing the physical workcell.

### Claim 5 (depends on 2)

The method of claim 2, wherein defining the variable safe zone comprises:
receiving, as user entry, second data representing a fixed volume within the 3D volume of the physical workcell.

### Claim 6 (depends on 2)

The method of claim 2, wherein defining the variable safe zone comprises:
defining the variable safe zone based on a detected motion, jerk, velocity, or acceleration of an object in the variable safe zone.

### Claim 7 (depends on 6)

The method of claim 6, wherein defining the variable safe zone comprises:
defining, as the variable safe zone, a larger volume when the one or more robot actors are moving at a higher velocity.

### Claim 8 (depends on 2)

The method of claim 2, wherein defining the variable safe zone comprises:
receiving location data generated by a transponder device; and
updating the variable safe zone based on the location data.

### Claim 9 (depends on 8)

The method of claim 8, wherein the transponder device is attached to a robot actor, and wherein the variable safe zone is defined by a distance from the transponder device.

### Claim 10 (depends on 2)

The method of claim 2, wherein the variable safe zone is defined prior to the execution of the sequence of pre-programmed steps by the one or more robot actors.

### Claim 11 (depends on 2)

The method of claim 2, further comprising visualizing the execution of the sequence of pre-programmed steps in software as if it were to actually occur within the physical world.

### Claim 12 (depends on 11)

The method of claim 11, wherein visualizing the execution of the sequence of pre-programmed steps in software further comprises:
providing a graphical representation of a potential conflict if it has been determined that a robot actor is going to collide with the variable safe zone.

### Claim 13 (depends on 2)

The method of claim 2, further comprising designating an additional volume that is within the physical workcell and outside of the variable safe zone as an unsafe zone.

### Claim 14 (depends on 2)

The method of claim 2, further comprising, after performing the safety check, transmitting commands to the one or more robot actors to execute the sequence of pre-programmed steps within the physical workcell.

### Claim 15 (depends on 2)

The method of claim 2, wherein the particular volume represented by the variable safe zone is a volume within which the one or more robot actors can move without colliding with one another or any unexpected objects while executing the sequence of pre-programmed steps.

### Claim 16

A system comprising:
one or more computers; and
a non-transitory computer-readable medium coupled to the one or more computers having instructions stored thereon which, when executed by the one or more computers, cause the one or more computers to perform operations comprising:
receiving first data representing a three-dimensional (3D) volume of a physical workcell that comprises one or more robot actors;
defining a variable safe zone, wherein the variable safe zone represents a particular volume within the 3D volume of the physical workcell, and wherein the particular volume is variable dependent on a state of the physical workcell; and
performing a safety check to determine, as the one or more robot actors move through a sequence of pre-programmed steps within the physical workcell, whether any robot actor exits the variable safe zone.

### Claim 17 (depends on 16)

The system of claim 16, wherein the operations further comprise receiving a 3D model that represents a 3D volume of a portion of the physical workcell that will be occupied through motion of the one or more robot actors as the one or more robot actors move through the sequence of pre-programmed steps.

### Claim 18 (depends on 16)

The system of claim 16, wherein receiving the first data representing the 3D volume of the physical workcell comprises receiving image data representing the physical workcell.

### Claim 19 (depends on 16)

The system of claim 16, wherein defining the variable safe zone comprises one or more of:
receiving, as user entry, second data representing a fixed volume within the 3D volume of the physical workcell;
defining the variable safe zone based on a detected motion, jerk, velocity, or acceleration of an object in the variable safe zone; or
receiving location data generated by a transponder device and updating the variable safe zone based on the location data.

### Claim 20 (depends on 19)

The system of claim 19, wherein the transponder device is attached to a robot actor, and wherein the variable safe zone is defined by a distance from the transponder device.

### Claim 21

A non-transitory computer storage medium encoded with a computer program, the computer program comprising instructions that when executed by one or more processors cause the one or more processors to perform operations comprising:
receiving first data representing a three-dimensional (3D) volume of a physical workcell that comprises one or more robot actors;
defining a variable safe zone, wherein the variable safe zone represents a particular volume within the 3D volume of the physical workcell, and wherein the particular volume is variable dependent on a state of the physical workcell; and
performing a safety check to determine, as the one or more robot actors move through a sequence of pre-programmed steps within the physical workcell, whether any robot actor exits the variable safe zone.
