System and method for using virtual/augmented reality for interaction with collaborative robots in manufacturing or industrial environment
AssigneeRaytheon Company
InventorKristen M. Stone
Life of this patent
Estimating the term…
Abstract
A method includes determining a movement of an industrial robot in a manufacturing environment from a first position to a second position. The method also includes displaying an image showing a trajectory of the movement of the robot on a wearable headset. The displaying of the image comprises at least one of: displaying an augmented reality (AR) graphical image or video of the trajectory superimposed on a real-time actual image of the robot, or displaying a virtual reality (VR) graphical image or video showing a graphical representation of the robot together with the trajectory.
Claims20
A method comprising:
- determining a movement of an industrial robot in a manufacturing environment from a first position to a second position;
- displaying an image showing a trajectory of the movement of the robot on a wearable headset, which comprises at least one of:
- displaying an augmented reality (AR) graphical image or video of the trajectory superimposed on a real-time actual image of the robot;
- or
- displaying a virtual reality (VR) graphical image or video showing a graphical representation of the robot together with the trajectory;
- receiving information related to one or more actions of a person wearing the wearable headset during a training simulation involving the robot, the information indicating a movement limitation of the person;
- and
- transmitting the information to a workstation in the manufacturing environment for path programming of the robot to accommodate the movement limitation of the person.
A system comprising:
- at least one memory configured to store instructions;
- and
- at least one processor coupled to the at least one memory and configured when executing the instructions to:
- determine a movement of an industrial robot in a manufacturing environment from a first position to a second position;
- control a wearable headset to display an image showing a trajectory of the movement of the robot, which comprises at least one of:
- control the wearable headset to display an augmented reality (AR) graphical image or video of the trajectory superimposed on a real-time actual image of the robot;
- or
- control the wearable headset to display a virtual reality (VR) graphical image or video showing a graphical representation of the robot together with the trajectory;
- receive information related to one or more actions of a person wearing the wearable headset during a training simulation involving the robot, the information indicating a movement limitation of the person;
- and
- transmit the information to a workstation in the manufacturing environment for path programming of the robot to accommodate the movement limitation of the person.
A non-transitory computer readable medium containing instructions that when executed cause at least one processor to:
- determine a movement of an industrial robot in a manufacturing environment from a first position to a second position;
- control a wearable headset to display an image showing a trajectory of the movement of the robot on the wearable headset, which comprises at least one of:
- control the wearable headset to display an augmented reality (AR) graphical image or video of the trajectory superimposed on a real-time actual image of the robot;
- or
- control the wearable headset to display a virtual reality (VR) graphical image or video showing a graphical representation of the robot together with the trajectory;
- receive information related to one or more actions of a person wearing the wearable headset during a training simulation involving the robot, the information indicating a movement limitation of the person;
- and
- transmit the information to a workstation in the manufacturing environment for path programming of the robot to accommodate the movement limitation of the person.
Dependencies are inferred from the claim text.