Visualization and modification of operational bounding zones using augmented reality
AssigneeFanuc America Corporation
InventorsDerek Jung, Bruce Coldren, Sam Yung-Sen Lee, Leo Keselman, Kenneth W. Krause
Life of this patent
Estimating the term…
Loading patent…
AssigneeFanuc America Corporation
InventorsDerek Jung, Bruce Coldren, Sam Yung-Sen Lee, Leo Keselman, Kenneth W. Krause
Estimating the term…
An augmented reality (AR) system for visualizing and modifying robot operational zones. The system includes an AR device such as a headset in communication with a robot controller. The AR device includes software for the AR display and modification of the operational zones. The AR device is registered with the robot coordinate frame via detection of a visual marker. The AR device displays operational zones overlaid on real world images of the robot and existing fixtures, where the display is updated as the user moves around the robot work cell. Control points on the virtual operational zones are displayed and allow the user to reshape the operational zones. The robot can be operated during the AR session, running the robot's programmed motion and evaluating the operational zones. Zone violations are highlighted in the AR display. When zone definition is complete, the finalized operational zones are uploaded to the robot controller.
A system for visualization and modification of machine operational zones, said system comprising:
An apparatus for visualization and modification of robot operational zones, said apparatus comprising an augmented reality (AR) device in communication with a robot controller, said AR device being a headset worn by a user and having one or more cameras, inertial sensors and a display, said AR device further including a processor and memory configured to run an AR zone software application, where the AR device continuously tracks its position and orientation relative to a robot work cell, and the AR device provides a virtual display of one or more operational zones superimposed on images from the one or more cameras of a robot and other physical items in the work cell, where each of the operational zones includes control points used to define and modify operational zone size and shape, including control points used to define and modify corner points of hexahedral and pyramidal operational zones and control points used to define and modify length and end shape of cylindrical operational zones, and the AR device also checks for interference between the operational zones, parts of the robot and the other physical items in the work cell, including checking for interference while the robot is moved through a predefined motion program.
A method for visualization and modification of machine operational zones, said method comprising:
Dependencies are inferred from the claim text.