Robot control, training and collaboration in an immersive virtual reality environment
AssigneeThe Johns Hopkins University
InventorsKelleher Guerin, Gregory D. Hager
Life of this patent
Estimating the term…
Abstract
System and methods to create an immersive virtual environment using a virtual reality system that receives parameters corresponding to a real-world robot. The real-world robot may be simulated to create a virtual robot based on the received parameters. The immersive virtual environment may be transmitted to a user. The user may supply input and interact with the virtual robot. Feedback such as the current state of the virtual robot or the real-world robot may be provided to the user. The user may train the virtual robot. The real-world robot may be programmed based on the virtual robot training.
Claims26
A method for programming a robot, comprising:
- creating an immersive virtual environment (IVE) using a virtual reality system (VRS);
- receiving, by the VRS, parameters corresponding to a real-world robot;
- creating, by the VRS within said IVE, a virtual robot, wherein the virtual robot is a simulation of the real-world robot based on the received parameters;
- transmitting, by the VRS, a representation of said IVE to a user;
- receiving, by the VRS, input from the user, wherein said VRE is configured to allow the user to interact with the virtual robot using said user input;
- providing, by the VRS within said IVE, robot feedback to the user, wherein said robot feedback includes a current state of the virtual robot;
- training, in the VRS, the virtual robot in the IVE by the user;
- and
- programming, by the VRS, the real-world robot based on the virtual robot training,
- wherein said user interaction includes an egocentric perspective, wherein the user operates the virtual robot from a point of view of the robot, and a robot's end effector directly follows a motion of a hand of the user.
Dependencies are inferred from the claim text.