User interface for integrated gestural interaction and multi-user collaboration in immersive virtual reality environments

A method of providing an augmented reality environment, the method including:

• integrating a virtual device including a contextual command input onto a representation of a detected user body portion, the contextual command input providing an interaction with multiple electronic devices in a real world space;
• generating, for display, a presentation including (i) a visual rendering of the user body portion and (ii) at least one instance of the virtual device affixed to the visual rendering of the user body portion, wherein the contextual command input included in the virtual device facilitates a control interface for changing operational modes of at least one electronic device of the multiple electronic devices;
• and
• responsive to a selection of one item of the contextual command input to select an operation of a particular electronic device of the multiple electronic devices, updating the contextual command input included in the virtual device to include items specifically for the particular electronic device.

A system, comprising:

• a processing system configured to (i) detect, from information sensed from a real world space, at least one of a position and a motion of an appendage of a user, (ii) determine at least one point on the appendage to which a virtual device including a contextual menu can be affixed for interacting with multiple electronic devices included in a scene of the real world space, and (iii) detect, from the sensed information, a finger gesture made freely in 3D space;
• and
• a processing system configured to generate, for display, a presentation including (i) a visual rendering of at least a portion of a detected appendage and (ii) at least one instance of a virtual device including a contextual menu providing a virtual interface for interacting with multiple electronic devices included in a scene of a real world space, the at least one instance of the virtual device being affixed to the visual rendering of the portion of the appendage, wherein the contextual menu included in the virtual device includes menu items facilitating a control interface for changing operational modes of at least one electronic device of the multiple electronic devices,
• wherein, the processing system, responsive to a selection of one of the menu items of the contextual menu to select an operation of a particular electronic device of the multiple electronic devices, updating the contextual menu included in the virtual device to include menu items specifically for the particular electronic device.