Direct hologram manipulation using imu

An electronic device for displaying an augmented reality environment, comprising:

• a memory, the memory stores an initial orientation associated with a secondary device in communication with the electronic device;
• one or more processors in communication with the memory, the one or more processors detect a triggering event corresponding with a virtual pointer mode and determine an initial virtual pointer location in response to detecting the triggering event, the one or more processors acquire orientation information from the secondary device and update the virtual pointer location based on the orientation information and the initial orientation;
• and
• a see-through display in communication with the one or more processors, the see-through display displays the augmented reality environment including a virtual pointer corresponding with the virtual pointer location.

One or more storage devices containing processor readable code for programming one or more processors to perform a method for controlling an augmented reality environment associated with an HMD comprising the steps of:

• detecting a triggering event corresponding with a virtual pointer mode of the HMD;
• determining a gaze direction associated with an end user of the HMD;
• determining an initial virtual pointer location based on the gaze direction;
• acquiring updated orientation information from a secondary device in communication with the HMD;
• updating the virtual pointer location based on the updated orientation information;
• displaying a virtual pointer within the augmented reality environment corresponding with the virtual pointer location;
• determining that a selection criterion has been satisfied;
• and
• displaying an updated augmented reality environment based on the selection criterion and the virtual pointer location.