Interactions with 3d virtual objects using poses and multiple-dof controllers

A system comprising:

• a display system of a wearable device configured to provide a three-dimensional (3D) view to a user and permit a user interaction with objects in a field of view (FOV) of the user, the FOV comprising a portion of an environment around the user that is capable of being perceived by the user via the display system;
• a hardware processor in communication with the display system, the hardware processor programmed to:
• initiate a cone cast of a virtual cone;
• determine contextual information in the FOV of the user;
• anchor a proximal end of the virtual cone to an anchoring location associated with:
• a location in-between eyes of the user, a location on a portion of an arm of the user, or a location on a user input device, wherein movement of the anchoring location causes corresponding movement of the virtual cone so that the proximal end of the virtual cone remains at the anchoring location;
• determine one or more objects within the virtual cone;
• and
• perform an action on one or more of the objects within the virtual cone.