Video-see-through (vst) device for interacting with objects within a vst environment and method for operating the same

A video-see-through (VST) device comprising:

• an user input interface configured to receive gesture input from a user;
• at least one memory storing one or more instructions;
• and
• at least one processor operatively connected to the at least one memory and configured to execute the one or more instructions to cause the VST device to:
• receive, through the user input interface, at least one user gesture of the user for selecting a spatial region of interest (ROI) within a field of view of the user,
• recognize the spatial ROI and at least one object located within the spatial ROI;
• generate at least one virtual bounding region enclosing the at least one recognized object located within the selected spatial ROI,
• determine at least one associated modality for enabling an interaction with the at least one object located within the at least one virtual bounding region, and
• generate at least one prompt corresponding to the at least one associated modality for interaction with the at least one object, based on a relative position of a hand of the user and the spatial ROI.