Optical-see-through head mounted display system and interactive operation

An interaction operating method for an optical-see-through head mounted display system, wherein the optical-see-through head mounted display system is mounted on a user and comprises a camera device and a display device and the camera device continuously shoots a space to form a plurality of image frames, for each of the image frame, the interaction operating method comprising:

• performing an image analysis to obtain positioning information of a marker in the space and input device three-dimensional information of an input device in the space;
• determining an image size and an image position of an image to be displayed by the display device and a virtual image position of a virtual image of the image according to the positioning information;
• performing an image shielding process to calculate a shielding area in the image corresponding to the input device according to the input device three-dimensional information and an eye position of the user and performing an image process on a portion of the image within the shielding area while the image is displayed;
• determining whether the input device touches the virtual image according to the positioning information and the input device three-dimensional information;
• and
• executing an event represented by a specific position on the image corresponding to the touch position according to a touch position which the input device touches the virtual image when it is determined the input device touches the virtual image.