Method and apparatus for interaction with virtual and real images

An interactive apparatus for virtual and real images, comprising:

• a transparent display;
• a first information capturing device, capturing an external object information on another side of the transparent display with respect to a user viewing the transparent display;
• a second information capturing device, capturing information of the user;
• and
• a processor, coupled to the transparent display, the first information capturing device, and the second information capturing device, loading and executing a plurality of program commands to:
• using the information of the user to detect a pointing operation of the user on the transparent display, and determining whether the pointing operation triggers the transparent display;
• if the transparent display is triggered, determining whether there is a prompt information at a trigger location of the pointing operation on the transparent display;
• if the prompt information is present, interacting with the user and the prompt information;
• and
• if the prompt information is not present, interacting with an object pointed to by the pointing operation located on the other side of the transparent display with respect to the user.