System and method for generating a representative computerized display of a user'S interactions with a touchscreen based hand held device on a gazed-at screen

A system for interacting with a touch screen based hand held device application, the system being operative in conjunction with an external digital display having a gazed-at display screen, on which a first image is provided which is based on another image produced by a touch screen based hand held device, the system interacting with a native interface operative, in a first, normal, default mode of operation of the hand held device, for sensing a user's interactions with the touch screen based hand held device and modifying a display on the touch screen based hand held device accordingly, the system comprising:

• virtual hovering apparatus operative, in a second, hovering, mode of operation of the hand held device, triggered by a trigger event and terminated by a release event, for sensing the user's interactions with the touch screen based hand held device and generating a representative display of the user's interactions superimposed on the first image;
• wherein the triggering and release events are touch events generated by the user's interaction with the touch screen representing a touch gesture, including simultaneous actions of at least two fingers, wherein at least one action is continuous, such as the gesture is not unintentional, including at least one of:
• putting two fingers on the touch screen and swiping both fingers, pressing on the touch screen and a typically simultaneous tap with another finger, putting two fingers on the touch screen, and then lifting one finger, while continuing to apply the other finger to the screen, placing two fingers on the touch screen at any location, followed by a drag of a single finger.

A computer program product, comprising a computer usable medium having a computer readable program code embodied therein, said computer readable program code adapted to be executed to implement a method for interacting with a touch screen based hand held device application, the method being operative in conjunction with an external digital display having a gazed-at display screen, on which a first image is provided which is based on another image produced by a touch screen based hand held device, the method including:

• in a first, normal, default mode of operation, sensing a user's interactions with the touch screen based hand held device and modifying a display on the touch screen based hand held device accordingly;
• in a second, hovering, mode of operation, triggered by a trigger event and terminated by a release event:
• sensing the user's interactions with the touch screen based hand held device;
• generating a representative display of the user's interactions superimposed on the first image;
• and
• detecting at least one predetermined touch event generated by the user's interaction with the touch screen representing a touch gesture, including simultaneous actions of at least two fingers, wherein at least one action is continuous, such as the gesture is not unintentional, including at least one of:
• putting two fingers on the touch screen and swiping both fingers, pressing on the touch screen and a typically simultaneous tap with another finger, putting two fingers on the touch screen, and then lifting one finger, while continuing to apply the other finger to the screen, placing two fingers on the touch screen at any location, followed by a drag of a single finger;
• and
• selecting between hovering mode and normal mode based on detected gesture, wherein at least one gestures indicates to select the normal mode and at least a second gesture indicates to select hovering mode.