Handheld display device having processor for rendering display output with real-time virtual transparency and video playback option

An interactive application stored on a non-transitory computer readable medium for execution on a handheld display device having an image sensor, a processor and an opaque touch-sensitive display screen, the interactive application being configured to operatively control the device so as to perform the steps of:

• monitoring the identity of the substrate and the position of the device relative to the substrate using the image data;
• retrieving display data based on the position of the device relative to the substrate;
• rendering display output to the touch-sensitive display screen, said display output being at least partially based on the retrieved display data, said display output including a video playback icon;
• interpreting user interaction with the video playback icon via the touch-sensitive display screen;
• retrieving video data in response to said user interaction with the video playback icon;
• and initiating video playback using the retrieved video data, wherein the interactive application is configured to operatively control the device such that the opaque touch-sensitive display screen has real-time virtual transparency through the screen to the printed content from a user's perspective to provide a virtual window to the printed content.

A method of interacting with printed content using a handheld display device, said method comprising the steps of:

• imaging an area of a printed substrate and generating image data using an image sensor of the handheld display device, the imaged area of the printed substrate containing the printed content;
• monitoring the identity of the substrate and the position of the device relative to the substrate using the image data;
• retrieving display data based on the position of the device relative to the substrate;
• rendering display output to the touch-sensitive display screen, said display output being at least partially based on the retrieved display data, said display output including a video playback icon;
• interpreting user interaction with the video playback icon via the touch-sensitive display screen;
• retrieving video data in response to said user interaction with the video playback icon;
• and
• initiating video playback using the retrieved video data,
• wherein the opaque touch-sensitive display screen has real-time virtual transparency through the screen to the printed content from a user's perspective to provide a virtual window to the printed content.