Device and method of creating an augmented interactive virtual reality system

A method for adding data into a video stream comprising:

• reading an input video data stream;
• accepting hotspots defining at least one object of interest shown within the video data stream;
• tracking movement of said hotspots generating a trajectory of said at least one object of interest in two-dimensional space of the video;
• defining a three-dimensional topology defining a three-dimensional volume of interest in a three-dimensional space;
• translating the hotspots to the three-dimensional volume;
• calculating motion of the hotspots in three-dimensional space;
• building virtual structures to relate said hotspots to said three-dimensional space to create a three dimensional geometric shape;
• and
• projecting resulting said shape.