Interactive video display system

A tangible computer readable storage medium having computer-executable instructions stored thereon, the computer-executable instructions readable by a computing system comprising one or more computing devices, wherein the computer-executable instructions are executable on the computing system in order to cause the computing system to perform a method of tracking movement of an object by a computing system comprising:

• receiving at a computing system a plurality of images from an image acquisition device;
• identifying an object of interest in at least one of the plurality of images;
• generating an influence image comprising one or more outline areas that each at least partially surround the identified object, wherein each of the outline areas are positioned successively further away from the identified object;
• mapping the at least one of the images, including the influence image, onto a video image depicting a virtual object;
• based at least on an overlap between one or more of the outline areas of the influence image and the virtual object, determining an interaction between the object and the virtual object.

A system comprising:

• a camera system operable to provide images of an object against a background;
• a display system operable to render video images onto a surface, wherein the video images comprise at least one virtual object;
• and
• a computing device configured to
• control rendering of the video images;
• and
• generate an influence image comprising two or more outline areas that each at least partially surround the object, wherein each of the outline areas are positioned successively further away from the object, wherein the outline areas are usable to estimate an interaction with at least one virtual object.