Projector system employing depth perception to detect speaker position and gestures

A method performed by a projection system, comprising:

• projecting at least one image onto a viewing surface;
• acquiring with an input device a depth image of at least one foreground object relative to the input device, wherein the input device is at least one of a stereo camera and a system comprising two or more monocular cameras;
• determining from the acquired depth image the position of the foreground object;
• and
• modifying the projected at least one image based on the position of the foreground object;
• and
• creating from the acquired depth image a dynamic mask of the foreground object.

An interactive presentation system comprising:

• a processor;
• a storage device coupled to the processor, wherein the storage device stores static information and instructions for the processor;
• and
• software means operative on the processor for:
• projecting at least one image onto a viewing surface;
• acquiring with a vision based input device a depth image of at least one foreground object, wherein the vision based input device is at least one of a stereo camera and a system comprising two or more monocular cameras;
• identifying from at least one of the acquired depth image and an image acquired from the vision based input device at least one command instructing the interactive presentation system to perform an action;
• determining from the acquired depth image the position of the foreground object;
• creating from at least one of the acquired depth image and an image acquired from the vision based input device a dynamic mask of the foreground object;
• and
• modifying the projected at least one image based on the dynamic mask.