Free-space multi-dimensional absolute pointer using a projection marker system

A non-propagating machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform a method, the method comprising:

• Capturing an image of two or more spatially fixed optical spots projected onto a display surface, the display surface displaying machine generated content capable of being manipulated via a cursor of a pointing device, wherein the images of the two or more optical spots is captured wirelessly using a handheld device representing the pointing device for which the optical spots serve as reference markers;
• and
• generating in the handheld device separate image data for each of the two or more spots within the image;
• processing in the handheld device the separate image data for each of the spots within the image to generate coordinate data for each of the spots within the image;
• wherein processing the image data further comprises:
• determining an intensity value for each of a plurality of pixels of the pixelated sensor;
• identifying a set of pixels in which each pixel has an intensity value above a specified threshold;
• generating coordinate data based on the intensity value and the location of each of the pixels in the set of pixels;
• transmitting from the handheld device the coordinate data derived from the processing of the image data;
• wherein a position of the cursor of the pointing device displayed on the display surface is determined and actively controlled based on the coordinate data transmitted from the handheld device.

A presentation system comprising:

• a projection apparatus to project two or more spatially fixed optical spots on a display surface for displaying machine generated content capable of being manipulated via a cursor of a pointing device;
• a handheld device representing the pointing device to wirelessly capture an images of each of the two or more optical spots projected onto the display surface, the optical spots serving as reference markers for the pointing device;
• the handheld device further adapted to generate separate image data for each of the two or more spots within the image, process the separate image data for each image to generate coordinate data for each spots within the image, and transmit from the handheld device the coordinate data derived from the processing of the image data;
• wherein processing the image data for each image further comprises:
• determining an intensity value for each of a plurality of pixels of the pixelated sensor;
• identifying a set of pixels in which each pixel has an intensity value above a specified threshold;
• and
• generating coordinate data based on the intensity value and the location of each of the pixels in the set of pixels;
• and
• a control unit communicatively coupled to the projection apparatus and the handheld device to determine and actively control a position of the cursor based on the coordinate data transmitted from the handheld device.