User interface system based on pointing device

User interaction system, comprising:

• an electrical apparatus;
• a portable pointing device operable by a user for making a gesture, which portable pointing device includes a camera connected thereto for obtaining successive images from said space;
• and
• a digital signal processor capable of receiving and processing the successive images to identify a gesture made with said pointing device, and capable of transmitting user interface information to the electrical apparatus, said user interface information representing control information for said electrical apparatus corresponding to the identified gesture, where said digital signal processor comprises a pattern recognition module for recognizing a predetermined pattern in said successive images
• characterized in that the digital signal processor is further arranged, while receiving successive images data representing said successive images captured by the camera, to process the successive image data until a gesture, based on differences of successive positions of recognized predetermined patterns in successive images obtained by the camera can only be attributed to a single gesture,
• the digital signal processor further being arranged to output command identification data, which represents a user interaction command, corresponding with the identified gesture,
• the digital signal processor being further arranged to transmit the user interface information to the electrical apparatus as soon as the gesture is identified, which user interface information is constructed from said command identification data.