Cross-platform interactivity architecture

A system having an architecture for handling user commands from multiple operating system platforms via an extensible environment, the architecture comprising:

• a processing unit;
• and
• a system memory communicatively coupled to the processing unit, wherein the system memory includes instructions, that when executed by the processing unit, cause the processing unit to:
• recognize a first gesture by:
• receiving a first raw pointer input associated with a first object displayed in a first user interface from a first device operating on a first operating system platform, wherein the first raw pointer input indicates a pointer status and a location of the first raw pointer input relative to the first object in the first user interface;
• identifying a first set of gestures corresponding to the first operating system platform, the first set of gestures including a number and type of gestures based on expected pointer inputs capable of being performed on the first operating system platform;
• and
• recognizing the first gesture from the first set of gestures based on the first raw pointer input, the pointer status, and the location of the first raw pointer input relative to the first object;
• recognize a second gesture based on a received second raw pointer input associated with a second object displayed in a second user interface from a second device operating on a second operating system platform, the second gesture recognized from a second set of gestures corresponding to the second operating system platform, the second set of gestures including a number and type of gestures identified based on expected pointer inputs capable of being performed on the second operating system platform, wherein the second gesture is a different type of gesture from the first gesture and the second operating system platform is a different operating system platform than the first operating system platform;
• normalize the first raw pointer input and the second raw pointer input when determining the first gesture and the second gesture signify execution of a same command;
• determine the same command to be executed on the first device and the second device, the same command being determined based on a respective object and a respective gesture;
• and
• transmit the same command for execution on the first device and the second device when the first raw pointer input received from the first device is different from the second raw pointer input received from the second device.

A method for handling user commands from multiple operating system platforms at an architecture via an extensible environment, comprising:

• recognizing a first gesture by:
• receiving, at the architecture, from a first device operating on a first operating system platform, a first raw pointer input associated with a first object displayed in a first user interface and hit test results, wherein the hit test results identify the first object displayed in the first user interface;
• identifying, at the architecture, a first set of gestures corresponding to the first operating system platform, the first set of gestures including a number and type of gestures based on expected pointer inputs capable of being performed on the first operating system platform;
• and
• recognizing, at the architecture, the first gesture from the first set of gestures based on the first raw pointer input and the hit test results;
• recognizing, at the architecture, a second gesture based on a received second raw pointer input associated with a second object displayed in a second user interface of a second device operating on a second operating system platform, the second gesture recognized from a second set of gestures corresponding to the second operating system platform, the second set of gestures including a number and type of gestures identified based on expected pointer inputs capable of being performed on the second operating system platform, wherein the second gesture is a different type of gesture from the first gesture and the second operating system platform is a different operating system platform than the first operating system platform;
• normalizing, at the architecture, the first raw pointer input and the second raw pointer input when determining the first gesture and the second gesture signify execution of a same command;
• determining, at the architecture, the same command to be executed on the first device and the second device, the same command being determined based on a respective gesture to perform on a respective object;
• and
• transmitting the same command to a command stack for execution on the first device and the second device when the first raw pointer input received from the first device is different from the second raw pointer input received from the second device.