Remote control of a desktop application via a mobile device

A method for using a mobile device to control a remote device:

• establishing, at a mobile device, a remote control session between the mobile device and a remote device;
• receiving, at the mobile device, a first video stream from a first camera coupled to the mobile device, the first camera being coupled to an opposite side of the mobile device from a touch screen display of the mobile device;
• receiving, via the touch screen display, a selection of an area corresponding to a first object within the first video stream displayed on the touch screen display;
• analyzing, at the mobile device using hardware configured for determining motion vectors, the first video stream in order to identify a first gesture made by the first object within the first video stream;
• identifying, at the mobile device, a pointing device command corresponding to the first gesture;
• sending, from the mobile device to the remote device, the pointing device command, the pointing device command being configured to cause a cursor to move within an application executing on the remote device;
• receiving, at the mobile device, a second video stream from a second camera coupled to the mobile device;
• analyzing, at the mobile device using the hardware configured for determining motion vectors, the second video stream to determine a second gesture corresponding to motion of a second object within the second video stream;
• identifying, at the mobile device, a selection command corresponding to the second gesture;
• and
• sending, from the mobile device to the remote device, the selection command.

A non-transitory computer-readable medium comprising executable instructions that when executed by a mobile device, cause the mobile device to perform a method for using the mobile device to control a remote device, the method comprising:

• establishing, at the mobile device, a remote control session between the mobile device and a remote device;
• receiving, at the mobile device, a first video stream from a first camera coupled to the mobile device, the first camera being coupled to an opposite side of the mobile device from a touch screen display of the mobile device;
• receiving, via the touch screen display, a selection of an area corresponding to a first object within the first video stream displayed on the touch screen display;
• analyzing, at the mobile device using hardware configured for determining motion vectors, the first video stream in order to identify a first gesture made by the first object within the first video stream;
• identifying, at the mobile device, a pointing device command corresponding to the first gesture;
• sending, from the mobile device to the remote device, the pointing device command, the pointing device command being configured to cause a cursor to move within an application executing on the remote device;
• receiving, at the mobile device, a second video stream from a second camera coupled to the mobile device;
• analyzing, at the mobile device using the hardware configured for determining motion vectors, the second video stream to determine a second gesture corresponding to motion of a second object within the second video stream;
• identifying, at the mobile device, a selection command corresponding to the second gesture;
• and
• sending, from the mobile device to the remote device, the selection command.