Eye tracking in remote desktop client

A non-transitory computer-readable storage medium encoded with instructions executable by a processor on a client device to:

• connect to a remote desktop on a remote server;
• receive screen data of the remote desktop from the remote server;
• display a portion of the remote desktop, a mode icon, and direction icons, the portion of the remote desktop being based on the screen data;
• operate in a first mode for the direction icons to locally scroll the remote desktop, comprising:
• detecting one of the direction icons being selected based on the user's eye movements and, in response, scrolling the remote desktop to display another portion of the remote desktop;
• and
• detecting the mode icon being selected based on the user's eye movements and, in response, switching from the first mode to a second mode for the direction icons;
• and
• operate in the second mode to remotely scroll in the remote desktop, comprising:
• detecting one of the direction icons being selected based on the user's eye movements and, in response, sending a scrolling command to the remote desktop on the remote server;
• receiving updated screen data of the remote desktop from the remote server;
• and
• displaying the other portion of the remote desktop based on the updated screen data.

A client device, comprising:

• a display screen;
• a camera to capture a user's eyes;
• a memory comprising instructions to track eye movements and to access a remote desktop on a remote server;
• a processor to execute the instructions in the memory to:
• track the eye movements to determine where the user is looking on the display screen;
• connect to the remote desktop on the remote server;
• receive screen data of the remote desktop from the remote server;
• display on the display screen a portion of the remote desktop, a mode icon, and direction icons, the portion of the remote desktop being based on the screen data;
• operate in a first mode for the direction icons to locally scroll the remote desktop, comprising:
• detecting one of the direction icons being selected based on the user's eye movements and, in response, scrolling the remote desktop to display another portion of the remote desktop;
• and
• detecting the mode icon being selected based on the user's eye movements and, in response, switching from the first mode to a second mode for the direction icons;
• and
• operate in the second mode to remotely scroll in the remote desktop, comprising:
• detecting one of the direction icons being selected based on the user's eye movements and, in response, sending a scrolling command to the remote desktop on the remote server;
• receiving updated screen data of the remote desktop from the remote server;
• and
• displaying on the display screen the other portion of the remote desktop based on the updated screen data