Using eye tracking for super resolution

One or more non-transitory computer readable storage media encoded with instructions that, when executed by a computer processor, cause the computer processor to perform operations including:

• acquiring one or more video streams and displaying the one or more video streams on a display device;
• acquiring a layout of the displayed one or more video streams and a position at which each of the one or more video streams is displayed in the layout;
• obtaining, via an eye-tracking module, a location, a duration, and a frequency of eye-gaze of a user associated to the display device;
• identifying a first position in the layout that matches the location of eye-gaze of the user;
• comparing the duration of eye-gaze of the user to a first threshold time;
• and
• applying super-resolution using an algorithm to a first video stream of the one or more video streams that corresponds to the first position when the duration of eye-gaze is longer than the first threshold time, wherein applying the super-resolution using the algorithm includes generating a higher-resolution version of the first video stream from a lower-resolution version of the first video stream.

An apparatus, comprising:

• a display device configured to display one or more video streams obtained from one or more computing devices;
• an eye-tracking module configured to provide a location, a duration, and a frequency of eye-gaze of a user associated to the display device;
• and
• a processor configured to execute software instructions to:
• acquire a layout of the displayed one or more video streams and a position at which each of the one or more video streams is displayed in the layout;
• identify a first position in the layout that matches the location of eye-gaze of the user;
• compare the duration of eye-gaze of the user to a first threshold time;
• and
• apply super-resolution using an algorithm to a first video stream of the one or more video streams corresponding to the first position when the duration of eye-gaze is longer than the first threshold time, wherein applying the super-resolution using the algorithm includes generating a higher-resolution version of the first video stream from a lower-resolution version of the first video stream.