# US 2026/0100174 A1 · Using eye tracking for super resolution > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2026/0100174 A1 - Document ID: US20260100174A1 - Status: Published application - Kind: A1 - Application number: 18/909,263 - Filed: 2024-10-08 - Published: 2026-04-09 - Earliest claimed: 2024-10-08 - Assignees: Cisco Technology, Inc. - Applicants: Cisco Technology, Inc. - Inventors: Jieyu Tan; Katerina Le Shiffer; Siyuan Li; Kanghua Zhu - Web page: https://patentgrep.com/patent/US20260100174A1 ## CPC - G09G 5/391: Resolution modifying circuits, e.g. variable screen formats - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G09G 2340/0407: Resolution change, inclusive of the use of different resolutions for different screen areas - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract A method and system are provided for applying super-resolution to a video and/or shared content in an audio and video communication session. One or more video streams are obtained from one or more computing devices and are displayed on a display device. A layout of the displayed one or more video streams and their respective positions as displayed in the layout is obtained. The location, duration, and frequency of eye-gaze of a user associated to the display device is obtained via an eye-tracking module. A first position in the layout that matches the location of eye-gaze of the user is obtained and the corresponding duration of eye-gaze is compared to a first threshold time. Super-resolution is applied to at least one of the one or more video streams that corresponds to the first position when the duration of eye-gaze is longer than the first threshold time. ## Claims ### Claim 1 A method, comprising: obtaining one or more video streams from one or more computing devices and displaying the one or more video streams on a display device; acquiring a layout of the displayed one or more video streams and a position at which each of the one or more video streams is displayed in the layout; obtaining, via an eye-tracking module, a location, a duration, and a frequency of eye-gaze of a user associated to the display device; identifying a first position in the layout that matches the location of eye-gaze of the user and comparing the duration of eye-gaze of the user to a first threshold time; and applying super-resolution using an algorithm to a first video stream of the one or more video streams that corresponds to the first position when the duration of eye-gaze is longer than the first threshold time, wherein applying the super-resolution using the algorithm includes generating a higher-resolution version of the first video stream from a lower-resolution version of the first video stream. ### Claim 2 (depends on 1) The method of claim 1, further comprising: comparing the frequency of eye-gaze to a threshold value and pinning, to the layout, the first video stream of the one or more video streams, that corresponds to the first position, when the frequency of eye-gaze is higher than the threshold value. ### Claim 3 (depends on 2) The method of claim 2, further comprising: un-pinning the first video stream that is pinned from the layout when the frequency of eye-gaze is lower than the threshold value. ### Claim 4 (depends on 1) The method of claim 1, further comprising: comparing the duration of eye-gaze to a second threshold time and enabling a zoom-in of contents included in the first video stream when the duration of eye-gaze is longer than the second threshold time, and enabling a zoom-out of the contents included in the first video stream when the duration of eye-gaze is lower than the second threshold time. ### Claim 5 (depends on 4) The method of claim 4, wherein the contents included in the first video stream is at least one selected from a group including a person and a shared data. ### Claim 6 (depends on 1) The method of claim 1, wherein applying super-resolution comprises: applying a first degree of super-resolution to the first video stream of the one or more video streams and applying a second degree of super-resolution to neighboring video streams of the first video stream in the layout, wherein the second degree of super-resolution is a lower resolution than the first degree of super-resolution. ### Claim 7 (depends on 1) The method of claim 1, wherein the one or more video streams comprises a text or an image. ### Claim 8 (depends on 1) The method of claim 1, wherein the one or more video streams comprise video of one or more users of the respective one or more computing devices. ### Claim 9 (depends on 1) The method of claim 1, wherein obtaining the one or more video streams comprises requesting one or more higher-resolution video streams from the one or more computing devices. ### Claim 10 (depends on 1) The method of claim 1, further comprising resizing the layout of the one or more video streams on the display device and remapping, via the eye-tracking module, the location, the duration, and the frequency of eye-gaze of the user associated to the display device. ### Claim 11 One or more non-transitory computer readable storage media encoded with instructions that, when executed by a computer processor, cause the computer processor to perform operations including: acquiring one or more video streams and displaying the one or more video streams on a display device; acquiring a layout of the displayed one or more video streams and a position at which each of the one or more video streams is displayed in the layout; obtaining, via an eye-tracking module, a location, a duration, and a frequency of eye-gaze of a user associated to the display device; identifying a first position in the layout that matches the location of eye-gaze of the user; comparing the duration of eye-gaze of the user to a first threshold time; and applying super-resolution using an algorithm to a first video stream of the one or more video streams that corresponds to the first position when the duration of eye-gaze is longer than the first threshold time, wherein applying the super-resolution using the algorithm includes generating a higher-resolution version of the first video stream from a lower-resolution version of the first video stream. ### Claim 12 (depends on 11) The one or more non-transitory computer readable storage media of claim 11, further comprising: comparing the frequency of eye-gaze to a threshold value and pinning, to the layout, the first video stream of the one or more video streams, that corresponds to the first position, when the frequency of eye-gaze is higher than the threshold value. ### Claim 13 (depends on 12) The one or more non-transitory computer readable storage media of claim 12, further comprising: un-pinning the first video stream that is pinned from the layout when the frequency of eye-gaze is lower than the threshold value. ### Claim 14 (depends on 11) The one or more non-transitory computer readable storage media of claim 11, further comprising: comparing the duration of eye-gaze to a second threshold time and enabling a zoom-in of contents included in the first video stream when the duration of eye-gaze is longer than the second threshold time and enabling a zoom-out of the contents included in the first video stream when the duration of eye-gaze is lower than the second threshold time. ### Claim 15 (depends on 14) The one or more non-transitory computer readable storage media of claim 14, wherein the contents included in the first video stream is at least one selected from a group including a person and a shared-data. ### Claim 16 (depends on 11) The one or more non-transitory computer readable storage media of claim 11, wherein applying super-resolution comprises: applying a first degree of super-resolution to the first video stream of the one or more video streams and applying a second degree of super-resolution to neighboring video streams of the first video stream in the layout, wherein the second degree of super-resolution is a lower resolution than the first degree of super-resolution. ### Claim 17 (depends on 11) The one or more non-transitory computer readable storage media of claim 11, further comprising resizing the layout of the one or more video streams on the display device and remapping, via the eye-tracking module, the location, the duration, and the frequency of eye-gaze of the user associated to the display device. ### Claim 18 An apparatus, comprising: a display device configured to display one or more video streams obtained from one or more computing devices; an eye-tracking module configured to provide a location, a duration, and a frequency of eye-gaze of a user associated to the display device; and a processor configured to execute software instructions to: acquire a layout of the displayed one or more video streams and a position at which each of the one or more video streams is displayed in the layout; identify a first position in the layout that matches the location of eye-gaze of the user; compare the duration of eye-gaze of the user to a first threshold time; and apply super-resolution using an algorithm to a first video stream of the one or more video streams corresponding to the first position when the duration of eye-gaze is longer than the first threshold time, wherein applying the super-resolution using the algorithm includes generating a higher-resolution version of the first video stream from a lower-resolution version of the first video stream. ### Claim 19 (depends on 18) The apparatus of claim 18, wherein the processor is further configured to compare the frequency of eye-gaze to a threshold value and pin, to the layout, the first video stream of the one or more video streams, that corresponds to the first position, when the frequency of eye-gaze is higher than the threshold value. ### Claim 20 (depends on 18) The apparatus of claim 18, wherein the processor is further configured to compare the duration of eye-gaze to a second threshold time and enable a zoom-in of contents included in the first video stream when the duration of eye-gaze is longer than the second threshold time. ### Claim 21 (depends on 1) The method of claim 1, wherein at least a second video stream of the one or more video streams is not subject to applying super-resolution. ### Claim 22 (depends on 11) The one or more non-transitory computer readable storage media of claim 11, wherein at least a second video stream of the one or more video streams is not subject to applying super-resolution. ### Claim 23 (depends on 18) The apparatus of claim 18, wherein at least a second video stream of the one or more video streams is not subject to applying super-resolution.