# US 2019/0318708 A1 · Adaptive parameters in image regions based on eye tracking information > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0318708 A1 - Document ID: US20190318708A1 - Status: Published application - Kind: A1 - Application number: 16/452,940 - Filed: 2019-06-26 - Published: 2019-10-17 - Earliest claimed: 2016-08-01 - Assignees: Facebook Technologies, LLC - Applicants: Facebook Technologies, LLC - Inventors: Martin Henrik Tall; Javier San Agustin Lopez; Rasmus Dahl - Web page: https://patentgrep.com/patent/US20190318708A1 ## CPC - G09G 5/37: Details of the operation on graphic patterns (G09G5/38 takes precedence) - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/147: using display panels - G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00) - G09G 5/14: Display of multiple viewports - G09G 5/391: Resolution modifying circuits, e.g. variable screen formats - H04N 19/124: Quantisation - H04N 19/162: User input - H04N 19/167: Position within a video image, e.g. region of interest [ROI] - H04N 19/17: the unit being an image region, e.g. an object - G09G 2320/0693: Calibration of display systems - G09G 2340/04: Changes in size, position or resolution of an image - G09G 2340/0407: Resolution change, inclusive of the use of different resolutions for different screen areas - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A display system divides a screen into regions and applies a different set of rendering/encoding parameters to each region. The system applies a first set of parameters to a first region that is being viewed by a fovea of an eye of a user. The system may also apply a second set of parameters to a second region that is being viewed by a parafovea of the eye, and apply a third set of parameters to a third region that is being viewed by the area of the eye outside of the parafovea. The first set of parameters are selected to yield relatively high image quality, while the second set of parameters are yield intermediate quality, and the third set of parameters yield lower quality. As a result, the second region and the third region can be rendered, encoded, and transmitted with less computing power and less bandwidth. ## Claims ### Claim 1 A method comprising: determining a plurality of screen regions of a screen of a display device, the plurality of screen regions comprising a first screen region separate from a second screen region, the first screen region containing a point of regard of a user, wherein the second screen region surrounds the first screen region; encoding a portion of an image corresponding to the first screen region to be displayed on the screen with a first image quality; encoding another portion of the image corresponding to the second screen region with a second image quality, the first image quality higher than the second image quality; and transmitting the encoded image to the display device to be displayed on the screen, wherein a size of the first screen region and a size of the second screen region are based on one or more predetermined parameters. ### Claim 2 (depends on 1) The method of claim 1, wherein the first screen region is a circle centered on the point of regard, and the second screen region is an annulus centered around the point of regard. ### Claim 3 (depends on 2) The method of claim 2, wherein the one or more predetermined parameters comprise: a radius of the first screen region, and a radius of an outer circle of the annulus, the outer circle corresponding to an outer edge of the second screen region. ### Claim 4 (depends on 1) The method of claim 1, wherein the first screen region is determined based on an intersection of a first cone with the screen of the display device, and the second screen region is determined based on an intersection of a second cone with the screen of the display device. ### Claim 5 (depends on 4) The method of claim 4, wherein the one or more predetermined parameters comprise: a first angle of the first cone, wherein a conical surface of the first cone is offset from an axis by the first angle, and a second angle of the second cone, wherein a conical surface of the second cone is offset from the axis by the second angle. ### Claim 6 (depends on 4) The method of claim 4, further comprising determining a gaze vector based on eye characteristics of the user, wherein an axis of the first cone and of the second cone is defined by the determined gaze vector. ### Claim 7 (depends on 1) The method of claim 1, wherein the first screen region is a rectangle centered on the point of regard, and a shape of the second screen region is defined by an outer rectangle centered on the point of regard, and the one or more predetermined parameters comprise: a length of the first screen region, and a length of a side of the outer rectangle that defines the shape of the second screen region. ### Claim 8 (depends on 7) The method of claim 7, wherein each side of the first screen region has a same length, and each side of the outer rectangle has a same length. ### Claim 9 (depends on 1) The method of claim 1, further comprising: determining one or more additional screen regions, the one or more additional screen regions configured to provide a smoother transition between the first screen region and the second screen region; and updating a size of each of the first screen region, the second screen region, and the one or more additional screen regions based on at least one of a noise in eye characteristics, an estimated accuracy of the eye characteristics, and a direction of gaze vectors. ### Claim 10 (depends on 9) The method of claim 9, further comprising: responsive to detecting a rapid eye movement between fixation points, increasing the size of each of the first screen region, the second screen region, and the one or more additional screen regions; and responsive to detecting that a fixation is stable after detecting the rapid eye movement, reducing the size of each of the first screen region, the second screen region, and the one or more additional screen regions. ### Claim 11 (depends on 1) The method of claim 1, wherein the first screen region corresponds to a region of the screen viewed by a fovea of an eye of the user, and the second screen region corresponds to a region of the screen viewed by a parafovea of an eye of the user. ### Claim 12 (depends on 1) The method of claim 1, wherein the first image quality comprises a first image resolution, the second image quality comprises a second image resolution, and the first image resolution is higher than the second image resolution. ### Claim 13 (depends on 1) The method of claim 1, wherein the first image quality comprises a first framerate, the second image quality comprises a second framerate, and the first framerate is higher than the second framerate. ### Claim 14 A non-transitory computer-readable medium storing instructions that, when executed by one or more processor, cause the one or more processors to perform operations comprising: determining a plurality of screen regions of a screen of a display device, the plurality of screen regions comprising a first screen region separate from a second screen region, the first screen region containing a point of regard of a user, wherein the second screen region surrounds the first screen region; encoding a portion of an image corresponding to the first screen region to be displayed on the screen with a first image quality; encoding another portion of the image corresponding to the second screen region with a second image quality, the first image quality higher than the second image quality; and transmitting the encoded image to the display device to be displayed on the screen, wherein a size of the first screen region and a size of the second screen region are based on one or more predetermined parameters. ### Claim 15 (depends on 14) The non-transitory computer-readable medium of claim 14, wherein the first screen region corresponds to a region of the screen viewed by a fovea of an eye of the user, and the second screen region corresponds to a region of the screen viewed by a parafovea of an eye of the user. ### Claim 16 (depends on 14) The non-transitory computer-readable medium of claim 14, wherein the first image quality comprises a first image resolution, the second image quality comprises a second image resolution, and the first image resolution is higher than the second image resolution. ### Claim 17 (depends on 14) The non-transitory computer-readable medium of claim 14, wherein the first image quality comprises a first framerate, the second image quality comprises a second framerate, and the first framerate is higher than the second framerate. ### Claim 18 (depends on 14) The non-transitory computer-readable medium of claim 14, wherein the first screen region is a circle centered on the point of regard, and the second screen region is an annulus centered around the point of regard. ### Claim 19 (depends on 14) The non-transitory computer-readable medium of claim 14, wherein the first screen region is determined based on an intersection of a first cone with the screen of the display device, and the second screen region is determined based on an intersection of a second cone with the screen of the display device. ### Claim 20 A system comprising: one or more processors; and a non-transitory computer-readable medium storing instructions that, when executed by the one or more processor, cause the one or more processors to perform operations comprising: determining a plurality of screen regions of a screen of a display device, the plurality of screen regions comprising a first screen region separate from a second screen region, the first screen region containing a point of regard of a user, wherein the second screen region surrounds the first screen region; encoding a portion of an image corresponding to the first screen region to be displayed on the screen with a first image quality; encoding another portion of the image corresponding to the second screen region with a second image quality, the first image quality higher than the second image quality; and transmitting the encoded image to the display device to be displayed on the screen, wherein a size of the first screen region and a size of the second screen region are based on one or more predetermined parameters.