# US 2017/0287112 A1 · Selective peripheral vision filtering in a foveated rendering system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0287112 A1 - Document ID: US20170287112A1 - Status: Published application - Kind: A1 - Application number: 15/087,629 - Filed: 2016-03-31 - Published: 2017-10-05 - Earliest claimed: 2016-03-31 - Assignees: Sony Computer Entertainment Inc. - Applicants: Sony Computer Entertainment Inc. - Inventors: Jeffrey Roger Stafford; Andrew Young - Web page: https://patentgrep.com/patent/US20170287112A1 ## CPC - G06F 3/012: {Head tracking input arrangements} - G02B 27/017: {Head mounted} - G02B 27/0179: {Display position adjusting means not related to the information to be displayed} - G06F 1/163: {Wearable computers, e.g. on a belt} - G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation} - G02B 2027/0118: {comprising devices for improving the contrast of the display / brillance control visibility} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0147: {comprising a device modifying the resolution of the displayed image} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G06T 2210/36: Level of detail - G06V 40/18: Eye characteristics, e.g. of the iris - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Gaze tracking data representing a viewer's gaze with respect to one or more images presented to the viewer is used to generate foveated image data representing one or more foveated images characterized by a higher level of detail within one or more regions of interest and a lower level of detail outside the regions of interest. The image data for portions outside the one or more regions of interest is selectively filtered to reduce visual artifacts due to contrast resulting from the lower level of detail before compositing foveated images for presentation. ## Claims ### Claim 1 A graphics processing method comprising: obtaining gaze tracking data representing a viewer's gaze with respect to one or more images presented to the viewer; generating foveated image data representing one or more foveated images using the gaze tracking data, wherein the one or more foveated images are generated with a higher level of detail within one or more regions of interest than a lower level of detail for one or more portions of the foveated images outside the one or more regions of interest; filtering the image data for the at least the one or more portions of the foveated images outside the one or more regions of interest to reduce visual artifacts due to contrast resulting from the lower level of detail; and compositing the one or more filtered foveated images; and displaying the one or more filtered foveated images to the viewer on a display device. ### Claim 2 (depends on 1) The method of claim 1, wherein filtering the image data for the at least the one or more portions of the one or more foveated images outside the one or more regions of interest to reduce visual artifacts due to contrast resulting from the lower level of detail includes selectively filtering of the one or more foveated images outside the one or more regions of interest that correspond to selected objects to maintain or increase the contrast. ### Claim 3 (depends on 1) The method of claim 1, wherein filtering the image data includes tagging one or more objects within the one or more foveated images but outside the one or more regions of interest with information reflecting a relative importance of the one or more objects. ### Claim 4 (depends on 3) The method of claim 3, wherein important objects outside the one or more regions of interest are subjected to less filtering to reduce artifacts than other portions of the one or more images outside the one or more regions of interest. ### Claim 5 (depends on 3) The method of claim 3, wherein tagging the one or more objects includes associating metadata with one or more objects. ### Claim 6 (depends on 3) The method of claim 3, wherein associating the metadata with the one or more objects is done subjectively through an application programming interface (API). ### Claim 7 (depends on 3) The method of claim 3, wherein associating the metadata with the one or more objects is done objectively by an algorithm. ### Claim 8 (depends on 3) The method of claim 3, wherein associating the metadata with the one or more objects is done by automatically tagging objects in the one or more foveated images that are moving as important based on motion vectors computed from the image data. ### Claim 9 (depends on 1) The method of claim 1, wherein filtering the image data includes inserting filtering information into the image data. ### Claim 10 (depends on 8) The method of claim 8, wherein the image data includes inserting filtering information into the image data by inserting the filtering data into a color buffer via the alpha channel depth buffer, stencil buffer, or an auxiliary buffer for each pixel in the one or more foveated images. ### Claim 11 A system, comprising: a processor; a memory; and computer-readable instructions embodied in the memory, the computer-readable instructions being configured to implement a graphics processing method when executed, the graphics processing method comprising: obtaining gaze tracking data representing a viewer's gaze with respect to one or more images presented to the viewer; generating image data representing one or more foveated images using the gaze tracking data, wherein the one or more foveated images are generated with a higher level of detail within one or more regions of interest than a lower level of detail for one or more portions of the foveated images outside the one or more regions of interest; generating filtered image data by filtering the image data for the at least the one or more portions of the foveated images outside the one or more regions of interest to reduce visual artifacts due to contrast resulting from the lower level of detail; and displaying a final composited image comprised of one or more filtered foveated images to the viewer on a display device. ### Claim 12 A non-transitory computer-readable medium having computer-readable instructions embodied therein, the computer-readable instructions being configured to implement a graphics processing method when executed, the graphics processing method comprising: obtaining gaze tracking data representing a viewer's gaze with respect to one or more images presented to the viewer; generating image data representing one or more foveated images using the gaze tracking data, wherein the one or more foveated images are generated with a higher level of detail within one or more regions of interest than a lower level of detail for one or more portions of the foveated images outside the one or more regions of interest; generating filtered image data by filtering the image data for the at least the one or more portions of the foveated images outside the one or more regions of interest to reduce visual artifacts due to contrast resulting from the lower level of detail; and displaying a final composited image comprised of one or more filtered foveated images to the viewer on a display device. ### Claim 13 (depends on 1) The graphics processing method of claim 1 wherein filtering the image data comprises applying an anti-aliasing filter to one or more portions of the one or more foveated images outside the one or more regions of interest.