# US 2019/0156793 A1 · Adjusting an angular sampling rate during rendering utilizing gaze information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0156793 A1
- Document ID: US20190156793A1
- Status: Published application
- Kind: A1
- Application number: 15/880,460
- Filed: 2018-01-25
- Published: 2019-05-23
- Earliest claimed: 2017-11-21
- Assignees: NVIDIA Corporation
- Applicants: NVIDIA Corporation
- Inventors: Qi Sun; Fu-Chung Huang; Joohwan Kim; David Patrick Luebke
- Web page: https://patentgrep.com/patent/US20190156793A1

## CPC

- G09G 5/391: Resolution modifying circuits, e.g. variable screen formats
- G06T 15/20: Perspective computation
- G09G 5/001: {Arbitration of resources in a display system, e.g. control of access to frame buffer by video controller and/or main processor}
- H04N 13/139: Format conversion, e.g. of frame-rate or size
- H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
- G06F 3/147: using display panels
- G06T 15/005: {General purpose rendering architectures}
- G09G 2310/04: Partial updating of the display screen
- G09G 2340/0407: Resolution change, inclusive of the use of different resolutions for different screen areas
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/08: Power processing, i.e. workload management for processors involved in display operations, such as CPUs or GPUs
- G09G 2360/121: using a cache memory
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method, computer readable medium, and system are disclosed for adjusting an angular sampling rate during rendering. The method includes the steps of determining a location of a gaze within a displayed scene, and adjusting, during a rendering of the scene, an angular sampling rate used to render at least a portion of the scene, based on the location of the gaze within the displayed scene.

## Claims

### Claim 1

A method comprising:
determining, by a hardware processor, a location of a gaze within a displayed scene;
adjusting, by the hardware processor, an angular sampling rate to be used to render at least a portion of the scene, based on the location of the gaze within the displayed scene, the angular sampling rate indicating a number of different views to render for each pixel of one or more pixels in the at least a portion of the scene; and
rendering the at least a portion of the scene at the adjusted angular sampling rate.

### Claim 2 (depends on 1)

The method of claim 1, wherein the location of the gaze includes a current gaze point within the scene.

### Claim 3 (depends on 2)

The method of claim 2, wherein the adjusting includes determining an eccentricity from the current gaze point for a predetermined area within the scene.

### Claim 4 (depends on 3)

The method of claim 3, wherein the angular sampling rate is adjusted for the predetermined area, based on the eccentricity.

### Claim 5 (depends on 3)

The method of claim 3, wherein the adjusting includes increasing the angular sampling rate in response to a decrease in the eccentricity.

### Claim 6 (depends on 3)

The method of claim 3, wherein the adjusting includes decreasing the angular sampling rate in response to an increase in the eccentricity.

### Claim 7 (depends on 1)

The method of claim 1, further comprising adjusting a spatial sampling rate used to render the scene, based on the location of the gaze.

### Claim 8 (depends on 1)

The method of claim 1, wherein the adjusting includes comparing, for a location within the scene, a spatial sampling rate used to render the location to a spatial sampling rate of a retina for the location.

### Claim 9 (depends on 8)

The method of claim 8, wherein the spatial sampling rate of the retina is calculated using a receptive field density of retinal cells.

### Claim 10 (depends on 8)

The method of claim 8, further comprising, in response to determining that the spatial sampling rate used to render the location is larger than the spatial sampling rate of the retina for the location:
reducing the spatial sampling rate used to render the location; and
reducing the angular sampling rate used to render the location.

### Claim 11

A system comprising:
a hardware processor that is configured to:
determine a location of a gaze within a displayed scene;
adjust an angular sampling rate to be used to render at least a portion of the scene, based on the location of the gaze within the displayed scene, the angular sampling rate indicating a number of different views to render for each pixel of one or more pixels in the at least a portion of the scene; and
rendering the at least a portion of the scene at the adjusted angular sampling rate.

### Claim 12 (depends on 11)

The system of claim 11, wherein the location of the gaze is used to identify a current gaze point within the scene.

### Claim 13 (depends on 12)

The system of claim 12, wherein the adjusting includes determining an eccentricity from the current gaze point for a predetermined area within the scene.

### Claim 14 (depends on 13)

The system of claim 13, wherein the angular sampling rate is adjusted for the predetermined area, based on the eccentricity.

### Claim 15 (depends on 13)

The system of claim 13, wherein the adjusting includes increasing the angular sampling rate in response to a decrease in the eccentricity.

### Claim 16 (depends on 13)

The system of claim 13, wherein the adjusting includes decreasing the angular sampling rate in response to an increase in the eccentricity.

### Claim 17 (depends on 11)

The system of claim 11, further comprising adjusting a spatial sampling rate used to render the scene, based on the location of the gaze.

### Claim 18 (depends on 11)

The system of claim 11, wherein the adjusting includes comparing, for a location within the scene, a spatial sampling rate used to render the location to a spatial sampling rate of a retina for the location.

### Claim 19 (depends on 18)

The system of claim 18, wherein the spatial sampling rate of the retina is calculated using a receptive field density of retinal cells.

### Claim 20

A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, causes the processor to perform steps comprising:
determining a location of a gaze within a displayed scene;
adjusting an angular sampling rate to be used to render at least a portion of the scene, based on the location of the gaze within the displayed scene, the angular sampling rate indicating a number of different views to render for each pixel of one or more pixels in the at least a portion of the scene; and
rendering the at least a portion of the scene at the adjusted angular sampling rate.

### Claim 21 (depends on 1)

The method of claim 1, wherein rendering the at least a portion of the scene at the adjusted angular sampling rate produces the scene in a four-dimensional (4D) light field display.

### Claim 22 (depends on 1)

The method of claim 1, wherein the views represent different virtual camera locations.

### Claim 23 (depends on 23)

The method of claim 23, wherein the different views are included a predefined grid of a plurality of baseline points, and wherein the at least a portion of the scene is rendered at the adjusted angular sampling rate by selecting, based on the number indicated by the adjusted angular sampling rate, a subset of the different views at which each pixel of one or more pixels in the at least a portion of the scene are rendered.
