# US 2019/0318709 A1 · Preserving sample data in foveated rendering of graphics content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318709 A1
- Document ID: US20190318709A1
- Status: Published application
- Kind: A1
- Application number: 16/247,964
- Filed: 2019-01-15
- Published: 2019-10-17
- Earliest claimed: 2018-04-13
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Jonathan WICKS; Tate HORNBECK; Robert VANREENEN
- Web page: https://patentgrep.com/patent/US20190318709A1

## CPC

- G06T 11/40: Filling planar surfaces by adding surface attributes, e.g. adding colours or textures
- G09G 5/373: for modifying the size of the graphic pattern
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 15/005: {General purpose rendering architectures}
- G09G 5/391: Resolution modifying circuits, e.g. variable screen formats
- G09G 5/393: Arrangements for updating the contents of the bit-mapped memory
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G09G 2340/04: Changes in size, position or resolution of an image
- G09G 2340/0407: Resolution change, inclusive of the use of different resolutions for different screen areas
- G09G 2350/00: Solving problems of bandwidth in display systems
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/122: Tiling
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Example techniques are described for generating graphics content by assigning a first region of the graphics content to a first tile, assigning a second region of the graphics content to a second tile, determining, at the first tile and at a first resolution, a first set of samples of the graphics content for each pixel of multiple pixels associated with the first region, determining, at the second tile and at a second resolution that is lower than the first resolution, a second set of samples of the graphics content for each pixel of multiple pixels associated with the second region, downsampling the first set of samples into a combined set of samples, preserving samples of the second set of samples to generate a third set of samples with preserved samples, storing the combined set of samples, and storing the third set of samples with preserved samples.

## Claims

### Claim 1

A device for generating graphics content, comprising:
a memory; and
a processor coupled to the memory configured to cause the device to perform a method comprising:
assigning a first region of the graphics content to a first tile of a plurality of tiles;
assigning a second region of the graphics content to a second tile of the plurality of tiles;
determining, at the first tile and at a first resolution, a first plurality of samples of the graphics content for each pixel of a plurality of pixels associated with the first region;
determining, at the second tile and at a second resolution that is lower than the first resolution, a second plurality of samples of the graphics content for each pixel of a plurality of pixels associated with the second region;
downsampling the first plurality of samples into a combined plurality of samples;
preserving samples of the second plurality of samples to generate a third plurality of samples with preserved samples;
storing the combined plurality of samples; and
storing the third plurality of samples with preserved samples.

### Claim 2 (depends on 1)

The device of claim 1, wherein the device comprises a virtual reality headset or a wireless communication device, the method further comprising:
generating an image based on the combined plurality of samples and the third plurality of samples with preserved samples that are stored; and
displaying the image.

### Claim 3 (depends on 1)

The device of claim 1, wherein:
downsampling the first plurality of samples comprises downsampling the first plurality of samples at a first scale; and
preserving the samples comprises downsampling the second plurality of samples by a second scale that is less the first scale.

### Claim 4 (depends on 1)

The device of claim 1, wherein preserving the samples comprises copying the second plurality of samples in the second tile.

### Claim 5 (depends on 1)

The device of claim 1, wherein preserving the samples comprises upscaling the second plurality of samples.

### Claim 6 (depends on 5)

The device of claim 5, wherein the upscaling comprises nearest sampling.

### Claim 7 (depends on 5)

The device of claim 5, wherein the upscaling comprises weighted sampling.

### Claim 8 (depends on 1)

The device of claim 1, the method further comprising:
determining that the first region is in the foveal vision of a user; and
determining to render the first region at the first resolution based on determining that the first region is in the foveal vision of a user.

### Claim 9 (depends on 1)

The device of claim 1, wherein:
the first region is predetermined to be rendered at a first resolution; and
the first region is a center region in the graphics content.

### Claim 10 (depends on 1)

The device of claim 1, the method further comprising:
assigning a third region of the graphics content to a third tile of the plurality of tiles; and
determining, at the third tile and at a third resolution that is lower than the first resolution, a third plurality of samples of the graphics content for each pixel of a plurality of pixels associated with the third region, wherein the second resolution is different than the third resolution.

### Claim 11 (depends on 1)

The device of claim 1, wherein the second resolution is at least one selected from the group consisting of one half of the first resolution, one fourth of the first resolution, and one eighth of the first resolution.

### Claim 12 (depends on 1)

The device of claim 1, wherein a number of samples determined for each pixel of the graphics content is at least one selected from the group consisting of two, four, and eight.

### Claim 13 (depends on 1)

The device of claim 1, wherein storing the combined plurality of samples and storing the third plurality of samples with preserved samples comprises storing the combined plurality of samples and the third plurality of samples with preserved samples in system memory.

### Claim 14

A method for generating graphics content comprising:
assigning a first region of the graphics content to a first tile of a plurality of tiles;
assigning a second region of the graphics content to a second tile of the plurality of tiles;
determining, at the first tile and at a first resolution, a first plurality of samples of the graphics content for each pixel of a plurality of pixels associated with the first region;
determining, at the second tile and at a second resolution that is lower than the first resolution, a second plurality of samples of the graphics content for each pixel of a plurality of pixels associated with the second region;
downsampling the first plurality of samples into a combined plurality of samples;
preserving samples of the second plurality of samples to generate a third plurality of samples with preserved samples;
storing the combined plurality of samples; and
storing the third plurality of samples with preserved samples.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
generating an image based on the combined plurality of samples and the third plurality of samples with preserved samples that are stored; and
displaying the image on a virtual reality headset or a wireless communication device.

### Claim 16 (depends on 14)

The method of claim 14, wherein:
downsampling the first plurality of samples comprises downsampling the first plurality of samples at a first scale; and
preserving the samples comprises downsampling the second plurality of samples by a second scale that is less the first scale.

### Claim 17 (depends on 14)

The method of claim 14, wherein preserving the samples comprises copying the second plurality of samples in the second tile.

### Claim 18 (depends on 14)

The method of claim 14, wherein:
preserving the samples comprises upscaling the second plurality of samples; and
the upscaling comprises nearest sampling or weighted sampling.

### Claim 19 (depends on 14)

The method of claim 14, further comprising:
determining that the first region is in the foveal vision of a user; and
determining to render the first region at the first resolution based on determining that the first region is in the foveal vision of a user.

### Claim 20

A non-transitory computer-readable medium for generating graphics content, the non-transitory computer-readable medium storing a program containing instructions that, when executed by a processor of a device, cause the device to perform a method comprising:
assigning a first region of the graphics content to a first tile of a plurality of tiles;
assigning a second region of the graphics content to a second tile of the plurality of tiles;
determining, at the first tile and at a first resolution, a first plurality of samples of the graphics content for each pixel of a plurality of pixels associated with the first region;
determining, at the second tile and at a second resolution that is lower than the first resolution, a second plurality of samples of the graphics content for each pixel of a plurality of pixels associated with the second region;
downsampling the first plurality of samples into a combined plurality of samples;
preserving samples of the second plurality of samples to generate a third plurality of samples with preserved samples;
storing the combined plurality of samples; and
storing the third plurality of samples with preserved samples.
