# US 2016/0364901 A1 · Rendering using ray tracing to generate a visibility stream

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0364901 A1
- Document ID: US20160364901A1
- Status: Published application
- Kind: A1
- Application number: 14/738,535
- Filed: 2015-06-12
- Published: 2016-12-15
- Earliest claimed: 2015-06-12
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Murat Balci; Christopher Paul Frascati; Juraj Obert; Hitendra Mohan Gangani; Avinash Seetharamaiah
- Web page: https://patentgrep.com/patent/US20160364901A1

## CPC

- G06T 15/06: Ray-tracing
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06T 1/60: Memory management
- G06T 15/005: {General purpose rendering architectures}
- G06T 15/40: Hidden part removal
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method and apparatus for ray tracing may include a method, manufacture and apparatus for ray tracing that may include dividing a render target into a plurality of bins. Next, a visibility pass is performed using ray tracing to generate a visibility stream such that the visibility stream indicates, for each bin of the plurality of bins, which primitives are visible in the bin. Then, for at least one bin of the plurality of bins, each primitive in the bin that is indicated in the visibility stream as being visible in the bin is rendered.

## Claims

### Claim 1

A method for graphics processing, comprising:
dividing a render target into a plurality of bins, wherein the render target includes a plurality of primitives;
performing a visibility pass using ray tracing to generate a visibility stream such that the visibility stream indicates, for each bin of the plurality of bins, which primitives are visible in the bin; and
for at least one bin of the plurality of bins, rendering each primitive in the bin that is indicated in the visibility stream as being visible in the bin.

### Claim 2 (depends on 1)

The method of claim 1, wherein the render target includes a plurality of pixels, and wherein using ray tracing to generate the visibility stream includes:
casting a ray through each pixel of the render target;
performing ray intersection tests to determine, for each bin of the plurality of bins, which primitives are visible in the bin; and
based on the ray intersection tests, generating the visibility stream such that the visibility stream indicates, for each bin of the plurality of bins, which primitives are visible in the bin.

### Claim 3 (depends on 1)

The method of claim 1, wherein each primitive of the plurality of primitives is a triangle.

### Claim 4 (depends on 1)

The method of claim 1, wherein the render target includes a plurality of pixels, and wherein using ray tracing to generate the visibility stream includes:
casting a primary ray through each pixel of the render target; and
performing ray intersection tests to determine, for each bin, which primitives are visible in the bin; and
generating the visibility stream such that the visibility stream indicates, for each bin of the plurality of bins, which primitives are visible in the bin.

### Claim 5

The method of 4, wherein performing ray intersection tests to determine which primitives are visible in the bin includes ray-bounding-box intersection tests and ray-triangle intersection tests.

### Claim 6 (depends on 1)

The method of claim 1, further comprising, while performing the visibility pass, generating a plurality of visibility heuristics.

### Claim 7 (depends on 6)

The method of claim 6, wherein the visibility heuristics include, for each bin of the plurality of bins, at least one of: an overdraw ratio, a pixel update ratio, or a scene complexity.

### Claim 8 (depends on 1)

The method of claim 1, further comprising, while generating the visibility stream, dynamically updating a plurality of visibility statistic counters.

### Claim 9 (depends on 8)

The method of claim 8, wherein dynamically updating the plurality of visibility statistics counters is performed such that, for each bin of the plurality of bins, at least one counter of the plurality of visibility statistic counters dynamically accumulates at least one of: the total number of primitives that hit the bin, the total number of primitives actually visible in the bin, a sum of the total of the number of primitives that hit that bin and the number of primitives actually visible in the bin, or the number of fully covered coarse pixels and total pixels in the bin.

### Claim 10 (depends on 9)

The method of claim 9, further comprising, simultaneous with generating the visibility stream, and also simultaneous with updating the plurality of visibility statistic counters, dynamically generating a plurality of visibility heuristics, wherein the visibility heuristics include, for each bin of the plurality of bins, at least one of: an overdraw ratio, a pixel update ratio, or a scene complexity.

### Claim 11

A device for graphics processing, comprising:
a memory; and
at least one processing unit that is configured to perform actions, including:
dividing a render target into a plurality of bins;
performing a visibility pass using ray tracing to generate a visibility stream such that the visibility stream indicates, for each bin of the plurality of bins, which primitives are visible in the bin; and
for at least one bin of the plurality of bins, rendering each primitive in the bin that is indicated in the visibility stream as being visible in the bin.

### Claim 12 (depends on 11)

The device of claim 11, wherein the at least one processing unit includes a graphics processing unit (GPU).

### Claim 13 (depends on 11)

The device of claim 11, wherein the at least one processing unit is further configured such that each primitive of the plurality of primitives is a triangle.

### Claim 14 (depends on 11)

The device of claim 11, wherein the at least one processing unit is further configured such that the render target includes a plurality of pixels, and wherein the at least one processing unit is configured to use ray tracing to generate the visibility stream by:
casting a ray through each pixel of the render target;
performing ray intersection tests to determine, for each bin of the plurality of bins, which primitives are visible in the bin; and
based on the ray intersection tests, generating the visibility stream such that the visibility stream indicates, for each bin of the plurality of bins, which primitives are visible in the bin.

### Claim 15 (depends on 11)

The device of claim 11, wherein the at least one processing unit is further configured to render the render target such that the render target includes a plurality of pixels, and wherein the at least one processing unit is configured to use ray tracing to generate the visibility stream by:
casting a primary ray through each pixel of the render target; and
performing ray intersection tests to determine, for each bin of the plurality of bins, which primitives are visible in the bin; and
generating the visibility stream such that the visibility stream indicates, for each bin of the plurality of bins, which primitives are visible in the bin.

### Claim 16 (depends on 15)

The device of claim 15, wherein the at least one processing unit is configured to perform ray intersection tests to determine which primitives are visible in the bin by: performing ray-bounding-box intersection tests and performing a ray-triangle intersection tests.

### Claim 17 (depends on 11)

The device of claim 11, the at least one processing unit is further configured to, while performing the visibility pass, generate a plurality of visibility heuristics.

### Claim 18 (depends on 17)

The device of claim 17, wherein the at least one processing unit is further configured to generate the plurality of visibility heuristics such that the visibility heuristics include, for each bin of the plurality of bins, at least one of: an overdraw ratio, a pixel update ratio, or a scene complexity.

### Claim 19 (depends on 11)

The device of claim 11, where the at least one processing unit is further configured to, while generating the visibility stream, dynamically update a plurality of visibility statistic counters.

### Claim 20 (depends on 19)

The device of claim 19, wherein the at least one processing unit is further configured to dynamically update the plurality of visibility statistics counters such that the plurality of visibility statistic counters include, for each bin of the plurality of bins, a counter that dynamically accumulates at least one of: the total number of primitives that hit the bin, the total number of primitives actually visible in the bin, a sum of the total of the number of primitives that hit that bin and the number of primitives actually visible in the bin, or the number of fully covered coarse pixels and total pixels in the bin.

### Claim 21 (depends on 20)

The device of claim 20, where the at least one processing unit is further configured to, simultaneous with generating the visibility stream, and also simultaneous with updating the plurality of visibility statistic counters, dynamically generate a plurality of visibility heuristics, wherein the visibility heuristics include, for each bin of the plurality of bins, at least one of: an overdraw ratio, a pixel update ratio, or a scene complexity.

### Claim 22

A tangible computer-readable storage medium storing instructions for graphics processing that, when executed, cause one or more processors to:
divide a render target into a plurality of bins;
perform a visibility pass using ray tracing to generate a visibility stream such that the visibility stream indicates, for each bin of the plurality of bins, which primitives are visible in the bin; and
for at least one bin of the plurality of bins, render each primitive in the bin that is indicated in the visibility stream as being visible in the bin.

### Claim 23

A device for graphics processing, comprising:
means for dividing a render target into a plurality of bins;
means for performing a visibility pass using ray tracing to generate a visibility stream such that the visibility stream indicates, for each bin of the plurality of bins, which primitives are visible in the bin; and
means for rendering, for at least one bin of the plurality of bins, each primitive in the bin that is indicated in the visibility stream as being visible in the bin.

### Claim 24 (depends on 23)

The device of claim 23, wherein each primitive of the plurality of primitives is a triangle.

### Claim 25 (depends on 23)

The device of claim 23, further comprising means for dynamically updating a plurality of visibility statistic counters while generating the visibility stream

### Claim 26 (depends on 23)

The device of claim 23, further comprising means for generating a plurality of visibility heuristics while performing the visibility pass.

### Claim 27 (depends on 26)

The device of claim 26, wherein the visibility heuristics include, for each bin of the plurality of bins, at least one of: an overdraw ratio, a pixel update ratio, or a scene complexity.
