# US 2021/0241414 A1 · System and method for efficient multi-gpu rendering of geometry by pretesting against screen regions using configurable shaders

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241414 A1
- Document ID: US20210241414A1
- Status: Published application
- Kind: A1
- Application number: 16/780,745
- Filed: 2020-02-03
- Published: 2021-08-05
- Earliest claimed: 2020-02-03
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment Inc.
- Inventors: Mark E. Cerny; Florian Strauss; Tobias Berghoff
- Web page: https://patentgrep.com/patent/US20210241414A1

## CPC

- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06F 9/3877: {using a secondary processor, e.g. coprocessor (peripheral processor G06F13/12)}
- G06F 9/461: {Saving or restoring of program or task context}
- G06F 9/5061: {Partitioning or combining of resources}
- G06T 15/005: {General purpose rendering architectures}
- G06T 15/10: Geometric effects
- G06T 15/30: Clipping
- G06T 17/10: Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
- G06T 2210/52: Parallel processing
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method including rendering graphics for an application using graphics processing units (GPUs). Responsibility for rendering of geometry is divided between GPUs based on screen regions, each GPU having a corresponding division of the responsibility which is known. A plurality of pieces of geometry of an image frame is assigned to the GPUs for geometry testing. A first GPU state configuring one or more shaders to perform the geometry testing is set. Geometry testing is performed at GPUs on the plurality of pieces of geometry to generate information regarding each piece of geometry and its relation to each of the plurality of screen regions. A second GPU state configuring the one or more shaders to perform rendering is set. The information generated for each of the plurality of pieces of geometry is used when rendering the plurality of pieces of geometry at the GPUs.

## Claims

### Claim 1

A method for graphics processing, comprising:
rendering graphics for an application using a plurality of graphics processing units (GPUs);
dividing responsibility for the rendering of geometry of the graphics between the plurality of GPUs based on a plurality of screen regions, each GPU having a corresponding division of the responsibility which is known to the plurality of GPUs;
assigning a plurality of pieces of geometry of an image frame to the plurality of GPUs for geometry testing;
setting a first GPU state configuring each of one or more shaders to perform the geometry testing on the image frame;
performing geometry testing at the plurality of GPUs on the plurality of pieces of geometry of the image frame based on the first GPU state to generate information regarding each piece of geometry and its relation to each of the plurality of screen regions;
setting a second GPU state configuring each of the one or more shaders to perform rendering of the image frame; and
using the information generated for each of the plurality of pieces of geometry when rendering the plurality of pieces of geometry of the image frame based on the second GPU state at the plurality of GPUs.

### Claim 2 (depends on 1)

The method of claim 1, wherein the using the information includes:
skipping rendering a piece of geometry at a rendering GPU when the information indicates that the piece of geometry does not overlap any screen region assigned to the rendering GPU for object rendering, wherein the rendering GPU is one of the plurality of GPUs.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
providing the information as a hint to a rendering GPU, wherein the rendering GPU is one of the plurality of GPUs,
wherein the information is considered by the rendering GPU if received before rendering of the piece of geometry,
wherein the piece of geometry is fully rendered at the rendering GPU when the information is received after rendering of the piece of geometry begins.

### Claim 4 (depends on 1)

The method of claim 1,
wherein pieces of geometry in the plurality of pieces of geometry are assigned evenly or unevenly throughout the plurality of GPUs,
wherein the plurality of pieces of geometry is assigned such that successive pieces of geometry are processed by different GPUs.

### Claim 5 (depends on 1)

The method of claim 1,
wherein a first GPU performs geometry pretesting on more pieces of geometry than a second GPU, or the first GPU performs geometry pretesting while the second GPU performs no geometry pretesting at all.

### Claim 6 (depends on 1)

The method of claim 1, wherein depending on the state of the first GPU state or the second GPU state, when commands in a rendering command buffer are executed, the commands cause the output of the information regarding the piece of geometry or cause the output of vertex position and parameter information for use by later one or more rendering stages.

### Claim 7 (depends on 6)

The method of claim 6, wherein depending on the state of the first GPU state or the second GPU state, the commands that affect the GPU configuration are interpreted in a plurality of ways.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
interleaving in a command buffer generation of first information for a first piece of geometry and its relation to the plurality of screen regions and rendering of the first piece of geometry with generation of second information for a second piece of geometry and its relation to the plurality of screen regions and rendering of the second piece of geometry.

### Claim 9 (depends on 1)

The method of claim 1, wherein hardware contexts are preserved, or saved and restored.

### Claim 10 (depends on 1)

The method of claim 1,
wherein one or more of the plurality of GPUs are portions of a larger GPU that is configured as a plurality of virtual GPUs.

### Claim 11

A method for graphics processing, comprising:
rendering graphics for an application using a plurality of graphics processing units (GPUs);
dividing responsibility for rendering of geometry of the graphics between the plurality of GPUs based on a plurality of screen regions, each GPU having a corresponding division of the responsibility which is known to the plurality of GPUs;
assigning a plurality of pieces of geometry of an image frame to the plurality of GPUs for geometry testing;
interleaving a first set of shaders configured to perform geometry testing and rendering on a first set of pieces of geometry of the image frame with a second set of shaders configured to perform geometry testing and rendering on a second set of pieces of geometry of the image frame, wherein the geometry testing and rendering performed by each of the first set of shaders is fully performed before the geometry testing and rendering performed by each of the second set of shaders,
wherein the geometry testing generates corresponding information regarding each piece of geometry of the image frame in the first set or second set and its relation to each of the plurality of screen regions,
wherein the corresponding information is used by the plurality of GPUs when rendering the geometry of the image frame by the plurality of GPUs.

### Claim 12 (depends on 11)

The method of claim 11,
wherein rendering of a piece of geometry in the first set is skipped at a rendering GPU when the information indicates that the piece of geometry in the first set does not overlap any screen region assigned to the rendering GPU for object rendering, wherein the rendering GPU is one of the plurality of GPUs,
wherein rendering of a piece of geometry in the second set is skipped at the rendering GPU when the information indicates that the piece of geometry in the second set does not overlap any screen region assigned to the rendering GPU for object rendering.

### Claim 13 (depends on 11)

The method of claim 11, wherein the interleaving includes:
configuring the first set of shaders of a command buffer to perform geometry testing on the first set of pieces of geometry;
performing geometry testing at the plurality of GPUs on the first set of pieces of geometry using the first set of shaders to generate first information regarding each piece of geometry in the first set and its relation to each of the plurality of screen regions;
configuring the first set of shaders to perform rendering of the first set of pieces of geometry;
skipping rendering a first piece of geometry in the first set of pieces of geometry at a first rendering GPU when the first information indicates that the first piece of geometry does not overlap any screen region assigned to the first rendering GPU for object rendering;
configuring the second set of shaders of a command buffer to perform geometry testing on the second set of pieces of geometry;
performing geometry testing at the plurality of GPUs on the second set of pieces of geometry using the second set of shaders to generate second information regarding each piece of geometry in the second set and its relation to each of the plurality of screen regions;
configuring the second set of shaders to perform rendering of the second set of pieces of geometry; and
skipping rendering a second piece of geometry in the second set of pieces of geometry at a second rendering GPU when the second information indicates that the second piece of geometry does not overlap any screen region assigned to the second rendering GPU for object rendering.

### Claim 14 (depends on 11)

The method of claim 11, further comprising:
providing the corresponding information as a hint to a rendering GPU, wherein the rendering GPU is one of the plurality of GPUs,
wherein the information is considered by the rendering GPU if received before rendering of a corresponding piece of geometry,
wherein the corresponding piece of geometry is fully rendered at the rendering GPU when the information is received after rendering of the corresponding piece of geometry begins.

### Claim 15 (depends on 11)

The method of claim 11,
wherein pieces of geometry in the plurality of pieces of geometry are assigned evenly or unevenly throughout the plurality of GPUs,
wherein the plurality of pieces of geometry is assigned such that successive pieces of geometry are processed by different GPUs.

### Claim 16 (depends on 11)

The method of claim 11,
wherein one or more of the plurality of GPUs are portions of a larger GPU that is configured as a plurality of virtual GPUs.

### Claim 17

A computer system comprising:
a processor;
memory coupled to the processor and having stored therein instructions that, if executed by the computer system, cause the computer system to execute a method for graphics processing, comprising:
rendering graphics for an application using a plurality of graphics processing units (GPUs);
dividing responsibility for the rendering of geometry of the graphics between the plurality of GPUs based on a plurality of screen regions, each GPU having a corresponding division of the responsibility which is known to the plurality of GPUs;
assigning a plurality of pieces of geometry of an image frame to the plurality of GPUs for geometry testing;
setting a first GPU state configuring each of one or more shaders to perform the geometry testing on the image frame;
performing geometry testing at the plurality of GPUs on the plurality of pieces of geometry of the image frame based on the first GPU state to generate information regarding each piece of geometry and its relation to each of the plurality of screen regions;
setting a second GPU state configuring each of the one or more shaders to perform rendering of the image frame; and
using the information generated for each of the plurality of pieces of geometry when rendering the plurality of pieces of geometry for the image frame based on the second GPU state at the plurality of GPUs.

### Claim 18 (depends on 17)

The method of claim 17, wherein the using the information includes:
skipping rendering a piece of geometry at a rendering GPU when the information indicates that the piece of geometry does not overlap any screen region assigned to the rendering GPU for object rendering, wherein the rendering GPU is one of the plurality of GPUs.

### Claim 19 (depends on 17)

The method of claim 17, further comprising:
providing the information as a hint to a rendering GPU, wherein the rendering GPU is one of the plurality of GPUs,
wherein the information is considered by the rendering GPU if received before rendering of the piece of geometry,
wherein the piece of geometry is fully rendered at the rendering GPU when the information is received after rendering of the piece of geometry begins.

### Claim 20 (depends on 17)

The method of claim 17,
wherein pieces of geometry in the plurality of pieces of geometry are assigned evenly or unevenly throughout the plurality of GPUs,
wherein the plurality of pieces of geometry is assigned such that successive pieces of geometry are processed by different GPUs.

### Claim 21 (depends on 17)

The method of claim 17,
wherein a first GPU performs geometry pretesting on more pieces of geometry than a second GPU, or the first GPU performs geometry pretesting while the second GPU performs no geometry pretesting at all.

### Claim 22 (depends on 17)

The method of claim 17, wherein depending on the state of the first GPU state or the second GPU state, when commands in a rendering command buffer are executed, the commands cause the output of the information regarding the piece of geometry or cause the output of vertex position and parameter information for use by later one or more rendering stages.

### Claim 23 (depends on 22)

The method of claim 22, wherein depending on the state of the first GPU state or the second GPU state, the commands that affect the GPU configuration are interpreted in a plurality of ways.

### Claim 24 (depends on 17)

The method of claim 17, further comprising:
interleaving in a command buffer generation of first information for a first piece of geometry and its relation to the plurality of screen regions and rendering of the first piece of geometry with generation of second information for a second piece of geometry and its relation to the plurality of screen regions and rendering of the second piece of geometry.

### Claim 25 (depends on 17)

The method of claim 17, wherein hardware contexts are preserved, or saved and restored.

### Claim 26 (depends on 17)

The method of claim 17,
wherein one or more of the plurality of GPUs are portions of a larger GPU that is configured as a plurality of virtual GPUs.
