# US 2024/0189720 A1 · Performing rendering processing by a graphics processing unit and a central processing unit

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0189720 A1
- Document ID: US20240189720A1
- Status: Published application
- Kind: A1
- Application number: 18/587,625
- Filed: 2024-02-26
- Published: 2024-06-13
- Earliest claimed: 2022-10-21
- Assignees: Tencent Technology (Shenzhen) Company Limited
- Applicants: Tencent Technology (Shenzhen) Company Limited
- Inventors: Jingyang LIU; Yandong YANG; Xinda ZHAO
- Web page: https://patentgrep.com/patent/US20240189720A1

## CPC

- A63F 13/77: involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A rendering processing method includes determining, in a process of rendering a virtual scene, image data required by a graphics processing unit to perform the rendering the virtual scene, configuring a rendering function in a central processing unit according to the required image data, and performing rendering computing through the configured rendering function in the central processing unit according to the required image data, to obtain a computing result. The method further includes outputting the computing result to the graphics processing unit, the computing result being configured for use by the graphics processing unit during the rendering the virtual scene.

## Claims

### Claim 1

A rendering processing method, comprising:
determining, in a process of rendering a virtual scene, image data required by a graphics processing unit to perform the rendering the virtual scene;
configuring a rendering function in a central processing unit according to the required image data, and performing rendering computing through the configured rendering function in the central processing unit according to the required image data, to obtain a computing result; and
outputting the computing result to the graphics processing unit, the computing result being configured for use by the graphics processing unit during the rendering the virtual scene.

### Claim 2 (depends on 1)

The method according to claim 1, wherein
the graphics processing unit comprises a first dynamic-link library file, which includes instructions to perform computing through the graphics processing unit during the rendering the virtual scene; and
the determining the image data comprises:
obtaining a second dynamic-link library file, wherein the second dynamic-link library file includes instructions to perform rendering computing through the central processing unit during the rendering the virtual scene;
replacing the first dynamic-link library file in the graphics processing unit with the second dynamic-link library file; and
invoking the second dynamic-link library file through the graphics processing unit to determine the image data required by the graphics processing unit to perform the rendering the virtual scene.

### Claim 3 (depends on 2)

The method according to claim 2, wherein
the first dynamic-link library file comprises a function to obtain the required image data required by the graphics processing unit to perform the rendering the virtual scene; and
the replacing the first dynamic-link library file comprises:
replacing invoking of the first dynamic-link library file for performing the function with invoking of the second dynamic-link library file for performing the function, wherein the second dynamic-link library file performs the function to obtain the required image data required by the graphics processing unit to perform the rendering the virtual scene.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the configuring the rendering function comprises:
configuring a graphics transform function in the central processing unit, wherein the graphics transform function performs rendering computing by using the central processing unit; and
configuring the required image data in the graphics transform function.

### Claim 5 (depends on 4)

The method according to claim 4, wherein
the required image data is of a first data type;
the central processing unit does not have read-write permission for the first data type, and the central processing unit has read-write permission for a second data type; and
the configuring the required image data in the graphics transform function comprises:
creating a first reference resource belonging to the second data type in the graphics processing unit, wherein a size of the first reference resource is the same as a size of the required image data;
copying the required image data to the first reference resource in the graphics processing unit, to obtain an updated first reference resource; and
copying, from the updated first reference resource, the required image data to the graphics transform function in the central processing unit.

### Claim 6 (depends on 5)

The method according to claim 5, wherein
the graphics transform function comprises a second reference resource of the first data type; and
the copying, from the updated first reference resource, the required image data to the graphics transform function in the central processing unit comprises:
creating a third reference resource of the second resource type in the graphics transform function;
copying the required image data in the first reference resource in the graphics processing unit to the third reference resource in the graphics transform function, to obtain an updated third reference resource; and
copying the required image data in the updated third reference resource to the second reference resource.

### Claim 7 (depends on 6)

The method according to claim 6, wherein the copying the required image data in the first reference resource in the graphics processing unit to the third reference resource in the graphics transform function comprises:
copying a virtual address of the required image data in the first reference resource in the graphics processing unit to the third reference resource in the graphics transform function.

### Claim 8 (depends on 6)

The method according to claim 6, wherein
in a case that, during rendering a first virtual picture of the virtual scene, the first reference resource of the second data type is created in the graphics processing unit, the third reference resource of the second data type is created in the graphics transform function, and the first virtual picture is any virtual picture in the virtual scene, the method further comprises:
in a case that image data required for resource computing during rendering a second virtual picture is required to be transferred to the central processing unit for rendering computing, copying the required image data to the created first reference resource in the graphics processing unit, to obtain the updated first reference resource, wherein the second virtual picture is any virtual picture in the virtual scene, and the second virtual picture is different from the first virtual picture; and
copying, from the updated first reference resource, the required image data to the created third reference resource in the central processing unit.

### Claim 9 (depends on 1)

The method according to claim 1, wherein
the required image data comprises at least shader image data, unordered access image data, and sampler image data, wherein
the graphics transform function has read permission for the shader image data, and the sampler image data, and does not have write permission for the shader image data and the sampler image data;
the graphics transform function has read-write permission for the unordered access image data, wherein the read-write permission comprises read permission and write permission;
the computing result is obtained by performing computing on the unordered access image data; and
the outputting the computing result to the graphics processing unit comprises:
copying the computing result from the graphics transform function to the graphics processing unit.

### Claim 10 (depends on 1)

The method according to claim 1, wherein the method further comprises:
triggering, in a case of detecting that the graphics processing unit and the central processing unit meet a computing migration start condition, the determining the image data required by the graphics processing unit to perform the rendering the virtual scene, wherein the detecting that the graphics processing unit and the central processing unit meet the computing migration start condition comprises detecting that a load rate of the graphics processing unit is greater than a first load threshold, and a load rate of the central processing unit is less than a second load threshold; and
canceling, in a process of replacing the graphics processing unit with the central processing unit to perform rendering computing, rendering computing performed by the central processing unit in a case of detecting that the central processing unit meets a computing migration cancellation condition, wherein detecting that the central processing unit meets the computing migration cancellation condition comprises detecting that the load rate of the central processing unit is greater than a third load threshold.

### Claim 11 (depends on 1)

The method according to claim 1, wherein the virtual scene comprises a virtual game scene, a virtual shopping scene, or an audiovisual application scene.

### Claim 12

A rendering processing apparatus, comprising:
processing circuitry configured to
determine, in a process of rendering a virtual scene, image data required by a graphics processing unit to perform the rendering the virtual scene;
configure a rendering function in a central processing unit according to the required image data, and perform rendering computing through the configured rendering function in the central processing unit according to the required image data, to obtain a computing result; and
output the computing result to the graphics processing unit, the computing result being configured for use by the graphics processing unit during the rendering the virtual scene.

### Claim 13 (depends on 12)

The apparatus according to claim 12, wherein
the graphics processing unit comprises a first dynamic-link library file, which includes instructions to perform computing through the graphics processing unit during the rendering the virtual scene; and
the processing circuitry is further configured to:
obtain a second dynamic-link library file, wherein the second dynamic-link library file includes instructions to perform rendering computing through the central processing unit during the rendering the virtual scene;
replace the first dynamic-link library file in the graphics processing unit with the second dynamic-link library file; and
invoke the second dynamic-link library file through the graphics processing unit to determine the image data required by the graphics processing unit to perform the rendering the virtual scene.

### Claim 14 (depends on 13)

The apparatus according to claim 13, wherein
the first dynamic-link library file comprises a function to obtain the required image data required by the graphics processing unit to perform the rendering the virtual scene; and
the processing circuitry is further configured to:
replace invoking of the first dynamic-link library file for performing the function with invoking of the second dynamic-link library file for performing the function, wherein the second dynamic-link library file performs the function to obtain the required image data required by the graphics processing unit to perform the rendering the virtual scenario.

### Claim 15 (depends on 12)

The apparatus according to claim 12, wherein the processing circuitry is further configured to:
configure a graphics transform function in the central processing unit, wherein the graphics transform function performs rendering computing by using the central processing unit; and
configure the required image data in the graphics transform function.

### Claim 16 (depends on 15)

The apparatus according to claim 15, wherein
the required image data is of a first data type;
the central processing unit does not have read-write permission for the first data type, and the central processing unit has read-write permission for a second data type; and
the processing circuitry is further configured to:
create a first reference resource belonging to the second data type in the graphics processing unit, wherein a size of the first reference resource is the same as a size of the required image data;
copy the required image data to the first reference resource in the graphics processing unit, to obtain an updated first reference resource; and
copy, from the updated first reference resource, the required image data to the graphics transform function in the central processing unit.

### Claim 17 (depends on 16)

The apparatus according to claim 16, wherein
the graphics transform function comprises a second reference resource of the first data type; and
the processing circuitry is further configured to:
create a third reference resource of the second resource type in the graphics transform function;
copy the required image data in the first reference resource in the graphics processing unit to the third reference resource in the graphics transform function, to obtain an updated third reference resource; and
copy the required image data in the updated third reference resource to the second reference resource.

### Claim 18 (depends on 17)

The apparatus according to claim 17, wherein the processing circuitry is further configured to:
copy a virtual address of the required image data in the first reference resource in the graphics processing unit to the third reference resource in the graphics transform function.

### Claim 19 (depends on 17)

The apparatus according to claim 17, wherein
in a case that, during rendering a first virtual picture of the virtual scene, the first reference resource of the second data type is created in the graphics processing unit, the third reference resource of the second data type is created in the graphics transform function, and the first virtual picture is any virtual picture in the virtual scene, the processing circuitry is further configured to:
in a case that image data required for resource computing during rendering a second virtual picture is required to be transferred to the central processing unit for rendering computing, copy the required image data to the created first reference resource in the graphics processing unit, to obtain the updated first reference resource, wherein the second virtual picture is any virtual picture in the virtual scene, and the second virtual picture is different from the first virtual picture; and
copy, from the updated first reference resource, the required image data to the created third reference resource in the central processing unit.

### Claim 20

A non-transitory computer-readable storage medium storing computer-readable instructions thereon, which, when executed by processing circuitry, cause the processing circuitry to perform a rendering processing method comprising:
determining, in a process of rendering a virtual scene, image data required by a graphics processing unit to perform the rendering the virtual scene;
configuring a rendering function in a central processing unit according to the required image data, and performing rendering computing through the configured rendering function in the central processing unit according to the required image data, to obtain a computing result; and
outputting the computing result to the graphics processing unit, the computing result being configured for use by the graphics processing unit during the rendering the virtual scene.