US 12,614,335 B2Granted

Method and system for distributed real-time rendering

AssigneeHuawei Cloud Computing Technologies Co., Ltd.

InventorsShuo Pang, Li Li, Jiehan Zhou

Life of this patent

Estimating the term…

Loading patent…

Abstract

Distributed real-time rendering is a cutting-edge solution to address the ever-increasing demands for realistic and immersive visual experiences, such as provided by augmented or artificial reality applications. Embodiments of the present specification provide a method and a system for distributed real-time rendering of a scene. The rendering is distributed among a root instance and a plurality of node instances. The root instance receives the scene to render, segments it into a plurality of objects, computes lighting parameters, assigns rendering tasks associated with objects to node instances, and communicates object metadata and the lighting parameters to the assigned node instance. The node instances render objects and create point clouds and u, v maps, which are then used by the root instance to render the scene for real-time display. The method and system can be used by end devices that include position sensors, processors, communication means and a display to provide immersive experiences.

Claims20

Dependent claims

A method for distributed real-time rendering of a scene, the method comprising:

segmenting, by a root instance, the scene into a plurality of objects, each object of the plurality of objects associated with respective object metadata including respective at least one of transformation matrices, material properties, or visibility information;
computing, by the root instance, lighting parameters associated with the scene;
assigning to each node of a plurality of node instances one or more of a plurality of rendering tasks, each rendering task of the plurality of rendering tasks being associated with respective one or more objects of the plurality of objects;
with respect to each rendering task, communicating, from the root instance to a corresponding assigned node instance, the respective object metadata and the lighting parameters;
with respect to each rendering task, rendering, by the corresponding assigned node instance, the respective one or more objects into at least a respective point cloud based on the respective object metadata and the lighting parameters, the rendering the respective one or more objects into at least the respective point cloud comprising:
rendering, by the corresponding assigned node instance, the respective one or more objects into at least the respective point cloud including a sampling density determined by distances between a virtual camera and the respective one or more objects based on the respective object metadata and the lighting parameters,
wherein the respective object metadata includes the transformation matrices, the material properties, and the visibility information;
with respect to each rendering task, sending the respective point cloud from the corresponding assigned node instance to the root instance;
and
rendering, by the root instance, a rendered scene from respective point clouds for real-time display.

7 more elements

A system for distributed real-time rendering of a scene, the system comprising:

a root instance;
and
a plurality of node instances, wherein the root instance is configured to perform:
segmenting the scene into a plurality of objects, each object of the plurality of objects associated with respective object metadata including respective at least one of transformation matrices, material properties, or visibility information;
computing lighting parameters associated with the scene;
assigning to each node of the plurality of node instances one or more of a plurality of rendering tasks, each rendering task of the plurality of rendering tasks being associated with respective one or more objects of the plurality of objects;
and
with respect to each rendering task, communicating to a corresponding assigned node instance, the respective object metadata and the lighting parameters;
wherein the plurality of node instances are configured to perform:
with respect to each rendering task, rendering, by the corresponding assigned node instance, the respective one or more objects into at least a respective point cloud based on the respective object metadata and the lighting parameters, the rendering the respective one or more objects into at least the respective point cloud comprising:
rendering, by the corresponding assigned node instance, the respective one or more objects into at least the respective point cloud including a sampling density determined by distances between a virtual camera and the respective one or more objects based on the respective object metadata and the lighting parameters,
wherein the respective object metadata includes the transformation matrices, the material properties, and the visibility information;
and
with respect to each rendering task, sending the respective point cloud from the corresponding assigned node instance to the root instance;
and
wherein the root instance is further configured to perform:
rendering a rendered scene from respective point clouds for real-time display.

14 more elements

Dependencies are inferred from the claim text.