Real-time volumetric rendering
AssigneeShanghaitech University
InventorsJingyi Yu, Yuyao Zhang, Xin Lou, Qing Wu, Chaolin Rao, Jiawen Yang
Life of this patent
Estimating the term…
Abstract
An image rendering system for rendering two-dimensional images in real-time. The image rendering system can receive an implicit representation model of a three-dimensional image. The image rendering system can construct, based on voxel coordinates, a three-dimensional image based on the implicit representation model. The image rendering system can rotate the three-dimensional image to an orientation in a computing space based on a user input. The image rendering system can generate a two-dimensional image based on the rotated three-dimensional image.
Claims14
A computer-implemented method, comprising:
- modeling, by a computer system, a three-dimensional image by a continuous implicit voxel function using an implicit representation model;
- training the implicit representation model using the three-dimensional image;
- transmitting the implicit representation model to an image rendering system;
- reconstructing, by the image rendering system, based on voxel coordinates, the three-dimensional image based on the implicit representation model;
- rotating, by the image rendering system, based on a user input, the three-dimensional image to an orientation in a computing space;
- and
- generating, by the image rendering system, a two-dimensional image based on the rotated three-dimensional image,
- wherein the implicit representation model is based on a neural network encoded with a neural radiance field, and wherein the neural network comprises a multilayer perceptron,
- wherein the neural network comprises at least fifteen neural layers, wherein each neural layer includes a rectified linear unit layer, and wherein the neural network includes at least two dense connections that concatenate an input of the neural network to at least two neural layers, and
- wherein each neural layer has at least one of 256 neurons or 512 neurons, wherein the fifth neural layer and the eleventh neural layer of the neural network have 512 neurons, and wherein the at least two dense connections are concatenated to the fifth neural layer and the tenth neural layer.
An image rendering system comprising:
- at least one processor;
- and
- a memory storing instructions that, when executed by the at least one processor, cause the image rendering system to perform:
- receiving an implicit representation model representing of a three-dimensional image;
- constructing, based on voxel coordinates, the three-dimensional image based on the implicit representation model;
- rotating, based on a user input, the three-dimensional image to an orientation in a computing space;
- and
- generating a two-dimensional image based on the rotated three-dimensional image,
- wherein the implicit representation model is based on a neural network encoded with a neural radiance field, and wherein the neural network comprises a multilayer perceptron,
- wherein the neural network comprises at least fifteen neural layers, wherein each neural layer includes a rectified linear unit layer, and wherein the neural network includes at least two dense connections that concatenate an input of the neural network to at least two neural layers, and
- wherein each neural layer has at least one of 256 neurons or 512 neurons, wherein the fifth neural layer and the eleventh neural layer of the neural network have 512 neurons, and wherein the at least two dense connections are concatenated to the fifth neural layer and the tenth neural layer.
Dependencies are inferred from the claim text.