Three-dimensional variable perspective radiance field viewing

A system for displaying three-dimensional viewing content based on a user perspective, the system comprising:

• at least one structure from motion tool coupled with at least one processor, the at least one processor coupled to at least one memory storing instructions for the method to be executed on the processor, cause the processor to:
• receive point cloud data by one or more structure from motion tools coupled to the at least one processor;
• create a Gaussian splat scene by associating Gaussian splats with the point cloud data;
• generate one or more first two-dimensional raster images from the Gaussian splat scene;
• derive a view matrix from a user position in a three-dimensional coordinate space, the view matrix comprising one or more vectors indicating the user position within the Gaussian splat scene;
• determine a projection matrix comprising one or more vectors for a transform of the three-dimensional coordinate space to two-dimensional screen space coordinates for display on a user interface;
• and
• project the one or more first two-dimensional raster images in a position in the two-dimensional screen space determined by matrix multiplication of the view matrix and projection matrix.

A non-transitory computer-readable storage medium having embodied thereon instructions which, when executed by a processor, perform the steps of a method, the method comprising:

• receiving point cloud data by one or more structure from motion tools coupled to the at least one processor;
• creating a Gaussian splat scene by associating Gaussian splats with the point cloud data;
• generating one or more first two-dimensional raster images from the Gaussian splat scene;
• deriving a view matrix from a user position in a three-dimensional coordinate space, the view matrix comprising one or more vectors indicating the user position within the Gaussian splat scene;
• determining a projection matrix comprising one or more vectors for a transform of the three-dimensional coordinate space to two-dimensional screen space coordinates for display on a user interface;
• and
• projecting the one or more first two-dimensional raster images in a position in the two-dimensional screen space determined by matrix multiplication of the view matrix and projection matrix.