Methods and systems for rendering frames of a virtual scene from different vantage points based on a virtual entity description frame of the virtual scene

A virtual scene capture system comprising:

• an asset storage system storing color and depth data representative of a virtual object;
• a plurality of server-side three-dimensional (3D) rendering engines including a first 3D rendering engine and a second 3D rendering engine each communicatively coupled to the asset storage system;
• and
• a virtual entity state tracking system communicatively coupled to the asset storage system and the first and second 3D rendering engines, the virtual entity state tracking system configured to
• maintain data representative of the virtual object included within a virtual 3D space of a virtual scene and of a plurality of virtual vantage points into the virtual 3D space, the plurality of virtual vantage points including a first virtual vantage point and a second virtual vantage point different from the first virtual vantage point, and the maintained data representative of the virtual object including a link to the color and depth data representative of the virtual object stored in the asset storage system,
• generate, based on the maintained data representative of the plurality of virtual entities, a virtual entity description frame representative of a state of at least one virtual entity in the plurality of virtual entities at a particular point in a temporal sequence, and
• provide the virtual entity description frame to the plurality of server-side 3D rendering engines including the first and second 3D rendering engines;
• wherein the first 3D rendering engine is associated with the first virtual vantage point and is configured to render, based on the virtual entity description frame and the color and depth data representative of the virtual object accessed from the asset storage system by way of the link, a first surface data frame representative of color and depth data of surfaces of the virtual object visible from the first virtual vantage point at the particular point in the temporal sequence;
• and
• wherein the second 3D rendering engine is associated with the second virtual vantage point and is configured to render, based on the virtual entity description frame and the color and depth data representative of the virtual object accessed from the asset storage system by way of the link, a second surface data frame representative of color and depth data of surfaces of the virtual object visible from the second virtual vantage point at the particular point in the temporal sequence.

A virtual scene capture system comprising:

• at least one physical computing device that
• maintains data representative of a plurality of virtual entities included within a virtual three-dimensional (3D) space of a virtual scene, wherein
• the plurality of virtual entities includes a virtual object and a plurality of virtual vantage points into the virtual 3D space,
• the plurality of virtual vantage points includes a first virtual vantage point and a second virtual vantage point different from the first virtual vantage point, and
• the maintained data representative of the plurality of virtual entities includes a link to color and depth data representative of the virtual object stored in an asset storage system associated with the virtual scene capture system;
• generates, based on the maintained data representative of the plurality of virtual entities, a virtual entity description frame representative of a state of at least one virtual entity in the plurality of virtual entities at a particular point in a temporal sequence, the virtual entity description frame including the link to the color and depth data representative of the virtual object stored in the asset storage system;
• and
• provides the virtual entity description frame to a plurality of server-side 3D rendering engines including a first 3D rendering engine associated with the first virtual vantage point and a second 3D rendering engine associated with the second virtual vantage point, the first and second 3D rendering engines configured to render first and second surface data frames, respectively, by performing operations including:
• receiving the virtual entity description frame from the virtual scene capture system, and
• accessing, from the asset storage system using the link included within the virtual entity description frame, the color and depth data representative of the virtual object stored in the asset storage system.