Query-based generation of traversable three-dimensional scenes

A system comprising:

• a memory component;
• and
• a processing device coupled to the memory component, the processing device to perform operations including:
• receiving a query that specifies a visual aspect to be included in a three-dimensional scene;
• generating a traversable three-dimensional scene that depicts the visual aspect by:
• generating a spherical representation of the three-dimensional scene based on the query that includes a sequence of panoramic frames;
• extracting one or more perspective views from each frame of the sequence of panoramic frames;
• estimating virtual poses for each of the extracted perspective views;
• and
• processing the one or more perspective views and the virtual poses using a machine learning model to reconstruct the traversable three-dimensional scene;
• and
• presenting a three-dimensional environment that includes the traversable three-dimensional scene.

A non-transitory computer-readable storage medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:

• receiving a query that specifies a visual aspect to be included in a three-dimensional scene;
• generating a spherical representation of the three-dimensional scene based on the query that includes a sequence of panoramic frames;
• constructing a traversable three-dimensional scene by processing one or more features of the panoramic frames using one or more machine learning models;
• and
• outputting a three-dimensional environment that includes the traversable three-dimensional scene for display.