Mesh updates in an extended reality environment

A non-transitory computer readable medium storing instructions that, when executed by a processor, cause the processor to perform the steps of:

• generating a 3D representation of a 3D environment that includes one or more 3D meshes, wherein the one or more 3D meshes comprise a first set of vertices representing 3D points captured of the 3D environment by a depth sensor on a host device;
• determining at least a portion of the 3D environment that falls within a current frame captured by an image sensor;
• generating one or more additional 3D meshes representing the at least a portion of the 3D environment, wherein the one or more additional 3D meshes comprise a second set of vertices representing additional 3D points captured by the depth sensor concurrently with the current frame being captured by the image sensor;
• and
• combining the one or more additional 3D meshes with the one or more 3D meshes into an update to the 3D representation of the 3D environment.

A computing device, comprising:

• a memory that includes an application;
• and
• a processor that is coupled to the memory, and when executing the application, performs the steps of:
• generating a 3D representation of a 3D environment that includes one or more 3D meshes, wherein the one or more 3D meshes comprise a first set of vertices representing 3D points captured of the 3D environment by a depth sensor on a host device;
• determining at least a portion of the 3D environment that falls within a current frame captured by an image sensor;
• generating one or more additional 3D meshes representing the at least a portion of the 3D environment, wherein the one or more additional 3D meshes comprise a second set of vertices representing additional 3D points captured by the depth sensor concurrently with the current frame being captured by the image sensor;
• and
• combining the one or more additional 3D meshes with the one or more 3D meshes into an update to the 3D representation of the 3D environment.