Mapping a real-world room for a shared artificial reality environment

A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for configuring occlusion masks in an artificial reality (XR) environment, the process comprising:

• rendering, by a first XR system of a first user, a shared XR environment, wherein the shared XR environment corresponds to a real-world room, wherein at least two users, including the first user, are local users in the real-world room, wherein the local users view at least part of the shared XR environment in A) mixed reality or B) in passthrough using a video capture of the real-world room;
• receiving, from a second XR system of a second user of the local users, tracking location and pose data for an avatar in the XR environment corresponding to the second user, wherein the avatar is not rendered by the first XR system in the XR environment;
• generating an occlusion mask attached relative, in the XR environment, to the location and pose data for the avatar of the second user, wherein the occlusion mask causes portions of virtual objects that are behind the occlusion mask, from the point of view of the first user, to not be rendered;
• and
• rendering a virtual object in the XR environment, wherein the generated occlusion mask causes at least part of the virtual object to not be displayed by the first XR system.

A computing system for configuring occlusion masks in an artificial reality (XR) environment, the computing system comprising:

• one or more processors;
• and
• one or more memories storing instructions that, when executed by the one or more processors, cause the edge computing system to perform a process comprising:
• rendering, by a first XR system of a first user, a shared XR environment that corresponds to a real-world room, wherein at least two users, including the first user view at least part of the shared XR environment in A) mixed reality or B) in passthrough using a video capture of the real-world room;
• receiving, from a second XR system of a second user of the users, tracking location and pose data for an avatar in the XR environment corresponding to the second user, wherein the avatar is not rendered by the first XR system in the XR environment;
• generating an occlusion mask attached relative, in the XR environment, to the location and pose data for the avatar;
• and
• rendering a virtual object in the XR environment, wherein the generated occlusion mask causes at least part of the virtual object to not be displayed by the first XR system.