System and method for securing a virtual reality environment

A method, comprising:

• rendering on one or more displays of a plurality of extended reality (XR) devices executing an XR environment, wherein the XR environment comprises a plurality of user avatars configured to interact with a plurality of XR applications executing within the XR environment, and wherein the plurality of user avatars comprises a first user avatar authorized to interact with an XR application of the plurality of XR applications and a second user avatar unauthorized to interact with the XR application;
• receiving, by one or more sensors of at least one of the plurality of XR devices, sensor data indicative of a user intent to interact with the XR application by the second user avatar;
• generating, based on the sensor data, an estimation of an unauthorized interaction with the XR application by the second user avatar;
• executing, based on the estimation of the unauthorized interaction, a data obfuscation of information associated with an authorized interaction with the XR application by the first user avatar;
• re-rendering on the one or more displays of the plurality of XR devices the XR application in accordance with the executed data obfuscation;
• prior to generating the estimation of the unauthorized interaction, weighting the sensor data based on a device capability of each of the plurality of XR devices, wherein weighting the sensor data based on the device capability comprises:
• 1) assigning a higher weight to eye-tracking or face tracking sensor data and a lower weight to head pose or object pose sensor data when the at least one of the plurality of XR devices includes eye-tracking and face-tracking capabilities, and 2) assigning a higher weight to head pose or object pose sensor data and a lower weight to other sensor data when the at least one of the plurality of XR devices does not include eye-tracking and face-tracking capabilities;
• and
• generating the estimation of the unauthorized interaction based on the weighted sensor data.

A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to:

• render on one or more displays of a plurality of XR devices an XR environment, wherein the XR environment comprises a plurality of user avatars configured to interact with the plurality of XR applications executing within the XR environment, and wherein the plurality of user avatars comprises a first user avatar authorized to interact with an XR application of the plurality of XR applications and a second user avatar unauthorized to interact with the XR application;
• receive, by one or more sensors of at least one of the plurality of XR devices, sensor data indicative of a user intent to interact with the XR application by the second user avatar;
• generate, based on the sensor data, an estimation of an unauthorized interaction with the XR application by the second user avatar;
• execute, based on the estimation of the unauthorized interaction, a data obfuscation of information associated with an authorized interaction with the XR application by the first user avatar;
• re-render on the one or more displays of the plurality of XR devices the XR application in accordance with the executed data obfuscation;
• prior to generating the estimation of the unauthorized interaction, weight the sensor data based on a device capability of the least one of the plurality of XR devices, wherein weighting the sensor data based on the device capability comprises:
• 1) assigning a higher weight to eye-tracking or face tracking sensor data and a lower weight to head pose or object pose sensor data when the at least one of the plurality of XR devices includes eye-tracking and face-tracking capabilities, and 2) assigning a higher weight to head pose or object pose sensor data and a lower weight to other sensor data when the at least one of the plurality of XR devices does not include eye-tracking and face-tracking capabilities;
• and
• generate the estimation of the unauthorized interaction based on the weighted sensor data.