Defining and modifying context aware policies with an editing tool in extended reality systems

A computer-implemented method for operating a head-mounted device, the method comprising:

• capturing image data from a camera disposed on the head-mounted device, wherein the image data is analyzed to obtain information about a plurality of real-world objects in a field of view of the camera;
• identifying, based on the information, a particular real-world object of the plurality of real-world objects;
• determining a context based on at least one factor, the at least one factor comprising the identification of the particular real-world object;
• determining an action based on the context;
• and
• causing the action to be performed by the head-mounted device, wherein the action comprises at least one of:
• outputting audio content from a speaker and/or presenting visual information on a display of the head-mounted device.

One or more non-transitory computer-readable media storing computer-readable instructions that, when executed by at least one processing system, cause a system to execute operations comprising:

• capturing image data from a camera disposed on a head-mounted device, wherein the image data is analyzed to obtain information about a plurality of real-world objects in a field of view of the camera;
• identifying, based on the information, a particular real-world object of the plurality of real-world objects;
• determining a context based on at least one factor, the at least one factor comprising the identification of the particular real-world object;
• determining an action based on the context;
• and
• causing the action to be performed by the head-mounted device, wherein the action comprises at least one of:
• outputting audio content from a speaker and/or presenting visual information on a display of the head-mounted device.