Situational awareness for head mounted devices

A method comprising:

• at a head mounted device (HMD) having a processor and a sensor:
• providing a computer generated reality (CGR) experience to a first user wearing the HMD in a physical environment;
• obtaining, via a sensor and during the CGR experience, image data from the physical environment;
• determining, based on the image data, that a second person is directing attention to the first user;
• determining that one or more actions of the first user during the CGR experience are the cause of the second person directing attention to the first user, wherein the determining is based on:
• identifying indicators corresponding to actions of the second person occurring within a threshold amount of time after presentation of an attribute of the CGR experience to the first user, the actions of the second person identified based on the image data, the actions of the second person including facial expressions, audible utterances, gazes, gestures, or changes in orientation;
• and
• based on the indicators, generating a cumulative indication that the one or more actions of the first user are the cause of the second person directing attention to the first user;
• and
• providing, based on the determining that the one or more actions of the first user during the CGR experience are the cause of the second person directing the attention to the first user, a change in the CGR experience.

A system comprising:

• a non-transitory computer-readable storage medium;
• and
• one or more processors coupled to the non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises program instructions that, when executed on the one or more processors, cause the system to perform operations comprising:
• providing a computer generated reality (CGR) experience to a first user in a physical environment;
• obtaining, via a sensor and during the CGR experience, audio data or image data from the physical environment;
• detecting, based on the audio data or image data, an emotional state of a second person other than the first user in the physical environment;
• determining that one or more actions of the first user during the CGR experience are the cause of the emotional state of the second person, wherein the determining is based on:
• identifying indicators corresponding to actions of the second person occurring within a threshold amount of time after presentation of an attribute of the CGR experience to the first user, the actions of the second person identified based on the audio data or the image data, the actions of the second person including facial expressions, audible utterances, gazes, gestures, or changes in orientation;
• and
• based on the indicators, generating a cumulative indication that the one or more actions of the first user are the cause of the emotional state of the second person;
• and
• providing, based on the detecting and based on the determining, a change in the CGR experience.