Representation of user position, movement, and gaze in mixed reality space

A method of controlling a mixed reality (MR) environment visualization, the method comprising:

• obtaining a plurality of sensor data from a plurality of data sources;
• processing the obtained plurality of sensor data using a plurality of data analyzers to identify at least one feature;
• generating a plurality of annotated data sets, wherein the annotated data sets contain an annotation of the at least one feature;
• aggregating the plurality of annotated data sets to correlate the at least one feature as a common feature across different annotated data sets of the plurality of annotated data sets;
• and
• based at least on the common feature, providing a visualization output representing the MR environment.

One or more computer storage devices having computer-executable instructions stored thereon for controlling a mixed reality (MR) environment visualization, which, on execution by a computer, cause the computer to perform operations comprising:

• obtaining a plurality of sensor data from a plurality of data sources;
• processing the obtained plurality of sensor data using a plurality of data analyzers to identify at least one feature;
• generating a plurality of annotated data sets, wherein the annotated data sets contain an annotation of the at least one feature;
• aggregating the plurality of annotated data sets to correlate the at least one feature as a common feature across different annotated data sets of the plurality of annotated data sets;
• based at least on the common feature, providing a visualization output representing the MR environment;
• and
• controlling a display unit, based at least on the visualization output.