Space models for mixed reality

The method performed by one or more computing devices comprising processing hardware and storage hardware, the storage hardware storing instructions configured to, when executed by the processing hardware, perform the method, the method comprising:

• providing a space model accessible via a data network, the space model comprising a data structure comprising space nodes representing respective spaces, the space nodes organized as a tree with hierarchical structure corresponding to hierarchical structure of a physical space, some of the space nodes comprising device representations, each device representation comprising state of a respective virtual or physical device that is updated by a corresponding physical or virtual device, wherein the state of each device representation is updated to include measures from respective virtual and/or physical sensors;
• providing a mixed reality system comprising a camera and a three-dimensional model, the mixed reality system rendering views of the three-dimensional model according to locations and orientations of the camera, the mixed reality system interfacing with a service to access the space model;
• receiving, by the mixed reality system, from the space model via the service, sensor metadata obtained from within the space model by the service, the sensor metadata provided by the space model and comprising or derived from the measures of the virtual and/or physical sensors;
• and
• rendering, by the mixed reality system, views of the three-dimensional model according to locations and orientations of the camera and according to the sensor metadata received from the space model, wherein the mixed reality system renders the three-dimensional model to include graphics representing the sensor metadata received from the space model.

A computer-readable storage hardware storing information configured to cause one or more computing devices to perform a process, the process comprising:

• managing a space model that models the containment relationships among places in a physical space, wherein some physical places contain other physical places and the space model includes place nodes and links therebetween that reflect the containment relationships, the links and place nodes comprising a tree hierarchy corresponding to the hierarchical containment relationships between the physical places, some nodes comprising representations of physical sensors in respective physical places, wherein each physical sensor in a physical place has a respective representation in a place node corresponding to the physical place, and wherein each representation stores a measure from its respectively represented physical sensor;
• establishing a communication link between the space model and a mixed reality system;
• receiving, by the mixed reality system, via the communication link, sensor values comprising or derived from the measures in the representations;
• and
• rendering, by the mixed reality system, according to the sensor values, graphics of a three-dimensional model of at least part of the physical place, wherein some of the graphics represent the sensor values.