Three dimensional virtual room-based user interface for a home automation system

A non-transitory electronic device readable medium having software encoded thereon, the software, when executed on one or more processors of one or more electronic devices, operable to:

• render and display, using a 3-D graphics engine, a user-navigable three-dimensional (3-D) virtual room, the user-navigable 3-D virtual room including data from 2-D images and a 3-D space model, wherein the 3-D graphics engine to render and display the user-navigable 3-D virtual room from a perspective defined by a virtual camera in 3-D space of the 3-D space model using data from the 2-D images to show depictions of one or more devices present in a physical room that are under the control of a home automation system;
• receive an explicit navigation command or implicit action from a user;
• in response to the explicit navigation command or implicit action, translate or rotate the virtual camera to alter a position or an orientation of the virtual camera in the 3-D space;
• re-render and display the 3-D virtual room from a new perspective defined by the altered position or orientation using the 3-D graphics engine, wherein when the new perspective does not coincide with a position associated with any of the 2-D images, the 3-D graphics engine re-renders the user-navigable 3-D virtual room by blending data from multiple 2-D images associated with different positions according to the 3-D space model;
• receive a user interaction;
• in response to the user interaction, cause the home automation system to change a state of a device in the physical room;
• and
• dynamically update an appearance of the depiction of the device in the user-navigable 3-D virtual room to reflect the changed state.

A home automation system controlled by a user-navigable three-dimensional (3-D) virtual room based user interface, comprising:

• a remote control, mobile device, or head-mounted display (HMD) including a display screen and a control application (app) having a 3-D graphics engine that is configured to render and display on the display screen a user-navigable 3-D virtual room, the user-navigable 3-D virtual room including data from 2-D images and a 3-D space model, the 3-D graphics engine to render and display the user-navigable 3-D virtual room from a perspective of a virtual camera in 3-D space of the 3-D space model using data from the 2-D images to show, depictions of one or more devices present in the physical room that are under the control of the home automation system, depictions of one or more boundaries of the physical room and depictions of one or more furnishings present in the physical room, the perspective of the 3-D virtual camera translatable and rotatable in the 3-D space in response to an explicit navigation command or implicit action from a user, wherein at least some changes in perspective cause the 3-D graphics engine to re-render the user-navigable 3-D virtual room by blending data from multiple 2-D images associated with different positions according to the 3-D space model;
• and
• a controller in communication with the remote control, mobile device, or HMD that is configured to control the one or more devices present in the physical room, the controller configured to change a state of a device in response to a user interaction with the user-navigable 3-D virtual room,
• wherein the control app having the 3-D graphics engine is further configured to dynamically update an appearance of the depiction of the device, the depiction of one or more boundaries, and the depictions of one or more furnishings in the user-navigable 3-D virtual room to reflect the changed state.