Spatial remote control

A system for spatially remote controlling a network controllable device in a physical user environment, the system comprising:

• a remote control device;
• a network coupled to one or more network controllable devices;
• at least one processor;
• and
• a memory storing processor-executable instructions, wherein the at least one processor is configured to implement the following operations upon executing the processor-executable instructions:
• tracking, by the at least one processor, a position and orientation of the remote control device based on sensor data acquired by one or more camera systems, a gyroscope, an accelerometer, or a magnetometer of the remote control device;
• based on the tracking, determining a geometric ray extending from the remote control device in a direction the remote control device is pointing;
• comparing, by the processor, the determined geometric ray to a predefined map, the predefined map including a spatial location associated with each of the one or more network controllable devices, constructing of the predefined map including:
• determining, based on the position and orientation of the remote control device, a plurality of boundaries of the physical user environment;
• receiving a list of the one or more network controllable devices coupled to a network;
• and
• determining, based on the position and orientation of the remote control device in response to a user pointing the remote control device at each of the one or more network controllable devices in turn, the spatial location associated with each of the one or more network controllable devices;
• based on the comparing, selecting one of the one or more network controllable devices corresponding to the determined geometric ray;
• receiving, by the processor, a user input;
• and
• in response to receiving the user input, transmitting a control signal to the selected one of the one or more network controllable devices.

A non-transitory processor-readable medium having instructions stored thereon, which when executed by one or more processors, cause the one or more processors to implement a method for spatially remote controlling a network controllable device in a physical user environment, the method comprising:

• tracking, by a processor, a position and orientation of a remote control device based on sensor data acquired by (i) one or more of a gyroscope, accelerometer, and a magnetometer of the remote control device, and (ii) one or more camera systems;
• based on the tracking, determining a geometric ray extending from the remote control device in a direction the remote control device is pointing;
• comparing, by the processor, the determined geometric ray to a predefined map, the predefined map including a spatial location associated with each of one or more network controllable devices, constructing of the predefined map including:
• determining, based on the position and orientation of the remote control device, a plurality of boundaries of the physical user environment;
• receiving a list of the one or more network controllable devices coupled to a network;
• and
• determining, based on the position and orientation of the remote control device, the spatial location associated with each of the one or more network controllable devices;
• based on the comparing, selecting one of the one or more network controllable devices corresponding to the determined geometric ray;
• receiving, by the processor, a user input;
• and
• in response to receiving the user input, transmitting a control signal to the selected one of the one or more network controllable devices.