System and method of IOT device control using augmented reality

A system for remotely controlling an external device, comprising:

• a device database configured to store a plurality of device profiles, wherein each device profile includes connection data, one or more control commands, and at least one associated image;
• an imaging device configured to receive a live rendering of a physical environment, the live rendering including at least one registered image and at least one unregistered image;
• a hardware controller programmed to operate as a detection module configured to detect the registered image in the live rendering of the physical environment;
• the hardware controller programmed to operate as a querying module configured to execute a query on the device database to identify a specific device profile of the plurality of device profiles where the at least one associated image includes the detected registered image;
• a communications interface configured to establish a communication channel with the external device using the connection data included in the identified specific device profile;
• an input interface configured to receive a user instruction associated with at least one of the one or more control commands included in the identified specific device profile, wherein the user instruction is one of a voice instruction and a gesture instruction;
• and
• a transmitting device configured to transmit, after receipt of the user instruction, the at least one of the one or more control commands included in the identified specific device profile to the external device using the established communication channel for controlling the external device,
• wherein the input interface is further configured to receive an instructions for selecting the at least one unregistered image in the live rendering for initiating a registration process, the registration process associating the at least one unregistered image with the external device by associating the at least one unregistered image with the specific device profile and the at least one associated image for the external device.

A non-transitory computer readable media having instructions operable to cause one or more processors to perform the operations comprising:

• storing a plurality of device profiles, wherein each device profile includes connection data, one or more control commands, and at least one associated image;
• receiving a live rendering of a physical environment, the live rendering including at least one registered image and at least one unregistered image;
• detecting the registered image in the live rendering of the physical environment;
• identifying a specific device profile of the plurality of device profiles where the at least one associated image includes the detected registered image;
• establishing a communication channel with an external device using the connection data included in the identified specific device profile;
• receiving a user instruction associated with at least one of the one or more control commands included in the identified specific device profile, wherein the user instruction is one of a voice instruction input and a gesture instruction;
• and
• after receiving the user instruction, electronically transmitting to the external device, using the established communication channel, the at least one of the one or more control commands for controlling the external device,
• wherein the non-transitory computer readable media causes the one more processors to be further execute the operation of selecting the at least one unregistered image in the live rendering for initiating a registration process, the registration process associating the at least one unregistered image with the external device by associating the at least one unregistered image with the specific device profile and the at least one associated image for the external device.