Interactivity with a mixed reality

A method of interacting with a mixed reality, comprising:

• providing a mobile phone device having a physical handheld display;
• using the mobile device to electronically capture image data of at least a portion of a multi-part real-world object;
• using the image data to identify an attribute associated with the real-world object;
• using the attribute to interact with software being operated at least in part remote to the mobile device to obtain a first command set for a first part of the real-world object and a second, different command set for a second part of the real-world object from a distal database storing a plurality command sets for multiple, mixed reality objects, where the command sets comprise network API addresses corresponding to commands that control the first and the second parts, respectively;
• offering the first and the second command set to the mobile phone device;
• combining at least one virtual interface comprising the commands sets with the image data of the real-world object to form mixed reality representations of the first and the second parts;
• displaying the at least one virtual interface on the handheld display to allow a user to select a command from one of the command sets;
• and
• executing the command by issuing call over a network from the mobile device to a corresponding network API address of the command drawn from the network API addresses.