Optical tag based information apparatus interaction method and system

A system for a terminal device to interact with one or more information apparatuses by using a single optical tag, comprising:

• the one or more information apparatuses;
• the single optical tag at a fixed position relative to the one or more information apparatuses;
• a server for storing information related to the one or more information apparatuses and the single optical tag;
• and
• the terminal device equipped with an imaging means, wherein the terminal device is configured to:
• perform image acquisition on the single optical tag to determine a position and an attitude of the terminal device relative to the single optical tag by calculating a rotation matrix and a displacement vector based on geographic position information of the single optical tag;
• for each information apparatus:
• determine a relative position between the terminal device and the information apparatus based on the position of the terminal device and a predetermined position of the information apparatus relative to the single optical tag acquired from the server;
• determine that, at the determined attitude of the terminal device and the relative position between the terminal device and the information apparatus, the information apparatus is at an imaging position that appears on a display screen of the terminal device;
• calculate the imaging position of the information apparatus on the display screen of the terminal device, according to the determined attitude of the terminal device and the relative position between the terminal device and the information apparatus;
• and
• present an interactive interface of the information apparatus at the respective imaging position on the display screen, for the user to interactively control the respective information apparatus over a network by interacting with the interactive interface.

A non-transitory computer-readable storage medium storing a computer program which, when executed, implements a method for a terminal device to interact with one or more information apparatuses by using a single optical tag, the method comprising:

• determining, by performing image acquisition on the single optical tag through the terminal device carried by a user, a position and an attitude of the terminal device relative to the single optical tag by calculating a rotation matrix and a displacement vector based on geographic position information of the single optical tag, wherein each information apparatus is located at a predetermined position relative to the single optical tag;
• for each information apparatus:
• determining a relative position between the terminal device and the information apparatus based on the position of the terminal device relative to the single optical tag and the predetermined position of the information apparatus relative to the single optical tag;
• determining that, at the determined attitude of the terminal device and the relative position between the terminal device and the information apparatus, the information apparatus is at an imaging position that appears on a display screen of the terminal device;
• calculating the imaging position of the information apparatus on the display screen of the terminal device, according to the determined attitude of the terminal device and the relative position between the terminal device and the information apparatus;
• and
• presenting an interactive interface of the information apparatus at the respective imaging position on the display screen, for the user to interactively control the respective information apparatus over a network by interacting with the interactive interface.