Method and system for user interaction

A system for user interaction, comprising:

• a server comprising a database configured to store a plurality of device identifiers, a plurality of panel identifiers, a plurality of graphical user interfaces, and rendering information;
• a head mounted augmented reality display having an image capture module configured for pointing toward a panel defining a physical area having a plurality of fiducial markers and a panel identifier, wherein the image capture module is configured to:
• recognize the plurality of fiducial markers on the panel and an interaction area defined by the plurality of fiducial markers;
• recognize the panel identifier;
• wherein the head mounted augmented reality display is configured to:
• use the recognized panel identifier to select a graphical user interface comprising a plurality of graphical user interface elements;
• and
• render the selected graphical user interface on the augmented reality display to appear to be floating in a spatial volume between the head mounted augmented reality display and the interaction area defined by the plurality of fiducial markers, and to visually align with the panel;
• use at least two of the plurality of fiducial markers as geometrical fiducial markers for defining a geometrical position and an orientation of the panel with respect to the head mounted augmented reality display;
• and
• use the image capture module to recognize at least one of a hand, a finger or a predefined detectable object in the spatial volume between the head mounted augmented reality display and the interaction area, wherein the at least one of the hand, the finger or the predefined detectable object is directed towards at least one of the plurality of graphical user interface elements rendered to appear to be floating in the spatial volume as perceived by a user.