Device and system for multidimensional data visualization and interaction in an augmented reality virtual reality or mixed reality environment

A workstation for multidimensional data visualization and interaction in an augmented reality (AR), virtual reality (VR), or mixed reality (MR) environment, said workstation comprising at least one of:

• an application state module adapted to:
• maintain a plurality of virtual scenes which describe distinct states of the application and include data and contents presented in AR/VR/MR,
• manage a plurality of application systems and corresponding system data, and
• allow querying and interaction with said application systems and the corresponding system data;
• the plurality of application systems adapted to create, read, modify, or destroy the corresponding system data and execute relevant application commands;
• the plurality of system data comprising at least one of:
• multidimensional data, including 3D volume data, or 2D image data, 3D or 2D geometry data,
• user input data, including hand position and orientation data, head position and orientation data, or controller input data, user interaction data, and informational data;
• a save/load module adapted to save the plurality of system data from memory to files, and load the plurality of system data from the files into the memory;
• an undo/redo module adapted to undo or redo user operations;
• a networking module adapted to support multi-user collaboration over the network;
• a state change router adapted to:
• receive a command to create, modify, or destroy the corresponding system data, and
• send the received command to the application state module, the undo/redo module, or the networking module for creating, modifying, or destroying the corresponding system data;
• a plurality of view controllers adapted to:
• query a public interface of the application state for the state of one or more application systems,
• subscribe to events that will trigger if at least a portion of the plurality of system data changes, and
• issue the commands to create, modify, or destroy the system data based on user instruction with plurality of interaction features;
• an AR/VR interface adapted to update the user input data from one or more AR/VR devices to at least one of:
• an AR/VR graphical user interface (GUI), or the plurality of view controllers;
• and
• a graphics rendering module adapted to:
• receive the system data from the plurality of view controllers,
• visualize the data on at least one of:
• 2D space or 3D space via a plurality of graphics rendering mechanisms, and
• display the visualizations on at least one of:
• a display device, or a GUI.