System and method for linking and interacting between augmented reality and virtual reality environments

An augmented reality system, comprising:

• a processor;
• a non-transitory computer-readable medium operatively coupled to the processor and having instructions stored thereon that, when executed by the processor cause the system to:
• render an augmented reality view of a real-world environment, the augmented reality view comprising a graphical digital object registered with the real-world environment;
• capture data of the rendered augmented reality view, wherein the captured data comprises video data of the real-word environment and graphical digital object data comprising the graphical digital object;
• transmit, to a device associated with a second user, the video data and the graphical digital object data of the rendered augmented reality view, wherein the video data and the graphical digital object data are transmitted as separate data streams;
• after transmitting the video data and the graphical digital object data, receive, from the device associated with the second user, digital object data modifying a state of the graphical digital object;
• and
• in response to receiving the digital object data modifying the state of the graphical digital object, modify the rendered augmented reality view.

A method, comprising:

• receiving, at a first device associated with a first user, video data and digital object data from a second device associated with a second user, wherein the video data and digital object data are associated with a display of an augmented reality view of a real-world environment having a first viewing angle;
• based on the received video data and digital object data, rendering a virtual reality view using the first device;
• receiving digital object data generated by the first user by physical manipulation of a user input device, the data comprising digital object data associated with the augmented reality view;
• wherein the video data and digital object data are received as separate data streams, the digital object data comprising a graphical digital object that is overlaid over the video, and wherein receiving digital object data generated by the first user by physical manipulation of a user input device comprises the user selecting the graphical digital object;
• transmitting the digital object data to the second device, wherein the digital object data modifies the display of the augmented reality view;
• receiving, at the first device, video data from a third device associated with a third user, wherein the video data is associated with a second display of an augmented reality view of the real-world environment having a second viewing angle;
• and
• temporally synching and spatially reconstructing, at the first device, the video data received from the second device with the video data received from the third device to create a three-dimensional representation of the real-world environment.