Methods for augmented reality applications

A method of interaction using augmented reality, the method comprising:

• capturing, by a local user, a live video image using an imaging device;
• generating first augmented reality (AR) coordinates corresponding to the live video image;
• generating, by the local user, first user-generated annotations;
• registering the first user-generated annotations to the live video image;
• transmitting, by the local user, the first AR coordinates, first user-generated annotations, and live video image to a remote user;
• receiving, by the local user, second user-generated annotations and second AR coordinates from the remote user;
• receiving, from the remote user, an identification of an object depicted in the live video image, wherein the second user-generated annotations comprise information about the identified object;
• and
• viewing, by the local user, the generated first user-generated annotations, the identification of the identified object depicted in the live video image, and the received second user-generated annotations registered to the live video image according to the second AR coordinates,
• wherein the viewing is performed on a device chosen from a group including a tablet, a mobile phone, a laptop computer, a head-mounted display, and a virtual-reality display.

A method of interaction using augmented reality, the method comprising:

• capturing, by a local user, a live video image using an imaging device;
• generating augmented reality (AR) coordinates corresponding to the live video image;
• updating a scene view according to the generated AR coordinates;
• encoding the live video image;
• loading first 3D object information from external storage;
• combining the AR coordinates, first 3D object information, and encoded live video image, to generate combined data;
• transmitting, by the local user, the combined data to a remote user;
• receiving, from the remote user, updated combined data including second 3D object information;
• receiving, from the remote user, an identification of an object depicted in the live video image, wherein second user-generated annotations comprise information about the identified object;
• and
• viewing, by the local user, the updated combined data and the identification of an object depicted in the live video image on a device chosen from a group including a tablet, a mobile phone, a laptop computer, a head-mounted display, and a virtual-reality display.

A method of interaction using augmented reality, the method comprising:

• receiving, from a remote user, combined data comprising augmented reality (AR) coordinates, information of first 3D objects, and an encoded live video frame;
• updating a background image based on the encoded live video frame;
• updating a scene view according to the AR coordinates;
• updating positions and existence of the first 3D objects;
• loading 3D content from external storage;
• creating a first updated rendered view by combining the loaded 3D content and the background image;
• viewing the first updated rendered view on a device chosen from a group including a tablet, a mobile phone, a laptop computer, a head-mounted display, and a virtual-reality display;
• generating second 3D object information;
• creating a second updated rendered view by combining the second 3D object information and the background image;
• returning, to the remote user, the second updated rendered view to the remote user;
• and
• returning, to the remote user, an identification of an object depicted in the live video image from the remote user, wherein the second updated rendered view comprises information about the identified object.