Synchronized, interactive augmented reality displays for multifunction devices

An augmented reality device, comprising:

• one or more onboard motion sensors configured for sensing motion;
• a camera for capturing a video for display on a display;
• a processor coupled to the motion sensor and the video camera, the processor configured for:
• modeling a computer-generated imagery representing one or more objects depicted in the video,
• overlaying an information layer on the computer-generated imagery,
• combining the information layer and the video for presentation on the display,
• displaying the information layer and the computer-generated imagery representing one or more objects with the video on the display,
• receiving sensor data from the one or more onboard motion sensors indicating that the camera is in motion, and
• synchronizing the video, the computer-generated imagery, and the information layer using the sensor data.

A non-transitory machine-readable storage medium comprising a plurality of instructions that, in response to being executed on a computing device, cause the computing device to:

• capture a video and display the video on a display of the computing device;
• generate computer-generated imagery based on the video;
• combine an information layer and the video, the information layer related to one or more objects in the video;
• display the computer-generated imagery representing one or more objects in the video on the display;
• overlay the information layer on the computer-generated imagery;
• receive sensor data from one or more onboard motion sensors indicating that the computing device is in motion;
• and
• synchronize the display of the video, the computer-generated imagery, and the information layer on the display using the sensor data.

A computer-implemented method for providing an augmented reality display comprising:

• capturing video with a camera of a device and displaying the video on a display of the device;
• generating computer-generated imagery based on the video;
• combining an information layer and the video, the information layer related to one or more objects in the video;
• displaying the computer-generated imagery representing one or more objects in the video on the display;
• overlaying the information layer on the computer-generated imagery;
• processing sensor data from a motion sensor of the device indicating that the device is in motion;
• and
• synchronizing the display of the video, the computer-generated imagery, and the information layer on the display using the sensor data.

A mobile device comprising:

• a sensor configured to generate data related to position of the mobile device;
• a camera to capture video for display on a display;
• and
• a processor coupled to the display, the sensor and the camera, the mobile configured to:
• capture a video and display the video on a display of the computing device;
• generate computer-generated imagery based on the video;
• combine an information layer and the video, the information layer related to one or more objects in the video;
• display the computer-generated imagery representing one or more objects in the video on the display;
• overlay the information layer on the computer-generated imagery;
• receive sensor data from the sensor indicating that the mobile device is in motion;
• and
• synchronize the display of the video, the computer-generated imagery, and the information layer on the display using the sensor data.