Augmented reality user interface including dual representation of physical location

A non-volatile machine-readable storage medium storing a program having instructions which when executed by a processor will cause the processor to:

• receive, from an inertial measurement unit of a first computing device, data indicative of movement and orientation of the first computing device;
• receive, from a camera of the first computing device, first video data representing a portion of a physical environment visible from a lens of the camera;
• identify, based on data from a location generator, a physical location of the first computing device in the physical environment;
• identify a physical object in the portion of the physical environment represented in the first video data, wherein the physical object is identified using a location of the physical object;
• obtain object data indicating a virtual location, a speed and an orientation of an augmented reality object in a virtual environment that corresponds to the physical environment wherein the object data further indicates a behavior of the augmented object corresponding to the identified physical object;
• generate a first view comprising the first video data and a representation of the augmented reality object superimposed over the first video data such that the representation appears to be within the physical environment at an apparent physical location corresponding to the virtual location and appears to move relative to the physical environment with the speed and the orientation of the augmented reality object in the virtual environment and with the behavior corresponding to the identified physical object;
• generate a second view comprising a first map indicating the apparent physical location of the augmented reality object within the physical environment relative to the physical location of the first computing device, and indicating the speed and the orientation of the augmented reality object relative to the physical environment;
• and
• transmit, to a second computing device, the apparent physical location, speed, and orientation of the augmented reality object in the virtual environment and the behavior corresponding to the identified physical object, wherein the transmission causes the second computing device to generate a second augmented reality video comprising second video data from a camera of the second computing device and a representation of the augmented reality object superimposed over the second video data such that the representation appears to be within the physical environment at the apparent physical location corresponding to the virtual location and appears to move relative to the physical environment with the speed and the orientation of the augmented reality object in the virtual environment, and with the behavior corresponding to the identified physical object, and further comprising a second map indicating the apparent physical location of the augmented reality object within the physical environment relative to a second physical location of the second computing device, and indicating the speed and the orientation of the augmented reality object relative to the physical environment.

A method for augmented reality user interface interactions, the method comprising:

• generating a first augmented reality video based on an identified first physical location of a first computing device within a physical environment, wherein the first augmented reality video comprises a first view including first video data from a camera of the first computing device and an augmented reality object superimposed over the first video data such that the augmented reality object appears to move in a first direction, with a behavior corresponding to an physical object represented in the first video data, and with a first speed relative to the physical environment and wherein the first augmented reality video comprises a second view comprising a first map indicating an apparent physical location of the augmented reality object within the physical environment relative to the identified first physical location and indicating the first direction and first speed of the apparent movement of the augmented reality object within the physical environment;
• and
• generating a second augmented reality video based on an identified second physical location of a second computing device within the physical environment of, wherein the second augmented reality video comprises a third view comprising second video data from a camera of the second computing device and the augmented reality object superimposed over the second video data such that the augmented reality object appears to move in the first direction, with the behavior corresponding to the identified physical object, and with the first speed relative to the physical environment and wherein the second augmented reality video comprises a fourth view comprising a second map indicating an apparent physical location of the augmented reality object within the physical environment relative to the identified second physical location and indicating the first direction and first speed of the apparent movement of the augmented reality object within the physical environment,
• wherein the identified physical object is identified using a location of the physical object.