Visually convincing depiction of object interactions in augmented reality images

A computer-implemented method for providing a virtual reality experience interacting with a real world physical structure having at least one marker, the method comprising:

• receiving a captured image of the real world physical structure, the captured image provided by a camera disposed in a housing;
• identifying, by image processing performed on the captured image using at least one processor, the at least one marker disposed at a location of the real world physical structure;
• determining aspects of camera viewpoint of the housing relative to the physical structure at least in part in response to the identified at least one marker;
• arranging an at least partial three dimensional model of the real world physical structure in a virtual space based upon the at least one marker;
• using collision and/or occlusion detection between the at least partial three dimensional model of the real world physical structure arranged in the virtual space and a virtual object to control display of interaction between the real world physical structure and the virtual object from the determined camera viewpoint;
• and
• displaying, on a display, an augmented reality view of the captured image including the controlled display of the interaction.

An apparatus for providing a virtual reality experience interacting with a real world physical structure having at least one marker, the apparatus comprising:

• an image interface configured to receive, from a physical camera disposed at a location of a housing, a captured image of the real world physical structure;
• a memory storing data of at least a partial three dimensional model of the real world physical structure;
• and
• at least one processor in communication with the memory and the image interface, the processor configured to:
• provide a virtual object;
• determine aspects of camera viewpoint of the housing relative to the real world physical structure at least in part in response to said at least one marker;
• arranging the at least partial three dimensional model of the real world physical structure in a virtual space based upon the at least one marker;
• and
• display an augmented reality view of the captured image on a display,
• the processor using collision and/or occlusion detection between the at least partial three dimensional model of the real world physical structure arranged in the virtual space and the virtual object to control display of the virtual object interacting with the real world physical structure from the determined camera viewpoint.

A non-transitory computer-readable storage medium having stored instructions which, when executed by at least one processor of a processing system, causes the processing system to perform operations for providing a virtual reality experience interacting with a real world physical structure having at least one marker, the operations comprising:

• receiving a captured image of the real world physical structure, the captured image provided by a camera disposed in a housing;
• identifying, by image processing performed on the captured image using the at least one processor, the at least one marker disposed at a location of the real world physical structure;
• determining aspects of camera viewpoint of the housing relative to the physical structure at least in part in response to the identified at least one marker;
• arranging an at least partial three dimensional model of the real world physical structure in a virtual space based upon the identified at least one marker;
• using collision and/or occlusion detection between the at least partial three dimensional model of the real world physical structure arranged in the virtual space and a virtual object to control display of the interaction between the real world physical structure and the virtual object from the determined camera viewpoint;
• and
• displaying an augmented reality view of the captured image including the controlled display of the interaction.