Waypoint creation in map detection
AssigneeMagic Leap, Inc.
InventorsJavier Antonio Busto, Jonathan Brodsky
Life of this patent
Estimating the term…
Abstract
An augmented reality (AR) device can be configured to generate a virtual representation of a user's physical environment. The AR device can capture images of the user's physical environment to generate a mesh map. The AR device can project graphics at designated locations on a virtual bounding box to guide the user to capture images of the user's physical environment. The AR device can provide visual, audible, or haptic guidance to direct the user of the AR device to look toward waypoints to generate the mesh map of the user's environment.
Claims20
An augmented reality (AR) system comprising:
- an AR display configured to present virtual content to a user of the AR system;
- an outward facing camera configured to capture one or more images of an environment of the user;
- and
- a hardware processor in communication with the AR display and the outward facing camera, the hardware processor programmed to:
- generate a virtual three-dimensional (3D) bounding area;
- determine a first waypoint location on a surface of the 3D bounding area;
- display a first waypoint at the first waypoint location on the surface of the 3D bounding area;
- generate and display a guidance indicator on or near the surface of the 3D bounding area configured to direct the user to move the outward facing camera to point toward the first waypoint location;
- capture one or more images of a physical environment of the user when the outward facing camera is pointed toward the first waypoint location;
- and
- update or generate a mesh map based at least partly on the captured images, wherein the mesh map comprises a virtual representation of a physical environment of the user.
A non-transitory computer readable medium having software instructions stored thereon, the software instructions executable by a hardware computer processor to cause a computing system to perform operations comprising:
- generate a virtual three-dimensional (3D) bounding area;
- determine a first waypoint location on a surface of the 3D bounding area;
- display a first waypoint at the first waypoint location on the surface of the 3D bounding area on a display of a headset including an outward facing camera;
- generate and display a guidance indicator on or near the surface of the 3D bounding area configured to direct a user to move the outward facing camera to point toward the first waypoint location;
- capture one or more images of a physical environment of the user when the outward facing camera is pointed toward the first waypoint location;
- and
- update or generate a mesh map based at least partly on the captured images, wherein the mesh map comprises a virtual representation of a physical environment of the user.
Dependencies are inferred from the claim text.