Waypoint creation in map detection
AssigneeMagic Leap, Inc.
InventorsJavier Antonio Busto, Jonathan Brodsky
Life of this patent
Estimating the term…
Abstract
An augmented reality (AR) device can be configured to generate a virtual representation of a user's physical environment. The AR device can capture images of the user's physical environment to generate a mesh map. The AR device can project graphics at designated locations on a virtual bounding box to guide the user to capture images of the user's physical environment. The AR device can provide visual, audible, or haptic guidance to direct the user of the AR device to look toward waypoints to generate the mesh map of the user's environment.
Claims20
An augmented reality (AR) system comprising:
- an AR display configured to present virtual content to a user of the AR system;
- a database to store a set of waypoints corresponding to a plurality of locations on a bounding area, wherein each of the set of waypoints is a uniquely positioned virtual location on the bounding area;
- an outward facing camera configured to selectively capture one or more images of an environment of the user;
- and
- a position sensor configured to capture information associated a position of the user;
- a hardware processor in communication with the AR display, the database, the outward facing camera, and the position sensor, the hardware processor programmed to:
- generate a virtual three-dimensional (3D) version of the bounding area based on the environment of the user, including the set of waypoints for the bounding area;
- determine the position of the user relative to the waypoints of the bounding area based on the information from the position sensor;
- direct the outward facing camera to capture one or more images of a physical environment of the user upon determination that the position of the user is such that the outward facing camera is pointed toward a first waypoint of the set of waypoints;
- and
- update or generate a mesh map based at least partly on the captured one or more images, wherein the mesh map comprises a virtual representation of a physical environment of the user.
A method of mapping a physical environment of a user using an augmented reality (AR) system, the method comprising:
- receiving captured data from the AR system;
- constructing or retrieving at least a portion of a map of the physical environment of the user based at least in part on the received captured data;
- generating a bounding area at a location of the user in the physical environment;
- identifying one or more waypoints relative to the bounding areas, including at least one first waypoint corresponding to unmapped portions of the physical environment on or within the bounding area;
- directing an outward facing camera of the AR system to capture one or more images of the physical environment of the user upon determination that a position of the user is such that the outward facing camera is pointed toward the at least one first waypoint;
- and
- updating the map based at least partly on the captured one or more images, wherein the map is a mesh map of a virtual representation of the physical environment of the user.
Dependencies are inferred from the claim text.