Converting a 2D positional input into a 3D point in space
AssigneeMagic Leap, Inc.
InventorMarc Alan McCall
Life of this patent
Estimating the term…
Abstract
A user may interact and select positions in three-dimensional space arbitrarily through conversion of a two-dimensional positional input into a three-dimensional point in space. The system may allow a user to use one or more user input devices for pointing, annotating, or drawing on virtual objects, real objects or empty space in reference to the location of the three-dimensional point in space within an augmented reality or mixed reality session.
Claims19
A computerized method, performed by a computing system having one or more hardware computer processors and one or more non-transitory computer readable storage device storing software instructions executable by the computing system to perform the computerized method comprising:
- determining a head pose of a user associated with a wearable display device;
- determining a cursor screen position at a first distance from the wearable display device;
- determining a cursor plane position at a second distance from the wearable display device;
- determining a two-dimensional position on the cursor screen;
- determining a one-dimensional position defined by at least one of the cursor plane or a mesh, wherein the one-dimensional position is further defined by a first intersection of a ray cast from the two-dimensional position on the cursor screen;
- and
- displaying a virtual object to the user at a three-dimensional position comprised of the two-dimensional position and the one-dimensional position.
A computerized method, performed by a computing system having one or more hardware computer processors and one or more non-transitory computer readable storage device storing software instructions executable by the computing system to perform the computerized method comprising:
- determining a head pose of a user associated with a wearable display device, wherein the head pose of the user determines a view frustum;
- determining a cursor screen position at a first distance from the wearable display device;
- determining a cursor plane position at a second distance from the wearable display device;
- determining a two-dimensional position on the cursor screen;
- determining a one-dimensional position defined by at least one of the cursor plane or a mesh;
- and
- displaying a virtual object to the user at a three-dimensional position comprised of the two-dimensional position and the one-dimensional position,
- wherein the cursor screen bisects the view frustum.
A system for converting a two-dimensional positional input into a three-dimensional position for visualizing augmented reality, the system comprising:
- a wearable headset;
- one or more non-transitory computer readable storage mediums having program instructions embodied therewith;
- and
- one or more processors configured to execute the program instructions to cause the system to:
- determine a three-dimensional position within an augmented reality environment that includes one or more virtual objects and one or more real-world objects;
- determine a two-dimensional position on a cursor screen based on a first two-dimensional offset and a second two-dimensional offset;
- determine a one-dimensional position on a cursor plane or a mesh associated with one of the virtual objects or real-world objects;
- identify an intersection of the determined one-dimensional position within the augmented reality environment where an axis orthogonal from a head pose origin associated with a position and a rotation, through the determined two-dimensional position on the cursor screen, and intersecting the cursor plane or the mesh associated with one of the virtual objects or real-world objects;
- determine an updated three-dimensional position within the augmented reality environment;
- and
- display a virtual object at the updated three-dimensional position within the augmented reality environment to a user via the wearable headset.
Dependencies are inferred from the claim text.