Coordinating cursor movement between a physical surface and a virtual surface

A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to perform operations for moving a virtual cursor along two traversing virtual planes, the operations comprising:

• generating a display via a wearable extended reality appliance, the display including a virtual cursor and plurality of virtual objects located on a first virtual plane that traverses a second virtual plane overlying a physical surface;
• while the virtual cursor is displayed on the first virtual plane, receiving a first two-dimensional input via a surface input device, wherein the first two-dimensional input is reflective of an intent to select a first virtual object located on the first virtual plane;
• in response to the first two-dimensional input, causing a first cursor movement toward the first virtual object, the first cursor movement being along the first virtual plane;
• while the virtual cursor is displayed on the first virtual plane, receiving a second two-dimensional input via the surface input device, wherein the second two-dimensional input is reflective of an intent to select a second virtual object that appears on the physical surface;
• and
• in response to the second two-dimensional input, causing a second cursor movement toward the second virtual object, the second cursor movement including a partial movement along the first virtual plane and a partial movement along the second virtual plane.

A method for moving a virtual cursor along two traversing virtual planes, the method comprising:

• generating a display via a wearable extended reality appliance, the display including a virtual cursor and plurality of virtual objects located on a first virtual plane that traverses a second virtual plane overlying a physical surface;
• while the virtual cursor is displayed on the first virtual plane, receiving a first two-dimensional input via a surface input device, wherein the first two-dimensional input is reflective of an intent to select a first virtual object located on the first virtual plane;
• in response to the first two-dimensional input, causing a first cursor movement toward the first virtual object, the first cursor movement being along the first virtual plane;
• while the virtual cursor is displayed on the first virtual plane, receiving a second two-dimensional input via the surface input device, wherein the second two-dimensional input is reflective of an intent to select a second virtual object that appears on the physical surface;
• and
• in response to the second two-dimensional input, causing a second cursor movement toward the second virtual object, the second cursor movement including a partial movement along the first virtual plane and a partial movement along the second virtual plane.

A system for moving a virtual cursor along two traversing virtual planes, the system comprising:

• at least one processor configured to:
• generate a display via a wearable extended reality appliance, the display including a virtual cursor and plurality of virtual objects located on a first virtual plane that traverses a second virtual plane overlying a physical surface;
• while the virtual cursor is displayed on the first virtual plane, receive a first two-dimensional input via a surface input device, wherein the first two-dimensional input is reflective of an intent to select a first virtual object located on the first virtual plane;
• in response to the first two-dimensional input, cause a first cursor movement toward the first virtual object, the first cursor movement being along the first virtual plane;
• while the virtual cursor is displayed on the first virtual plane, receive a second two-dimensional input via the surface input device, wherein the second two-dimensional input is reflective of an intent to select a second virtual object that appears on the physical surface;
• and
• in response to the second two-dimensional input, cause a second cursor movement toward the second virtual object, the second cursor movement including a partial movement along the first virtual plane and a partial movement along the second virtual plane.