US 2025/0147595 A1 · Integration of Artificial Reality Interaction Modes

Abstract

Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes. The interaction mode system can also provide affordances for signaling a current interaction mode and interaction mode transitions.

Claims20

Dependent claims

A computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for transitioning between interaction modes for interpreting user input in an artificial reality system, the process comprising:

selecting an interaction mode by identifying an interaction mode context and applying a mapping of interaction mode contexts to interaction modes, wherein the mapping includes at least:
a first mapping instance to a no-hands interaction mode in which at least some user interactions are performed using a gaze cursor;
a second mapping instance to a gaze and gesture interaction mode in which at least some user interactions are performed through a combination of a tracked user gaze and identified user gestures;
and
a third mapping instance to a ray casting interaction mode in which at least some user interactions are performed using a virtual ray projection cast out from a tracked position of a user's hand;
and
in response to selecting the interaction mode, enabling the selected interaction mode.

4 more elements

A computing system for transitioning between interaction modes for interpreting user input in an artificial reality system, the computing system comprising:

one or more processors;
and
one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:
selecting an interaction mode by identifying an interaction mode context and applying a mapping of interaction mode contexts to interaction modes, wherein the mapping includes at least:
a first mapping instance to a no-hands interaction mode in which at least some user interactions are performed using a gaze cursor;
a second mapping instance to a gaze and gesture interaction mode in which at least some user interactions are performed through a combination of a tracked user gaze and identified user gestures;
and
a third mapping instance to a ray casting interaction mode in which at least some user interactions are performed using a virtual ray projection cast out from a tracked position of a user's hand;
and
in response to selecting the interaction mode, enabling the selected interaction mode.

7 more elements

A method for transitioning between interaction modes for interpreting user input in an artificial reality system, the method comprising:

selecting an interaction mode by identifying an interaction mode context and applying a mapping of interaction mode contexts to interaction modes, wherein the mapping includes at least:
a first mapping instance to a first interaction mode in which at least some user interactions are performed using a gaze cursor;
a second mapping instance to a second interaction mode in which at least some user interactions are performed through a combination of a tracked user gaze and identified user gestures;
and
a third mapping instance to a third interaction mode in which at least some user interactions are performed using a virtual ray projection cast out from a tracked position of a user's hand;
and
in response to selecting the interaction mode, enabling the selected interaction mode.

4 more elements

Dependencies are inferred from the claim text.

Integration of Artificial Reality Interaction Modes

Life of this patent

Integration of Artificial Reality Interaction Modes

Life of this patent

Abstract

Claims20