Automatic Projection Type Selection in an Artificial Reality Environment

A computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for interacting in an artificial reality environment, the process comprising:

• determining a projection type, for a projection for a user interaction with multiple objects and prior to the user interaction with the multiple objects, by:
• identifying an interaction plane of a gaze of a user, wherein the interaction plane is a viewing plane, on which the gaze of the user is focused prior to the user interaction, that is A) distant from the user in a 3D environment and B) is identified based on the gaze, by the user, directed toward a location between the multiple objects;
• selecting the projection type based on the computed distance between the user and the interaction plane;
• generating a projection, of the selected projection type;
• and
• causing the user interaction with the multiple objects using the generated projection and based on one or more tracked positions of one or more body parts of the user.

A computing system for interacting in an artificial reality environment, the computing system comprising:

• one or more processors;
• and
• one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:
• determining a projection type, for a projection for a user interaction with multiple objects and prior to the user interaction with the multiple objects, by:
• identifying an interaction plane of a gaze of a user, wherein the interaction plane is a viewing plane, on which the gaze of the user is focused prior to the user interaction, that is A) distant from the user in a 3D environment and B) is identified based on the gaze, by the user, directed toward a location between the multiple objects;
• selecting the projection type based on the computed distance between the user and the interaction plane;
• generating a projection, of the selected projection type;
• and
• causing the user interaction with the multiple objects using the generated projection and based on one or more tracked positions of one or more body parts of the user.