Intent-based user interface modifications in an artificial reality environment

A non-transitory computer-readable storage medium storing instructions, for providing intent-based user interface modifications in an artificial reality environment, the instructions, when executed by a computing system, cause the computing system to:

• identify, by an artificial reality system, a physical hand in a real-world environment of a user;
• associate the physical hand with a first virtual hand in the artificial reality environment;
• display the first virtual hand, the first virtual hand tracking motion of the physical hand in the real-world environment;
• identify an intent, to interact with a virtual object by the user, based on an identified association between the virtual object and the physical hand, wherein the intent to interact is a pressing motion by the physical hand relative to the virtual object;
• based on the identifying the intent to interact, display the first virtual hand, in the pressing motion, compressing the virtual object;
• determine that the virtual object has reached its maximum compression based on the pressing motion of the physical hand relative to the virtual object;
• in response to the identifying the intent and the determining that the virtual object has reached its maximum compression, modify tracking and display of the first virtual hand to be based on a position of the virtual object, such that a position of the first virtual hand is different from a position of the physical hand;
• and
• display, in addition to the first virtual hand, a second virtual hand tracking motion of the physical hand in the real-world environment.

A computing system for providing intent-based user interface modifications in an artificial reality environment, the computing system comprising:

• one or more processors;
• and
• one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to:
• identify, by an artificial reality system, a physical hand in a real-world environment of a user;
• associate the physical hand with a first virtual hand in the artificial reality environment;
• display the first virtual hand, the first virtual hand tracking motion of the physical hand in the real-world environment;
• identify an intent, to interact with a virtual object by the user, based on an identified association between the virtual object and the physical hand, wherein the intent to interact is a pressing motion by the physical hand relative to the virtual object;
• based on the identifying the intent to interact, display the first virtual hand, in the pressing motion, compressing the virtual object;
• determine that the virtual object has reached its maximum compression based on the pressing motion of the physical hand relative to the virtual object;
• in response to the identifying the intent and the determining that the virtual object has reached its maximum compression, modify tracking and display of the first virtual hand to be based on a position of the virtual object, such that a position of the first virtual hand is different from a position of the physical hand;
• and
• display, in addition to the first virtual hand, a second virtual hand tracking motion of the physical hand in the real-world environment.