Smart Character Suggestion via XR Cubic Keyboard on Head-mounted Devices

One or more computer-readable non-transitory non-volatile storage media embodying software that is operable when executed to:

• receive, from a client system comprising a head-mounted extended-reality (XR) device, a first user input from a user;
• determine, based on the first user input, an intent of the user to activate an XR cubic keyboard;
• render, via one or more XR displays of the head-mounted XR device, the XR cubic keyboard, wherein the XR cubic keyboard comprises a plurality of input areas representing a plurality of characters, respectively, in a three-dimensional (3D) space, and wherein the plurality of input areas are reachable by a plurality of vectors, respectively, from a centroid of the XR cubic keyboard in the 3D space;
• receive, a second user input from the user, wherein the second user input comprises a hand movement of the user along a direction of a first vector of the plurality of vectors from the centroid of the XR cubic keyboard in the 3D space;
• determine, based only on the direction of the first vector with respect to the XR cubic keyboard in the 3D space, a first character of the plurality of characters that the user intended to input;
• and
• render, via the one or more XR displays, an indication of the first character.

A system comprising:

• one or more processors;
• and a non-transitory non-volatile memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:
• receive, from a client system comprising a head-mounted extended-reality (XR) device, a first user input from a user;
• determine, based on the first user input, an intent of the user to activate an XR cubic keyboard;
• render, via one or more XR displays of the head-mounted XR device, the XR cubic keyboard, wherein the XR cubic keyboard comprises a plurality of input areas representing a plurality of characters, respectively, in a three-dimensional (3D) space, and wherein the plurality of input areas are reachable by a plurality of vectors, respectively, from a centroid of the XR cubic keyboard in the 3D space;
• receive, a second user input from the user, wherein the second user input comprises a hand movement of the user along a direction of a first vector of the plurality of vectors from the centroid of the XR cubic keyboard in the 3D space;
• determine, based only on the direction of the first vector with respect to the XR cubic keyboard in the 3D space, a first character of the plurality of characters that the user intended to input;
• and
• render, via the one or more XR displays, an indication of the first character.