Rendering XR Avatars Based on Acoustical Features

One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

• receive, from a first client system associated with a first user, a voice input having a plurality of acoustic features;
• determine, based on one or more of the acoustic features by one or more machine-learning models, one or more emotions associated with the voice input;
• determine, based on the one or more emotions, one or more facial features for a first extended-reality (XR) avatar representing the first user;
• and
• send, to a second client system associated with a second user, instructions for rendering the first XR avatar representing the first user, wherein the first XR avatar is rendered with the determined one or more facial features.

A system comprising:

• one or more processors;
• and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:
• receive, from a first client system associated with a first user, a voice input having a plurality of acoustic features;
• determine, based on one or more of the acoustic features by one or more machine-learning models, one or more emotions associated with the voice input;
• determine, based on the one or more emotions, one or more facial features for a first extended-reality (XR) avatar representing the first user;
• and
• send, to a second client system associated with a second user, instructions for rendering the first XR avatar representing the first user, wherein the first XR avatar is rendered with the determined one or more facial features.