Processing speech signals of a user to generate a visual representation of the user

A computing system for generating image data representing a speaker's face, the computing system comprising:

• a detection device configured to route data representing a voice signal to one or more processors that generate a response to the voice signal;
• and
• a data processing device comprising the one or more processors, the data processing device configured to generate a representation of a speaker that generated the voice signal in response to receiving the voice signal by performing operations comprising:
• executing a voice embedding function to generate a feature vector from the voice signal representing one or more signal features of the voice signal;
• mapping a signal feature of the feature vector to a visual feature of the speaker by a modality transfer function specifying a relationship between the visual feature of the speaker and the signal feature of the feature vector;
• and
• generating a visual representation of at least a portion of the speaker based on the mapping, the visual representation comprising the visual feature.