Emotional interaction apparatus
AssigneeThe George Washington University
InventorChung Hyuk PARK
Life of this patent
Estimating the term…
Abstract
A system and method for emotional interaction. The system includes a robot that uses behavioral analysis automation to provide treatment and assessment of emotional communication and social skills for children with autism. The system generates a dataset including speech signals of one or more speakers, and assigns at least one of a set of labels to each of the speech signals for the one or more speakers. The set of labels includes at least three levels of emotional dimensions, the emotional dimensions include at least activation, valence, and dominance, and the at least three levels of emotional dimensions include a high state, a neutral state, and a low state.
Claims26
An emotional detection system, comprising:
- an audio input device (150) receiving speech signals from a speaker;
- a voice analyzer (108) configured to receive the speech signals from the audio input device, determine at least one speech emotional dimensional label of a set of emotional dimension labels for each of the speech signals for the speaker, wherein the emotional dimension labels include at least one of activation, valence, and/or dominance, and determine a speech emotional dimension level associated with each speech emotional dimension label, wherein the emotional dimension level includes a high state, a neutral state, and a low state;
- an emotion controller (116) configured to receive the at least one speech emotional dimension label and the speech emotional dimension level and select a responsive emotional expression and/or gestural behavior based on the at least one speech emotional dimension label and speech emotional dimension level;
- and
- an output device configured to present the selected responsive emotional expression and/or gestural behavior to the speaker.
A method for detecting the emotion of a speaker, comprising:
- receiving by an audio input device, speech signals from the speaker;
- receiving by a voice analyzer the speech signals from the audio input device;
- determining by the voice analyzer, at least one of a set of emotional dimension labels for each of the speech signals for the speaker, wherein the emotional dimension labels include at least one of activation, valence, and/or dominance;
- determining by the voice analyzer, an emotional dimension level associated with each emotional dimension label, wherein the emotional dimension level includes a high state, neutral state, and a low state;
- receiving by an emotion controller configured the at least one emotional dimension label and the emotional dimension level;
- selecting by the emotion controller, a responsive emotional expression and/or gestural behavior based on the at least one emotional dimension label and emotional dimension level;
- and
- presenting by an output device, the selected responsive emotional expression and/or gestural behavior to the speaker.
An emotional detection system, comprising:
- a motion sensor configured to detect movement of the speaker;
- and
- a motion module configured to receive the detected movement and determine a speaker gestural behavior based on the detected movement;
- an emotion controller (116) is further configured to receive the detected speaker gestural behavior and select the responsive emotional expression and/or gestural behavior based on the detected speaker gestural behavior;
- and
- an output device configured to present the selected responsive emotional expression and/or gestural behavior to the speaker.
Dependencies are inferred from the claim text.