Generating communicative behaviors for anthropomorphic virtual agents based on user's affect
AssigneeIpsoft Incorporated
InventorsReza AMINI, Ugan YASAVUR, Jorge TRAVIESO, Chetan DUBE
Life of this patent
Estimating the term…
Abstract
Systems and methods for automatically generating at least one of facial expressions, body gestures, vocal expressions, or verbal expressions for a virtual agent based on emotion, mood and/or personality of a user and/or the virtual agent are provided. Systems and method for determining a user's emotion, mood and/or personality are also provided.
Claims17
A method for automatically generating at least one of facial expressions, body gestures, vocal expressions, or verbal expressions for a virtual agent, the method comprising:
- receiving, by a computer, an emotion vector for a user, a mood vector for the user, and a personality vector of the user, wherein the emotion vector for the user, the mood vector for the user and the personality vector of the user are all for a particular utterance of the user;
- determining, by a computer, an emotion vector for the virtual agent based on the emotion vector of the user;
- determining, by the computer, a mood vector for the virtual agent based on i) the emotion vector for the virtual agent, and ii) the mood vector of the user;
- determining, by the computer, a personality vector for the virtual agent based on i) the mood vector for the virtual agent, and ii) a personality vector of the user;
- determining, by the computer, at least one of a facial expression, body gesture, vocal expression, or verbal expression for the virtual agent based on a content of the particular user utterance and at least one of the emotion vector for the virtual agent, the mood vector for the virtual agent and the personality vector for the virtual agent;
- and
- applying, by the computer, the facial expression, body gesture, vocal expression, verbal expression, or any combination thereof to the virtual agent to produce control of the virtual agent's vocal expression, facial expression or both.
An article comprising a non-transitory computer readable storage medium containing program instructions for causing a computer to perform a method for automatically generating at least one of facial expressions, body gestures, vocal expressions, or verbal expressions for a virtual agent, the method comprising:
- receive an emotion vector for a user, a mood vector for the user, and a personality vector of the user, wherein the emotion vector for the user, the mood vector for the user and the personality vector of the user are all for a particular utterance of the user;
- determine an emotion vector for the virtual agent based on the emotion vector of the user;
- determine a mood vector for the virtual agent based on i) the emotion vector for the virtual agent, and ii) the mood vector of the user;
- determine a personality vector for the virtual agent based on i) the mood vector for the virtual agent, and ii) a personality vector of the user;
- determine at least one of a facial expression, body gesture, vocal expression, or verbal expression for the virtual agent based on a content of the particular user utterance and at least one of the emotion vector for the virtual agent, the mood vector for the virtual agent and the personality vector for the virtual agent;
- and
- apply the facial expression, body gesture, vocal expression, verbal expression, or any combination thereof to the virtual agent to produce control of the virtual agent's vocal expression, facial expression or both.
An apparatus comprising:
- a processor configured to:
- receive an emotion vector for a user, a mood vector for the user, and a personality vector of the user, wherein the emotion vector for the user, the mood vector for the user and the personality vector of the user are all for a particular utterance of the user;
- determine an emotion vector for the virtual agent based on the emotion vector of the user;
- determine a mood vector for the virtual agent based on i) the emotion vector for the virtual agent, and ii) the mood vector of the user;
- determine a personality vector for the virtual agent based on i) the mood vector for the virtual agent, and ii) a personality vector of the user;
- determine at least one of a facial expression, body gesture, vocal expression, or verbal expression for the virtual agent based on a content of the particular user utterance and at least one of the emotion vector for the virtual agent, the mood vector for the virtual agent and the personality vector for the virtual agent;
- and
- apply the facial expression, body gesture, vocal expression, verbal expression, or any combination thereof to the virtual agent to produce control of the virtual agent's vocal expression, facial expression or both.
Dependencies are inferred from the claim text.