Systems and methods for providing an interactive avatar

A non-transient processor-readable medium storing instructions configured to be executed by one or more processors to perform steps of:

• receiving, by a processor-based system, a video recording of a human subject including captured physical characteristics and phoneme pronunciations of the human subject wherein the video recording has both audio of the human subject and a visual representation of the human subject;
• generating, by the processor-based system, a personality model comprising a Markov decision process based on the video recording, the personality model corresponding to the human subject;
• extracting, by the processor-based system, from the video recording, and storing in an avatar characteristic table:
• appearance simulating the human subject based on the physical characteristics of the human subject,
• voice simulating the human subject based on the phoneme pronunciations by the human subject,
• movement behavior that is characteristic of the human subject based on the physical characteristics of the human subject,
• speech behavior that is characteristic of the human subject based on the phoneme pronunciations by the human subject, and
• attitude that is characteristic of the human subject;
• conducting a conversation with a user using the personality model, conducting a conversation comprising:
• receiving, by the processor-based system, a communication from a user;
• generating, by the processor-based system, a probability table that identifies the probability that the human subject would exhibit a particular type of response based on the avatar characteristic table and a current context of the conversation;
• determining a next state using the personality model, the next state based on the determined attitude, a random number, and the probability table, the next state comprising a response to the communication;
• rendering, by the processor-based system to the user, an avatar speaking the response, with the avatar speaking with the determined voice and the determined speech behavior and appearing with the determined appearance and moving with the determined movement behavior;
• receiving a reply from the user;
• and
• updating the avatar characteristic table based on the communication from the user, the response from the avatar, and the reply from the user;
• wherein a future conversation is conducted using the updated avatar characteristic table that has an augmented memory based on the conversation that manifests itself in future avatar spoken responses in the future conversation.

A processor-based system configured to perform steps of:

• receiving, by a processor-based system, a video recording of a human subject including captured physical characteristics and phoneme pronunciations of the human subject wherein the video recording has both audio of the human subject and a visual representation of the human subject;
• generating, by the processor-based system, a personality model comprising a Markov decision process based on the video recording, the personality model corresponding to the human subject;
• extracting, by the processor-based system, from the video recording, and storing in an avatar characteristic table:
• appearance simulating the human subject based on the physical characteristics of the human subject,
• voice simulating the human subject based on the phoneme pronunciations by the human subject,
• movement behavior that is characteristic of the human subject based on the physical characteristics of the human subject,
• speech behavior that is characteristic of the human subject based on the phoneme pronunciations by the human subject, and
• attitude that is characteristic of the human subject;
• conducting a conversation with a user using the personality model, conducting a conversation comprising:
• receiving, by the processor-based system, a communication from a user;
• generating, by the processor-based system, a probability table that identifies the probability that the human subject would exhibit a particular type of response based on the avatar characteristic table and a current context of the conversation;
• determining a next state using the personality model, the next state based on the determined attitude, a random number, and the probability table, the next state comprising a response to the communication;
• rendering, by the processor-based system to the user, an avatar speaking the response, with the avatar speaking with the determined voice and the determined speech behavior and appearing with the determined appearance and moving with the determined movement behavior;
• receiving a reply from the user;
• and
• updating the avatar characteristic table based on the communication from the user, the response from the avatar, and the reply from the user;
• wherein a future conversation is conducted using the updated avatar characteristic table that has an augmented memory based on the conversation that manifests itself in future avatar spoken responses in the future conversation.

A method comprising:

• receiving, by a processor-based system, a video recording of a human subject including captured physical characteristics and phoneme pronunciations of the human subject, wherein the video recording has both audio of the human subject and a visual representation of the human subject;
• generating, by the processor-based system, a personality model comprising a Markov decision process based on the video recording, the personality model corresponding to the human subject;
• extracting, by the processor-based system, from the video recording, and storing in an avatar characteristic table:
• appearance simulating the human subject based on the physical characteristics of the human subject,
• voice simulating the human subject based on the phoneme pronunciations by the human subject,
• movement behavior that is characteristic of the human subject based on the physical characteristics of the human subject,
• speech behavior that is characteristic of the human subject based on the phoneme pronunciations by the human subject, and
• attitude that is characteristic of the human subject;
• conducting a first conversation with a user using the personality model, conducting a first conversation comprising:
• receiving, by the processor-based system, a communication from a user;
• determining a next state using the personality model, the next state based on the determined attitude, a random number, and the probability table, the next state comprising a response to the communication;
• rendering, by the processor-based system to the user, an avatar speaking the response, with the avatar speaking with the determined voice and the determined speech behavior and appearing with the determined appearance and moving with the determined movement behavior;
• receiving a reply from the user;
• and
• updating the avatar characteristic table based on the communication from the user, the response from the avatar, and the reply from the user;
• wherein a future conversation is conducted using the updated avatar characteristic table that has an augmented memory based on the first conversation that manifests itself in future avatar spoken responses in the future conversation, and wherein the future conversation references the content of the first conversation.