Nonverbal information generation apparatus, nonverbal information generation model learning apparatus, methods, and programs

A nonverbal information generation model learning apparatus comprising:

• a hardware processor that:
• acquires text information representing text corresponding to voice of a speaker and time information representing times assigned to predetermined units of the text;
• acquires nonverbal information representing information relating to behavior of the speaker when the speaker performed speaking corresponding to the text, and time information representing times at which the behavior was performed and corresponding to the nonverbal information, and creates time-information-stamped nonverbal information;
• extracts time-information-stamped text feature quantities representing feature quantities of the text information from the acquired text information and the time information corresponding to the text information;
• and
• learns a nonverbal information generation model for generating the acquired time-information-stamped nonverbal information on the basis of the extracted time-information-stamped text feature quantities.

A nonverbal information generation model learning apparatus comprising:

• a hardware processor that:
• acquires voice information corresponding to voice of a speaker and time information representing times of predetermined units when the voice information is emitted;
• acquires nonverbal information representing information relating to behavior of the speaker when the speaker performed speaking corresponding to the voice and time information representing times at which the behavior was performed and corresponding to the nonverbal information, and creates time-information-stamped nonverbal information;
• extracts time-information-stamped voice feature quantities representing feature quantities of the voice information from the acquired voice information and the time information corresponding to the voice information;
• and
• learns a nonverbal information generation model for generating the acquired time-information-stamped nonverbal information on the basis of the extracted time-information-stamped voice feature quantities.

A nonverbal information generation model learning apparatus comprising:

• a hardware processor that:
• acquires text information representing text corresponding to voice of a speaker and time information representing times assigned to predetermined units of the text;
• acquires nonverbal information representing information relating to behavior of a listener of speaking of the speaker corresponding to the text when the speaker performed the speaking, and time information representing times at which the behavior was performed and corresponding to the nonverbal information, and creates time-information-stamped nonverbal information;
• extracts time-information-stamped text feature quantities representing feature quantities of the text information from the acquired text information and the time information corresponding to the text information;
• and
• learns a nonverbal information generation model for generating the acquired time-information-stamped nonverbal information on the basis of the extracted time-information-stamped text feature quantities.

A nonverbal information generation model learning apparatus comprising:

• a hardware processor that:
• acquires voice information corresponding to voice of a speaker and time information representing times of predetermined units when the voice information is emitted;
• acquires nonverbal information representing information relating to behavior of a listener of speaking of the speaker corresponding to the voice when the speaker performed the speaking, and time information representing times at which the behavior was performed and corresponding to the nonverbal information, and creates time-information-stamped nonverbal information;
• extracts time-information-stamped voice feature quantities representing feature quantities of the voice information from the acquired voice information and the time information corresponding to the voice information;
• and
• learns a nonverbal information generation model for generating the acquired time-information-stamped nonverbal information on the basis of the extracted time-information-stamped voice feature quantities.

A nonverbal information generation model learning method comprising:

• acquiring text information representing text corresponding to voice of a speaker and time information representing times assigned to predetermined units of the text;
• acquiring nonverbal information representing information relating to behavior of a listener of speaking of the speaker corresponding to the text when the speaker performed the speaking, and time information representing times at which the behavior was performed and corresponding to the nonverbal information, and creating time-information-stamped nonverbal information;
• extracting time-information-stamped text feature quantities representing feature quantities of the text information from the acquired text information and the time information corresponding to the text information;
• and
• learns a nonverbal information generation model for generating the acquired time-information-stamped nonverbal information on the basis of the extracted time-information-stamped text feature quantities.

A nonverbal information generation model learning method comprising:

• acquiring voice information corresponding to voice of a speaker and time information representing times of predetermined units when the voice information is emitted;
• acquiring nonverbal information representing information relating to behavior of a listener of speaking of the speaker corresponding to the voice when the speaker performed the speaking, and time information representing times at which the behavior was performed and corresponding to the nonverbal information, and creating time-information-stamped nonverbal information;
• extracting time-information-stamped voice feature quantities representing feature quantities of the voice information from the acquired voice information and the time information corresponding to the voice information;
• and
• learning a nonverbal information generation model for generating the acquired time-information-stamped nonverbal information on the basis of the extracted time-information-stamped voice feature quantities.