Segmenting and generating conversation features for a multiparty conversation
AssigneeBetterUp, Inc.
InventorsAndrew Reece, Peter Bull, Gus Cooney, Casey Fitzpatrick, Gabriella Rosen Kellerman, Ryan Sonnek
Life of this patent
Estimating the term…
Abstract
Technology is provided for generating conversation features for recorded conversations. The technology includes, receiving videos depicting a multiple-user interaction, segmenting the videos into multiple utterances based on identifying utterances from individual users, receiving label data for the utterance segments specifying conversation features, and storing the label data in association with the utterance segments.
Claims20
A method to generate conversation features for recorded conversations, the method comprising:
- receiving one or more videos depicting a multiple-user interaction, each of the one or more videos including acoustic data and visual data;
- segmenting the one or more videos into multiple utterance segments, from the multiple users,
- wherein the segmenting is based on identifying utterances from individual users;
- receiving label data for two or more of the utterance segments, the label data specifying the conversation features associated with the corresponding utterance segment,
- wherein the label data for at least a first segment corresponds to an utterance associated with a first of the multiple users and the label data for at least a second segment corresponds to an utterance associated with a second of the multiple users;
- and
- storing the label data in association with the utterance segments.
A computing system for generating conversation features for recorded conversations, the computing system comprising:
- one or more processors;
- and
- one or more memories storing computer-executable instructions that, when executed by the one or more processors, cause the computing system to perform operations comprising:
- receiving one or more videos depicting a multiple-user interaction, each of the one or more videos including acoustic data and visual data;
- automatically segmenting the one or more videos into multiple segments;
- receiving label data for two or more of the segments, the label data specifying the conversation features associated with the corresponding segment,
- wherein the label data for at least a first segment corresponds to a first of the multiple users and the label data for at least a second segment corresponds to a second of the multiple users;
- and
- storing the label data in association with the segments.
A computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform actions comprising:
- receiving one or more videos depicting a multiple-user interaction, each of the one or more videos including acoustic data and visual data;
- segmenting the one or more videos into multiple utterance segments, from the multiple users,
- wherein the segmenting is based on identifying utterances from individual users;
- automatically generating labels for two or more of the utterance segments, the labels specifying the conversation features associated with the corresponding utterance segment,
- wherein the labels for at least a first segment corresponds to an utterance associated with a first of the multiple users and the labels for at least a second segment corresponds to an utterance associated with a second of the multiple users;
- and
- storing the labels in association with the utterance segments.
Dependencies are inferred from the claim text.