System and method for change point detection in multi-media multi-person interactions
AssigneeXerox Corporation
InventorsOctavia Maria Sulea, Leora Morgenstern, Viswanathan Babu Chidambaram Ayyappan, Jiaying Shen, Gregory Michael Youngblood
Life of this patent
Estimating the term…
Abstract
One embodiment can provide a method and a system for detecting change points within a conversation. During operation, the system can obtain a signal associated with the conversation and extract a one-dimensional (1D) feature function from the signal. The system can apply Gaussian smoothing on the 1D feature function, identify zero-crossing points on the smoothed 1D feature function, and determine a set of change points within the conversation based on the identified zero-crossing points.
Claims16
A computer-implemented method for detecting changes in human emotions during a conversation, the method comprising:
- recording the conversation using a camera or microphone;
- obtaining, by a computer, a signal associated with the recorded conversation;
- extracting a one-dimensional (1D) feature function from the signal;
- applying Gaussian smoothing on the 1D feature function;
- identifying zero-crossing points on the smoothed 1D feature function;
- and
- consolidating the identified zero-crossing points into a smaller set by applying a hierarchical clustering technique on the identified zero-crossing points;
- and
- determining, by the computer, a set of change points indicating the changes in human emotions during the conversation based on the smaller set of zero-crossing points.
A non-transitory computer-readable storage medium storing instructions that when executed by a processor cause the processor to perform a method for detecting changes in human emotions during a conversation, the method comprising:
- configuring a camera or microphone to record the conversation;
- obtaining a signal associated with the conversation;
- extracting a one-dimensional (1D) feature function from the signal;
- applying Gaussian smoothing on the 1D feature function;
- identifying zero-crossing points on the smoothed 1D feature function;
- consolidating the identified zero-crossing points into a smaller set by applying a hierarchical clustering technique on the identified zero-crossing points;
- and
- determining, by the computer, a set of change points indicating the changes in human emotions during the conversation based on the smaller set of zero-crossing points.
A computer system, comprising:
- a processor;
- and
- a storage device storing instructions that when executed by the processor cause the processor to perform a method for detecting changes in human emotions during a conversation, the method comprising:
- configuring a camera or microphone to record the conversation;
- obtaining a signal associated with the conversation;
- extracting a one-dimensional (1D) feature function from the signal;
- applying Gaussian smoothing on the 1D feature function;
- identifying zero-crossing points on the smoothed 1D feature function;
- consolidating the identified zero-crossing points into a smaller set by applying a hierarchical clustering technique on the identified zero-crossing points;
- and
- determining a set of change points indicating the changes in human emotions during the conversation based on the smaller set of zero-crossing points.
Dependencies are inferred from the claim text.