System and method for real-time feedback of remote collaborative communication
AssigneeHoneywell International Inc.
InventorsNichola Lubold, Tor Finseth
Life of this patent
Estimating the term…
Abstract
A system and method for providing real-time feedback of remote collaborative communication between users includes extracting speech-related features and physiological features from at least one of the users and using these features to determine a stress state of at least one user. In response to the determined stress state audio signals may be processed to manipulate one or more vocal features of the speech supplied from another user, and/or at least one device may supply feedback to another user that provides suggestions as to how to manipulate or more of their vocal features.
Claims20
A system for providing real-time feedback of remote collaborative communication between a first user and a second user, the system comprising a processing system that is configured to:
- extract a plurality of first speech-related features from first audio signals generated in response to speech supplied from the first user;
- extract a plurality of first physiological features from the first audio signals, first physiological data generated in response to physiological activity of the first user, or both;
- extract a plurality of second speech-related features from second audio signals generated response to speech supplied from the second user;
- extract a plurality of second physiological features from the second audio signals, second physiological data generated in response to physiological activity of the second user, or both;
- process the first and second speech-related features to determine if the speech from the first and second users exhibits positive or negative vocal entrainment;
- process the first and second physiological features to determine if physiological states of the first and second users are aligned or misaligned;
- and
- generate commands that cause at least one device to supply feedback that indicates (i) if the speech from the first and second users exhibits positive or negative vocal entrainment and (ii) if the physiological activity of the first and second users is aligned or misaligned.
A method for providing real-time feedback of remote collaborative communication, comprising the steps of:
- processing first audio signals to extract a plurality of first speech-related features therefrom, the first audio signals being supplied in response to speech supplied from a first user;
- processing the first audio signals, first physiological data, or both, to extract a plurality of first physiological activity features therefrom, the first physiological data being supplied in response to physiological activity of the first user;
- processing second audio signals to extract a plurality of second speech-related features therefrom, the second audio signals being supplied in response to speech supplied from a second user;
- processing the second audio signals, second physiological activity data, or both, to extract a plurality of second physiological features therefrom, the second physiological activity data being supplied in response to physiological activity of the second user;
- processing the first and second speech-related features to determine if the speech from the first and second users exhibits positive or negative vocal entrainment;
- processing the first and second physiological features to determine if physiological states of the first and second users are aligned or misaligned;
- and
- generating feedback, via at least one human-machine interface, that indicates (i) if the speech from the first and second users exhibits positive or negative vocal entrainment and (ii) if the physiological states of the first and second users are aligned or misaligned.
A system for providing real-time feedback of remote collaborative communication between a first user and a second user, the system comprising a processing system that is configured to:
- extract a plurality of first speech-related features from first audio signals generated in response to speech supplied from the first user;
- extract a plurality of physiological features from the audio signals, first physiological data generated in response to physiological activity of the first user, or both;
- process the first speech-related features and the first physiological activity features to determine a stress state of the first user;
- and
- in response to the determined stress state of the first user:
- (i) automatically process second audio signals generated in response to speech supplied from the second user to manipulate one or more vocal features of the speech supplied from the second user;
- and/or
- (ii) generate commands that cause at least one device to supply feedback to the second user that provide suggestions to the second user as to how to manipulate or more of their vocal features.
Dependencies are inferred from the claim text.