System and method for providing real-time feedback of remote collaborative communication

A method for providing real-time feedback of remote collaborative communication, comprising the steps of:

• processing first audio signals to extract a plurality of first speech-related features therefrom, the first audio signals being supplied in response to speech supplied from a first user;
• processing first electroencephalogram (EEG) signals to extract a plurality of first brain activity features therefrom, the first EEG signals being supplied in response to brain activity of the first user;
• processing second audio signals to extract a plurality of second speech-related features therefrom, the second audio signals being supplied in response to speech supplied from a second user;
• processing second EEG signals to extract a plurality of second brain activity features therefrom, the second EEG signals being supplied in response to brain activity of the second user;
• processing the first and second speech-related features to determine if the speech from the first and second users exhibits positive or negative vocal entrainment;
• processing the first and second brain activity features to determine if the brain activity of the first and second users is aligned or misaligned;
• and
• generating feedback, on at least one display device, that indicates (i) if the speech from the first and second users exhibits positive or negative vocal entrainment and (ii) if the brain activity of the first and second users is aligned or misaligned.

A system for providing real-time feedback of remote collaborative communication between a first user and a second user, the system comprising

• a first microphone configured to receive speech supplied from the first user and, in response thereto, supply first audio signals;
• and
• a plurality of first electroencephalogram (EEG) sensors disposed on the first user and configured to supply first EEG signals in response to brain activity of the first user;
• a second microphone configured to receive speech supplied from the second user and, in response thereto, supply second audio signals;
• a plurality of second EEG sensors disposed on the second user and configured to supply second EEG signals in response to brain activity of the second user;
• a processing system coupled to receive the first and second audio signals and the first and second EEG signals, the processing system configured to:
• extract a plurality of first speech-related features from first audio signals;
• extract a plurality of first brain activity features from the first EEG signals;
• extract a plurality of second speech-related features from the second audio signals;
• extract a plurality of second brain activity features from the second EEG signals;
• process the first and second speech-related features to determine if the speech from the first and second users exhibits positive or negative vocal entrainment;
• process the first and second brain activity features to determine if the brain activity of the first and second users is aligned or misaligned;
• and
• generate display commands that cause at least one display device to render feedback images that indicate (i) if the speech from the first and second users exhibits positive or negative vocal entrainment and (ii) if the brain activity of the first and second users is aligned or misaligned.