US 10,095,918 B2Granted

System and method for interpreting interpersonal communication

AssigneeInternational Business Machines Corporation

InventorsDario Gil, Joseph N. Kozhaya, David O. Melville, Valentina Salapura

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method for interpreting interpersonal communication includes monitoring a first interaction between two or more individuals using a set of monitoring devices including a camera, a microphone, and the like. A culture and personality type of at least one individual is identified based on the monitored first interaction. First cultural/personality profile information specific to the identified culture and personality type is retrieved from a database of cultural/personality profile information. A second interaction between the two or more individuals is monitored using the set of monitoring devices. A first facial expression, gesture, vocal intonation, or indication of emotional state derived from biometric data of the at least one individual is identified based on the monitored second interaction. The identified first expression is interpreted using the first cultural/personality profile information. The interpretation of the identified first expression is communicated to a user.

Claims8

Dependent claims

A system for interpreting interpersonal communication, comprising:

a processor;
a set of monitoring devices including a camera, a video camera, or a microphone;
and
a non-transitory, tangible program storage medium, readable by the system for interpreting interpersonal communication, embodying a program of instructions executable by the processor, to perform method steps for interpreting interpersonal communication, the method comprising:
monitoring a first interaction between two or more individuals using the set of monitoring devices including the camera, the video camera, or the microphone;
identifying a culture and personality type of at least one of the two or more individuals based on the monitored first interaction;
retrieving first cultural/personality profile information specific to the identified culture and personality type from a database of cultural/personality profile information;
monitoring a second interaction between the two or more individuals using the set of monitoring devices including the camera, the video camera, or the microphone;
identifying a first facial expression, gesture, vocal intonation, or indication of emotional state derived from biometric data of the at least one of the two or more individuals based on the monitored second interaction;
interpreting the identified first facial expression, gesture, vocal intonation, or indication of emotional state derived from biometric data using the first cultural/personality profile information;
and
communicating the interpretation of the identified first facial expression, gesture, vocal intonation, or indication of emotional state derived from biometric data to a user;
wherein the user and the at least one of the two or more individuals are the same person.

10 more elements

A system for video conferencing, comprising:

a processor;
two or more terminals, each of the two or more terminals including a set of monitoring devices including a camera, a video camera, or a microphone;
and
a non-transitory, tangible program storage medium, readable by the system for interpreting interpersonal communication, embodying a program of instructions executable by the processor, to perform method steps for interpreting interpersonal communication, the method comprising:
monitoring a first interaction between two or more individuals, wherein a first individual of the two or more individuals is located at a first terminal of the two or more terminals, wherein a second individual of the two or more individuals is located at a second terminal of the two or more terminals, and wherein monitoring the first interaction between the two or more individuals includes using the set of monitoring devices including the camera, the video camera, or the microphone included in each of the first and second terminals to monitor the first and second individuals, identifying a culture and personality type of at least one of the first and second individuals based on the monitored first interaction;
retrieving first cultural/personality profile information specific to the identified culture and personality type from a database of cultural/personality profile information;
monitoring a second interaction between the first and second individuals located at the first and second terminals using the set of monitoring devices including the including the camera, the video camera, or the microphone included in each of the first and second terminals;
identifying a first facial expression, gesture, vocal intonation, or indication of emotional state derived from biometric data of the at least one of the first and second individuals based on the monitored second interaction;
interpreting the identified first facial expression, gesture, vocal intonation, or indication of emotional state derived from biometric data using the first cultural/personality profile information;
and
communicating the interpretation of the identified first facial expression, gesture, vocal intonation, or indication of emotional state derived from biometric data to a user;
wherein the user and the at least one of the two or more individuals are the same person.

9 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/654,909Filed 20 Jul 2017 · continuation
Priority: 30 Jun 2015
Published: US 2017/0004356 A19 Nov 2017
Granted: 9 Oct 2018
Term ends: Not estimatedThe source records don’t support an estimate.

Classification12 codes

G10L 25/51
Specially adapted for particular use: for comparison or discrimination
G06V 40/174
Human faces, e.g. facial parts, sketches or expressions: facial expression recognition
G06V 40/176
Facial expression recognition: dynamic expression
G06V 40/28
Movements or behaviour, e.g. gesture recognition: recognition of hand or arm movements, e.g. recognition of deaf sign language

Family

Application14/755,752Parent of this continuation · filed 30 Jun 2015
US 2017/0323153 A1Pre-grant publication · published 9 Nov 2017
US 9,760,766 B2Parent of this continuation
US 2017/0004356 A1Published application
US 10,095,918 B2This patent

From the US filing history. Foreign family members aren’t listed.