System and method for reading and analysing behaviour including verbal, body language and facial expressions in order to determine a person's congruence

Method for providing indicators of congruence or incongruence between the body language and the Speech of a person comprising the following steps:

• a) providing a video recording device adapted to record images of a subject including face and at least some parts of the body,
• b) recording a video of the Speech of that person with said video recording device, said video being divided into n video sequences comprising n sequences of images and n corresponding audio sequences,
• c) for each sequence of images, detecting at least one Visual cue Vc and attributing at least one rating among positive Vc+, neutral Vc0 or negative Vc− for each visual cue Vc,
• d) for each audio sequence, detecting at least one Audio cue Ac and attributing at least one rating among positive Act, neutral Ac0 or negative Ac− for each Audio cue Ac,
• e) for each video sequence, comparing the rating of said Audio cue Ac with the rating of said Visual cue Vc, and giving a congruence indicator which is a positive congruence indicator if both ratings are either positive (Vc+ and Ac+) or negative (Vc+ and Ac+), a negative congruence indicator if one of the ratings is positive and the other one is negative (Vc+ and Ac−, or Vc− and Ac+), and a neutral congruence indicator if one of the ratings is neutral (Vc0 or Ac0).