Mental state mood analysis using heart rate collection based on video imagery

A computer program product embodied in a non-transitory computer readable medium for mental state analysis, the computer program product comprising code which causes one or more processors to perform operations of:

• obtaining video of an individual;
• analyzing the video to determine heart rate information, wherein the analyzing includes:
• identifying a face of the individual in a portion of the video;
• separating pixels from the video of the individual, into at least a green pixel temporal intensity trace;
• training a statistical classifier, wherein the training is learned from a data set consisting of human blood volume pulse synchronized face videos;
• and
• recognizing a pulse, from the video of the individual, using the statistical classifier, by learning patterns of variability in the mean of the pixel temporal intensity trace;
• correlating the heart rate information to a stimulus that the individual is encountering;
• and
• inferring mental states of the individual based on the heart rate information.

A computer system for mental state analysis comprising:

• a memory which stores instructions;
• one or more processors attached to the memory wherein the one or more processors, when executing the instructions which are stored, are configured to:
• obtain video of an individual;
• analyze the video to determine heart rate information, wherein analyzing includes:
• identifying a face of the individual in a portion of the video;
• separating pixels from the video of the individual into at least a green pixel temporal intensity trace;
• training a statistical classifier, wherein the training is learned from a data set consisting of human blood volume pulse synchronized face videos;
• and
• recognizing a pulse, from the video of the individual, using the statistical classifier, by learning patterns of variability in the mean of the pixel temporal intensity trace;
• correlate the heart rate information to a stimulus that the individual is encountering;
• and
• infer mental states of the individual based on the heart rate information.