System and method for detecting invisible human emotion
AssigneeNuralogix Corporation
InventorsKang Lee, Pu Zheng
Life of this patent
Estimating the term…
Abstract
A system and method for emotion detection and more specifically to an image-capture based system and method for detecting invisible and genuine emotions felt by an individual. The system provides a remote and non-invasive approach by which to detect invisible emotion with a high confidence. The system enables monitoring of hemoglobin concentration changes by optical imaging and related detection systems.
Claims20
A computer-implemented digital image processing system for training an image processing unit to determine a human emotion being experienced by a human subject, the system comprising:
- a computer-readable memory comprising a plurality of sequences of RGB images obtained during a time span for a plurality of human subjects, each of the sequences of RGB images being labelled with one of the plurality of known identifiable human emotions being experienced by the respective human subject, each RGB image comprising a red channel, a green channel and a blue channel, each of the red channel, green channel and blue channel each having a bit length of more than one bit;
- and
- an image processing unit comprising one or more processors in communication with the computer-readable memory, the image processing unit executable to:
- generate a set of bitplane images from each of the plurality of sequences of RGB images, each bitplane image being an image formed by isolating a particular bit position within a red, green or blue channel of the corresponding RGB image;
- determine a set of high SNR bitplanes, the high SNR bitplanes being a subset of the bitplane images from each of the plurality of sequences of RGB images that optimize hemoglobin concentration differentiation between the identifiable human emotions, by removing effects of at least one of cardiac, respiratory, and blood pressure data from the captured images;
- and
- train a machine learning model utilizable by the image processing unit to determine the human emotion experienced by the human subject by analyzing spatial changes in the hemoglobin concentration obtainable in the set of high SNR bitplanes during the captured image sequences and associating each of the identifiable human emotions with the spatial changes.
A computer-implemented method for training an image processing unit to determine a human emotion being experienced by a human subject, the method using a plurality of sequences of RGB images obtained during a time span for a plurality of human subjects, each of the sequences of RGB images being labelled with one of the plurality of known identifiable human emotions being experienced by the respective human subject, each RGB image comprising a red channel, a green channel and a blue channel, each of the red channel, green channel and blue channel each having a bit length of more than one bit, the method comprising:
- generating a set of bitplane images from each of the plurality of sequences of RGB images, each bitplane image being an image formed by isolating a particular bit position within a red, green or blue channel of the corresponding RGB image;
- determining a set of high SNR bitplanes, the high SNR bitplanes being a subset of the bitplane images from each of the plurality of sequences of RGB images that optimize hemoglobin concentration differentiation between the identifiable human emotions, by removing effects of at least one of cardiac, respiratory, and blood pressure data from the captured images;
- and
- training a machine learning model utilizable by the image processing unit to determine the human emotion experienced by the human subject by analyzing spatial changes in the hemoglobin concentration obtainable in the set of high SNR bitplanes during the captured image sequences and associating each of the identifiable human emotions with the spatial changes.
Dependencies are inferred from the claim text.