Multi-view learning in detection of psychological states
AssigneeRaytheon BBN Technologies Corp.
InventorsXiaodan Zhuang, Viktor Rozgic, Michael Roger Crystal
Life of this patent
Estimating the term…
Abstract
Systems and methods for using multi-view learning to leverage highly informative, high-cost, psychophysiological data collected in a laboratory setting, to improve post-traumatic stress disorder (PTSD) screening in the field, where only less-informative, low-cost, speech data are available. Partial least squares (PLS) methods can be used to learn a bilinear factor model, which projects speech and EEG responses onto latent spaces, where the covariance between the projections is maximized. The systems and methods use a speech representation based on a combination of audio and language descriptors extracted from spoken responses to open-ended questions.
Claims20
A system for detecting psychological states, the system comprising:
- a device to obtain sensor data corresponding to a subject's response to stimuli;
- a feature extraction processor to extract one or more features from the sensor data to generate feature representation data, the feature representation data being associated with a first view;
- a memory device configured to store a projection matrix modeling a relationship between the first view and a second view, and to store a detection model trained using training data associated with the first view transformed to a latent space using the projection matrix;
- and
- a detection module to transform the feature representation data to the latent space using the projection matrix, and to apply the transformed feature representation data to the detection model to detect one or more psychological states of the subject.
A method for detecting psychological states, the method comprising:
- obtaining sensor data associated with a first view, the sensor data corresponding to a subject's response to stimuli;
- performing feature extraction to generate feature representation data;
- transforming the feature representation data to a latent space using a projection matrix;
- and
- applying a detection model to the transformed feature representation data to detect one or more psychological states of the subject.
A system for detecting psychological states, the system comprising:
- a means for obtaining sensor data corresponding to a subject's response to stimuli;
- at least one feature extraction means for extracting one or more features from the sensor data to generate feature representation data, the feature representation data being associated with a first view;
- a memory means for storing a projection matrix modeling a relationship between the first view and a second view, and for storing a detection model trained using training data associated with the first view transformed to a latent space using the projection matrix;
- and
- a detection means for transforming the feature representation data to the latent space using the projection matrix, and for applying the transformed feature representation data to the detection model to detect one or more psychological states of the subject.
Dependencies are inferred from the claim text.