Pupil dynamics, physiology, and performance for estimating competency in situational awareness

A method comprising:

• receiving an image stream from at least one eye tracking camera;
• receiving physiological data from one or more physiological data recording devices, including at least a heart rate;
• identifying gaze and pupil dynamics, including pupil response, over time from the image stream;
• identifying involuntary eye movements and involuntary eye lid movements;
• correlating the physiological data with the gaze and pupil dynamics;
• correlating the gaze and pupil dynamics, and the physiological data with one or more stimuli;
• determining whether the gaze and pupil dynamics, and physiological data correspond to predetermined behaviors indicative of volitional attention shifting;
• determining if a user begins shifting gaze to one or more instrument readings or alerts corresponding to the volitional attention shifting within some threshold time;
• characterizing the gaze and pupil dynamics as either cognitively initiated or stimuli triggered with reference to the gaze and pupil dynamics, physiological data, involuntary eye movements, and involuntary eye lid movements;
• and
• activating automation when the characterization indicates a user is unable to continue safe flight.

A simulator comprising:

• at least one eye tracking camera configured to capture image frames including pupil size, blink properties, eyelid position, and eye movement at a defined sampling rate;
• at least one physiological sensor comprising at least a heart-rate monitor configured to generate a time-synchronized physiological data stream;
• and
• at least one processor in data communication with a memory storing processor executable code;
• and
• wherein the processor executable code configures the at least one processor to:
• receive an image stream from the at least one eye tracking camera;
• receive physiological data from the one or more physiological data recording devices, including at least a heart rate;
• identify gaze and pupil dynamics, including pupil response, over time from the image stream;
• identify involuntary eye movements and involuntary eye lid movements;
• correlate the physiological data with the gaze and pupil dynamics;
• correlate the gaze and pupil dynamics, and the physiological data with one or more stimuli;
• determine whether the gaze and pupil dynamics, and physiological data correspond to predetermined behaviors indicative of volitional attention shifting;
• determine if a user begins shifting gaze to one or more instrument readings or alerts corresponding to the volitional attention shifting within some threshold time;
• characterize the gaze and pupil dynamics as either cognitively initiated or stimuli triggered with reference to the gaze and pupil dynamics, physiological data, involuntary eye movements, and involuntary eye lid movements;
• and
• activate automation when the characterization indicates a user is unable to continue safe flight.