Gaze-assisted verification of pilot activities

Abstract

A system and method for verification of a pilot's activities in an aircraft cockpit has been developed. The system includes a camera located in the aircraft cockpit that monitors the pilot's eye position, head position and direction of gaze in the cockpit during aircraft operations. A computer system is located onboard the aircraft has a retrievable electronic memory that stores a three-dimensional (3D) model of the aircraft cockpit. The 3D model of the aircraft cockpit includes the location of aircraft instrumentation indicators. The retrievable electronic memory also stores a database of visual taskings for the pilot. The computer system determines the completion of the visual taskings for the pilot by comparing the pilot's eye and head position and gaze direction with location of relevant aircraft instrumentation indicators and a notification system that alerts the pilot when a visual tasking is not completed.

Dependencies are inferred from the claim text.