Neural network image processing apparatus

A neural network image processing apparatus arranged to acquire one or more images from an image sensor, the apparatus being configured to:

• identify at least one region of interest containing a face region in at least one of said one or more images;
• determine at plurality of facial landmarks in a face region within a region of interest;
• use said plurality of said facial landmarks to transform said face region within said region of interest into a face region having a given pose;
• use transformed landmarks within said transformed face region to identify a pair of eye regions within said transformed face region;
• feed each identified eye region of said pair of eye regions to a respective first and second convolutional neural network, each network configured to produce a respective feature vector comprising a plurality of numerical values;
• feed each feature vector to respective eyelid opening level neural networks to obtain respective measures of eyelid opening for each eye region;
• combine the feature vectors;
• and
• feed the concatenated vector to a gaze angle neural network to generate gaze yaw and pitch values substantially simultaneously with the eyelid opening values, wherein said first and second eyelid opening and gaze angle neural networks are jointly trained based on a common training set.