Methods And Systems to Predict Activity In A Sequence Of Images

A driver monitoring system to determine activity in a sequence of successively acquired images of a scene within a vehicle, comprising:

• memory;
• and
• one or more processors configured to perform operations comprising:
• acquiring the sequence of images;
• forming, for each image in the sequence of images, a feature block of features extracted from the image;
• determining, for each image in the sequence of images, image specific information, wherein the image specific information includes a weighting indicating image importance for the image and one or more likelihoods of one or more activities;
• passing a plurality of weighted feature blocks through a predictive module to determine an activity in the sequence of images;
• comparing the determined activities with a most likely image activity in the image specific information;
• validating the determined activity based on the comparison;
• and
• controlling the vehicle according to the validated activity.

A method for determining an activity in a sequence of successively acquired images of a scene within a vehicle, comprising:

• acquiring the sequence of images;
• forming, for each image in the sequence of images, a feature block of features extracted from the image;
• determining, for each image in the sequence of images, image specific information, wherein the image specific information includes a weighting indicating image importance for the image and one or more likelihoods of one or more activities;
• passing a plurality of weighted feature blocks through a predictive module to determine an activity in the sequence of images;
• comparing the determined activities with a most likely image activity in the image specific information;
• validating the determined activity based on the comparison;
• and
• controlling the vehicle according to the validated activity.