Scene classification

A vehicle equipped with a system for scene classification, comprising:

• an image capture device capturing a first series of image frames of an environment from a moving vehicle;
• an image segmentation module identifying one or more traffic participants within the environment based on a first convolutional neural network (CNN);
• an image masker generating a second series of image frames by masking one or more of the traffic participants from the environment;
• a temporal classifier classifying one or more image frames of the second series of image frames with one of two or more temporal predictions and generating a third series of image frames associated with respective temporal predictions based on a scene classification model, wherein the classification is based on a second CNN, a long short-term memory (LSTM) network, and a first fully connected layer;
• and
• a scene classifier classifying one or more image frames of the third series of image frames based on a third CNN, global average pooling, and a second fully connected layer and generating an associated scene prediction based on the scene classification model and respective temporal predictions;
• and
• a controller activating or deactivating one or more sensors or one or more vehicle systems of the vehicle based on the scene prediction.

A system for scene classification, comprising:

• an image capture device capturing a first series of image frames of an environment from a moving vehicle;
• a temporal classifier classifying one or more image frames of the first series of image frames with one of two or more temporal predictions and generating a second series of image frames associated with respective temporal predictions based on a scene classification model, wherein the classification is based on a convolutional neural network (CNN), a long short-term memory (LSTM) network, and a first fully connected layer;
• and
• a scene classifier classifying one or more image frames of the second series of image frames based on a second CNN, global average pooling, and a second fully connected layer and generating an associated scene prediction based on the scene classification model and respective temporal predictions.