Systems and Methods for Semantically Classifying and Normalizing Shots in Video

A method for classifying a video file according to one or more scene classes, the video file including a plurality of frames, where each frame includes a plurality of pixels, and where each pixel is associated with a vector of material classification scores describing the material content in its respective frame, comprising the steps of:

• (a) dividing each frame into a plurality of grid cells;
• (b) for each frame, retrieving the vector of material classification scores for each pixel in each grid cell;
• (c) for each grid cell, averaging the material classification scores across each pixel in the grid cell to form a material occurrence vector for the grid cell;
• (d) concatenating the material occurrence vectors for the plurality of grid cells in each frame to generate a material arrangement vector for each frame;
• (e) generating a scene classification score associated with each of the one or more scene classes for each frame in the video file via one or more scene classifiers based on the material arrangement vectors generated for each frame;
• (f) generating a representative scene classification score for the video file for each of the one or more scene classes based on the scene classification scores generated for each frame;
• and
• (g) if one of more of the representative scene classification scores is above a predetermined threshold value, labeling the video file according to the respective scene classes associated with the one or more scene classification scores that are above the predetermined threshold value.