Compressed domain motion detection

One or more non-transitory computer-readable storage devices storing data instructions that, when executed by at least one processing device of a system, cause the system to:

• receive compressed video data;
• extract macroblocks and motion vectors for a plurality of frames in the compressed video data;
• identify frame-level features for each of the plurality of frames based on the macroblocks and the motion vectors;
• calculate similarity features for each of the identified frame-level features based on the frame-level features identified in consecutive frames;
• predict motion for each of the plurality of frames by providing the frame-level features and the similarity features into a model trained to detect motion;
• and
• predict event boundaries in the compressed video data by providing the frame-level features into a second model trained to identify event boundaries.

A smart camera device, the smart camera device comprising:

• a processor;
• and
• a memory storage device, the memory storage device storing instructions that, when executed by the processor, cause the smart camera device to:
• receive compressed video data;
• extract macroblocks and motion vectors for a plurality of frames in the compressed video data;
• identify frame-level features for each of the plurality of frames based on the macroblocks and the motion vectors;
• calculate similarity features for each of the identified frame-level features based on the frame-level features identified in consecutive frames;
• predict motion for each of the plurality of frames by providing the frame-level features and the similarity features into a model trained to detect motion;
• and
• predict event boundaries in the compressed video data by providing the frame-level features into a second model trained to identify event boundaries.