Hybrid pixel-domain and compressed-domain video analytics framework

At least one non-transitory machine accessible storage medium having instructions stored thereon, wherein the instructions, when executed on a machine, cause the machine to:

• receive, via a communication interface, a compressed video stream captured by a camera, wherein the compressed video stream comprises a plurality of compressed video frames, wherein the plurality of compressed video frames comprises:
• a first compressed frame;
• and
• a second compressed frame, wherein the second compressed frame is compressed based at least in part on the first compressed frame, and wherein the second compressed frame comprises a plurality of motion vectors;
• decompress the first compressed frame into a first decompressed frame;
• perform pixel-domain object detection to detect an object at a first position in the first decompressed frame;
• and
• perform compressed-domain object detection to detect the object at a second position in the second compressed frame, wherein the object is detected at the second position in the second compressed frame based on:
• the first position of the object in the first decompressed frame;
• and
• the plurality of motion vectors from the second compressed frame.

A method, comprising:

• receiving, via a communication interface, a compressed video stream captured by a camera, wherein the compressed video stream comprises a plurality of compressed video frames, wherein the plurality of compressed video frames comprises:
• a first compressed frame;
• and
• a second compressed frame, wherein the second compressed frame is compressed based at least in part on the first compressed frame, and wherein the second compressed frame comprises a plurality of motion vectors;
• decompressing the first compressed frame into a first decompressed frame;
• performing pixel-domain object detection to detect an object at a first position in the first decompressed frame;
• and
• performing compressed-domain object detection to detect the object at a second position in the second compressed frame, wherein the object is detected at the second position in the second compressed frame based on:
• the first position of the object in the first decompressed frame;
• and
• the plurality of motion vectors from the second compressed frame.

A system, comprising:

• a camera;
• and
• an edge processing device, comprising:
• a communication interface;
• and
• processing circuitry to:
• receive, via the communication interface, a compressed video stream captured by the camera, wherein the compressed video stream comprises a plurality of compressed video frames, wherein the plurality of compressed video frames comprises:
• a first compressed frame;
• and
• a second compressed frame, wherein the second compressed frame is compressed based at least in part on the first compressed frame, and wherein the second compressed frame comprises a plurality of motion vectors;
• decompress the first compressed frame into a first decompressed frame;
• perform pixel-domain object detection to detect an object at a first position in the first decompressed frame;
• and
• perform compressed-domain object detection to detect the object at a second position in the second compressed frame, wherein the object is detected at the second position in the second compressed frame based on:
• the first position of the object in the first decompressed frame;
• and
• the plurality of motion vectors from the second compressed frame.