Method and system for live video streaming with integrated encoding and transmission semantics

A system for live video streaming with integrated encoding and transmission semantics comprising:

• a memory (102) storing instructions;
• one or more communication interfaces (106);
• and
• one or more hardware processors (104) coupled to the memory (102) via the one or more communication interfaces (106), wherein the one or more hardware processors (104) are configured by the instructions to:
• encode, a set of frames associated with a live video stream of a live video streaming protocol to generate a set of data fragments by using, (i) a reference encoder, a set of full frames comprising of encoded MCU (Minimum Coded Unit) blocks corresponding to a complete jpeg frame of the live video stream, and (ii) a delta encoder, a set of delta frames which consist of encoded MCU blocks corresponding to foreground pixels of a current frame obtained from a background subtraction module;
• periodically transmit, by using a transmitter unit of the live video streaming protocol, (i) each packet from the set of full frames and each packet from the set of delta frames are transmitted in sequence with a payload specific header based on a packet mode, and providing a region of interest (ROI) information to the transmitter unit as pixel boundaries for each packet by computing a scaling factor, wherein each packet of the payload specific header is categorically inferred as at least one of a critical with confirmable communication semantics, and a non-critical with non-confirmable communication semantics;
• and
• receive, by using a receiver unit of the live video streaming protocol, each packet of the full frames and each packet of the delta frames based on the packet mode to reconstruct an original sequence of the live video stream from the foreground pixels, wherein each packet comprising the set of delta frames are decoded using a delta decoder and each packet comprising the set of full frames are decoded using a reference decoder by estimating, (i) a total number of packets expected at each frame interval from the payload specific header, and (ii) a loss incurred in each packet from the set of full frames and the set of delta frames.

One or more non-transitory machine-readable information storage mediums comprising one or more instructions which when executed by one or more hardware processors perform actions comprising:

• encoding, a set of frames associated with a live video stream of a live video streaming protocol to generate a set of data fragments by using,
• a reference encoder, a set of full frames comprising of encoded MCU (Minimum Coded Unit) blocks corresponding to a complete jpeg frame of the live video stream, and
• a delta encoder, a set of delta frames comprising of encoded MCU blocks corresponding to foreground pixels of a current frame obtained from a background subtraction module;
• periodically transmitting, by using a transmitter unit of the live video streaming protocol,
• each packet from the set of full frames and each packet from the set of delta frames are transmitted in sequence with a payload specific header based on a packet mode, and
• providing a region of interest (ROI) information to the transmitter unit as pixel boundaries for each packet by computing a scaling factor, wherein each packet of the payload specific header is categorically inferred as at least one of a critical with confirmable communication semantics, and a non-critical with non-confirmable communication semantics;
• and
• receiving, by using a receiver unit of the live video streaming protocol, each packet of the full frames and each packet of the delta frames based on the packet mode to reconstruct an original sequence of the live video stream from the foreground pixels, wherein each packet comprising the set of delta frames are decoded using a delta decoder and each packet comprising the set of full frames are decoded using a reference decoder by estimating,
• a total number of packets expected at each frame interval from the payload specific header, and
• a loss incurred in each packet from the set of full frames and the set of delta frames.