Chunk based modular video processing

A non-transitory computer readable storage medium including instructions that when executed by a processing device, causes the processing device to perform operations comprising:

• receiving, by a recording service, a stream of images from a video streaming source;
• encoding, by the recording service, the stream of images, resulting in encoded images with corresponding metadata;
• generating, by the recording service, a plurality of chunks, each one of the plurality of chunks comprising a group of the encoded images and the metadata corresponding to the encoded images;
• storing, by the recording service, the plurality of chunks to data storage;
• transmitting, by the recording service, a plurality of messages to a message server, wherein each one of the plurality of messages corresponds to one of the plurality of chunks;
• and
• generating an encoded video including encoding the plurality of chunks in parallel, based on the plurality of messages.

A data processing system comprising:

• a processor;
• and
• a memory storing instructions that, when executed by the processor, configure the data processing system to perform operations comprising:
• receiving, by a recording service, a stream of images from a video streaming source;
• encoding, by the recording service, the stream of images, resulting in encoded images with corresponding metadata;
• generating, by the recording service, a plurality of chunks, each one of the plurality of chunks comprising a group of the encoded images and the metadata corresponding to the encoded images;
• storing, by the recording service, the plurality of chunks to data storage;
• transmitting, by the recording service, a plurality of messages to a message server, wherein each one of the plurality of messages corresponds to one of the plurality of chunks;
• and
• generating an encoded video, based on the plurality of messages and combining the plurality of chunks.