Method and system to combine multiple encoded videos into an output data stream of encoded output frames

A non-transitory computer readable medium having stored therein instructions, that when executed by a processor, cause the processor to perform operations, the operations comprising:

• receiving a first data stream that represent a first video, wherein the first data stream includes a first sequence of frames that includes first intra-coded frames;
• receiving a second data stream that represent a second video, wherein the second data stream includes a second sequence of frames that includes second intra-coded frames, wherein the first video has a first frame rate that is higher than a second frame rate of the second video;
• after second intra-coded frames of the second data stream, inserting a particular number of frames into the second data stream, wherein the particular number of frames is proportional to a difference between the first frame rate and the second frame rate;
• combining the received first data stream and the received second data stream to obtain an output data stream of encoded output frames such that an encoded output frame includes a respective frame of the first sequence and a respective frame of the second sequence and that first intra-coded frames are combined with respective second intra-coded frames in respective encoded output frames within the output stream;
• and
• sending the output data stream to a decoder for decoding the output data stream into the first video and the second video.

A device comprising:

• one or more processors;
• and
• data storage configured to store instructions, that when executed by the one or more processors, cause the device to:
• receive a first data stream that includes a sequence of first encoded frames, wherein each first encoded frame is divided into a respective first coding unit array;
• receive a second data stream that includes a sequence of second encoded frames, wherein each second encoded frame is divided into a respective second coding unit array, wherein the first data stream represents a first video having a first frame rate, and wherein the second data stream represents a second video having a second frame rate that is lower than the first frame rate;
• after second intra-coded frames of the second data stream, insert a particular number of frames into the second data stream, wherein the particular number of frames is proportional to a difference between the first frame rate and the second frame rate;
• combine the received first data stream and the received second data stream into an output data stream of encoded output frames such that an encoded output frame includes a first coding unit array and a second coding unit array, wherein intra-coded coding unit arrays of the first sequence are combined with respective intra-coded coding unit arrays of the second sequence;
• and
• send the output data stream to a decoder for decoding the output data stream into the first video and the second video.