Dynamic track switching in media streaming

A computing device configured to provide dynamic track switching in media streaming, comprising:

• a processor;
• a media engine comprising:
• a switching module;
• a first audio rendering pipeline comprising a first audio decoder and a first audio renderer;
• a first video rendering pipeline comprising a first video decoder and a first video renderer;
• a memory unit storing computer-executable instructions that when executed by the processor causes the switching module to:
• configure a first switch to receive first and second selection inputs, wherein the first selection input comprises encoded data for a first media track and the second selection input comprises encoded data for a second media track, wherein a first selection output of the first switch is associated with the first audio rendering pipeline;
• configure a second switch to receive third and fourth selection inputs, wherein the third selection input comprises encoded data for a third media track and the fourth selection input comprises encoded data for a fourth media track, wherein a second selection output of the second switch is associated with the first video rendering pipeline;
• activate the first switch to route the first selection input to the first audio rendering pipeline upon identifying the first selection input as the first selection output;
• and
• activate the second switch to route the third selection input to the first video rendering pipeline upon identifying the third selection input as the second selection output.

The computing device of claim 1, wherein the memory unit further stores computer-executable instructions that when executed by the processor cause the switching module to:

• configure the second switch to receive a fifth selection input, wherein the fifth selection input comprises encoded data for a fifth media track;
• and
• activate the second switch to route the fifth selection input to the first video rendering pipeline upon identifying the fifth selection input as the first selection output;
• identify a random access point in the fifth selection input;
• and
• transmit a switching event signal indicating the start of a switching operation as well as a potential time latency.

A method for managing dynamic track switching in media streaming on a computing device, comprising

• receiving, at a first source buffer on the computing device, a first encoded media stream comprising a first encoded audio track A1, a first encoded video track V1, and first metadata M1;
• receiving, at a second source buffer on the computing device, a second encoded media stream comprising a second encoded audio track A2, a second encoded video track V2, and second metadata M2;
• dynamically configuring, using first metadata elements of the first metadata M1 and second metadata elements of the second metadata M2, a first media track switch on the computing device to receive as selection inputs the first encoded audio track A1 and the second encoded audio track A2, and to provide a first media track switch output to a first audio rendering pipeline;
• and
• dynamically configuring, using first metadata elements of the first metadata M1 and second metadata elements of the second metadata M2, a second media track switch on the computing device to receive as selection inputs the first encoded video track V1 and the second encoded video track V2, and to provide a second media track switch output to a first video rendering pipeline.

The method of claim 13 further comprising:

• decoding and rendering the second encoded audio track A2 to produce a second audio track A2;
• decoding and rendering the first encoded video track V1 to produce a first video track V1;
• and
• synchronizing playback of the second audio track A2 and the first video track V1.

The method of claim 13 further comprising:

• receiving, at a third source buffer on the computing device, a third encoded media stream comprising a third encoded audio track A1 and a third encoded video track V1;
• dynamically reconfiguring the first media track switch on the computing device to receive the third encoded audio track A3 as an additional selection input;
• dynamically reconfiguring the second media track switch on the computing device to receive the third encoded video track V3 as an additional selection input;
• updating a display on a user interface of the computing device to reflect the reconfiguring of the first and second media track switches;
• and
• updating a media stream map that correlates the media tracks received at the first and second media track switches to information displayed on the user interface.

The method of claim 13 further comprising:

• detecting inactivity of, or loss of data from, the second source buffer;
• removing the second source buffer based on the detected inactivity or loss of data;
• dynamically reconfiguring the first media track switch on the computing device to remove the second encoded audio track A2 as a selection input;
• dynamically reconfiguring the second media track switch on the computing device to remove the second encoded video track V2 as a selection input.

The method of claim 13 further comprising:

• receiving, at a third source buffer on the computing device, a third encoded media stream comprising a third encoded audio track A3 and a third encoded video track V3;
• receiving, at a fourth source buffer on the computing device, a fourth encoded media stream comprising a fourth encoded audio track A4;
• dynamically configuring a third media track switch on the computing device to receive as selection inputs the third encoded audio track A3 and the fourth encoded audio track A4, and to provide a third media track switch output to a third audio rendering pipeline;
• dynamically reconfiguring the second media track switch on the computing device to receive the third encoded video track V3 as an additional selection input.

A computer system comprising:

• a first source buffer storing encoded data for a first set of encoded media tracks;
• a second source buffer storing encoded data for a second set of encoded media tracks;
• a third source buffer storing encoded data for a third set of encoded media tracks;
• a first audio rendering pipeline comprising a first audio decoder and a first audio renderer;
• a second audio rendering pipeline comprising a second audio decoder and a second audio renderer;
• a third audio rendering pipeline comprising a third audio decoder and a third audio renderer;
• a video rendering pipeline comprising a video decoder and a video renderer;
• and
• a switching module comprising:
• a first switch comprising one or more first switch selection inputs and a first switch selection output coupled to the first audio rendering pipeline, each first switch selection input corresponding to encoded media track data from one of the first, second, and third source buffers;
• a second switch comprising one or more second switch selection inputs and a second switch selection output coupled to the second audio rendering pipeline, each second switch selection input corresponding to encoded media track data from one of the first, second, and third source buffers;
• a third switch comprising one or more third switch selection inputs and a third switch selection output coupled to the third audio rendering pipeline, each third switch selection input corresponding to encoded media track data from one of the first, second, and third source buffers;
• a fourth switch comprising one or more fourth switch selection inputs and a fourth switch selection output coupled to the video rendering pipeline, each fourth switch selection input corresponding to encoded media track data from one of the first, second, and third source buffers;
• wherein the switching module is configured to route one of the first switch selection inputs to the first audio rendering pipeline via the first switch selection output, one of the second switch selection inputs to the second audio rendering pipeline via the second switch selection output, one of the third switch selection inputs to the third audio rendering pipeline via the third switch selection output, and one of the fourth switch selection inputs to the video rendering pipeline via the fourth switch selection output.