US 2022/0021929 A1Published application

Adaptive streaming with demuxed audio and video tracks

AssigneesAT&T Intellectual Property I, L.P., University of Connecticut

InventorsSubhabrata Sen, Yanyuan Qin, Bing Wang

Life of this patent

Estimating the term…

Abstract

Aspects of the subject disclosure may include, for example, accessing adaptive streaming information for a multimedia content segment, determining available access bandwidths for a plurality of video tracks and a plurality of audio tracks identified by the adaptive streaming information, selecting one of a plurality of candidate track pairings identified by the adaptive streaming information based on the available access bandwidths, obtaining video content of the multimedia content segment via a video track of the selected track pairing, and obtaining audio content of the multimedia content segment via an audio track of the selected track pairing. Other embodiments are disclosed.

Claims20

Dependent claims

A device, comprising:

a processing system for an adaptive streaming client, the processing system including a processor;
and
a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:
accessing adaptive streaming information for a multimedia content segment, wherein the adaptive streaming information identifies:
a plurality of video tracks conveying video content of the multimedia content segment;
a plurality of audio tracks conveying audio content of the multimedia content segment;
and
a plurality of track pairings, each comprising a respective video track among the plurality of video tracks and a respective audio track among the plurality of audio tracks;
performing a joint audio/video adaptation assessment of the plurality of track pairings to select one of the plurality of track pairings, resulting in a selected track pairing, wherein the joint audio/video adaptation assessment comprises assessing the plurality of track pairings based on:
bandwidth requirements for the plurality of video tracks;
available access bandwidths for a first network path associated with the plurality of video tracks;
bandwidth requirements for the plurality of audio tracks;
and
available access bandwidths for a second network path associated with the plurality of audio tracks;
synchronizing a first duration of the video content of the multimedia content segment with a second duration of the audio content of the multimedia content segment;
obtaining the video content of the multimedia content segment via a video track of the selected track pairing, wherein the video track is accessed via the first network path associated with the plurality of video tracks;
and
obtaining the audio content of the multimedia content segment via an audio track of the selected track pairing, wherein the audio track is accessed via the second network path associated with the plurality of audio tracks, wherein the first network path and the second network path are not the same, and wherein the synchronizing of the first duration of the audio content and the second duration of the video content prevents an underflow of an audio content buffer, a video content buffer, or any combination thereof.

15 more elements

A non-transitory machine-readable medium, comprising executable instructions that, when executed by a processing system for an adaptive streaming client, the processing system including a processor, facilitate performance of operations, the operations comprising:

requesting a manifest file from an adaptive streaming server;
receiving the manifest file responsive to the requesting the manifest file, wherein the manifest file comprises adaptive streaming information for a multimedia content segment, wherein the adaptive streaming information identifies:
a plurality of video tracks conveying video content of the multimedia content segment;
a plurality of audio tracks conveying audio content of the multimedia content segment;
and
a plurality of track pairings, each comprising a respective video track among the plurality of video tracks and a respective audio track among the plurality of audio tracks;
performing a joint audio/video adaptation assessment of the plurality of track pairings to select one of the plurality of track pairings, resulting in a selected track pairing, wherein the joint audio/video adaptation assessment comprises assessing the plurality of track pairings based on:
bandwidth requirements for the plurality of video tracks;
available access bandwidths for a first network path associated with the plurality of video tracks;
bandwidth requirements for the plurality of audio tracks;
and
available access bandwidths for a second network path associated with the plurality of audio tracks;
synchronizing a first duration of the video content of the multimedia content segment with a second duration of the audio content of the multimedia content segment;
obtaining the video content of the multimedia content segment via a video track of the selected track pairing, wherein the video track is accessed via the first network path associated with the plurality of video tracks;
and
obtaining the audio content of the multimedia content segment via an audio track of the selected track pairing, wherein the audio track is accessed via a second network path associated with the plurality of audio tracks, and wherein the first network path and the second network path are not the same, and wherein the synchronizing of the first duration of the audio content and the second duration of the video content prevents an underflow of an audio content buffer, a video content buffer, or any combination thereof.

13 more elements

A method, comprising:

requesting, by a processing system for an adaptive streaming client, the processing system including a processor, a manifest file from an adaptive streaming server, wherein the manifest file is formatted in accordance with an adaptive bitrate streaming protocol;
receiving, by the processing system, the manifest file responsive to the requesting the manifest file, wherein the manifest file comprises adaptive streaming information for a multimedia content segment, wherein the adaptive streaming information identifies:
a plurality of video tracks conveying video content of the multimedia content segment;
a plurality of audio tracks conveying audio content of the multimedia content segment;
and
a plurality of track pairings, each comprising a respective video track among the plurality of video tracks and a respective audio track among the plurality of audio tracks;
performing, by the processing system, a joint audio/video adaptation assessment of the plurality of track pairings to select one of the plurality of track pairings, resulting in a selected track pairing, wherein the joint audio/video adaptation assessment comprises assessing the plurality of track pairings based on:
bandwidth requirements for the plurality of video tracks;
available access bandwidths for a first network path associated with the plurality of video tracks;
bandwidth requirements for the plurality of audio tracks;
and
available access bandwidths for a second network path associated with the plurality of audio tracks;
synchronizing, by the processing system, a first duration of the video content of the multimedia content segment with a second duration of the audio content of the multimedia content segment;
obtaining, by the processing system, the video content of the multimedia content segment via a video track of the selected track pairing, wherein the video track is accessed via the first network path associated with the plurality of video tracks;
and
obtaining, by the processing system, the audio content of the multimedia content segment via an audio track of the selected track pairing, wherein the audio track is accessed via the second network path associated with the plurality of audio tracks, and wherein the first network path and the second network path are not the same, and wherein the synchronizing of the first duration of the audio content and the second duration of the video content prevents an underflow of an audio content buffer, a video content buffer, or any combination thereof.

13 more elements

Dependencies are inferred from the claim text.

patentgrep

Loading patent…

Abstract

A device, comprising:

a processing system for an adaptive streaming client, the processing system including a processor;
and
a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:
accessing adaptive streaming information for a multimedia content segment, wherein the adaptive streaming information identifies:
a plurality of video tracks conveying video content of the multimedia content segment;
a plurality of audio tracks conveying audio content of the multimedia content segment;
and
a plurality of track pairings, each comprising a respective video track among the plurality of video tracks and a respective audio track among the plurality of audio tracks;
performing a joint audio/video adaptation assessment of the plurality of track pairings to select one of the plurality of track pairings, resulting in a selected track pairing, wherein the joint audio/video adaptation assessment comprises assessing the plurality of track pairings based on:
bandwidth requirements for the plurality of video tracks;
available access bandwidths for a first network path associated with the plurality of video tracks;
bandwidth requirements for the plurality of audio tracks;
and
available access bandwidths for a second network path associated with the plurality of audio tracks;
synchronizing a first duration of the video content of the multimedia content segment with a second duration of the audio content of the multimedia content segment;
obtaining the video content of the multimedia content segment via a video track of the selected track pairing, wherein the video track is accessed via the first network path associated with the plurality of video tracks;
and
obtaining the audio content of the multimedia content segment via an audio track of the selected track pairing, wherein the audio track is accessed via the second network path associated with the plurality of audio tracks, wherein the first network path and the second network path are not the same, and wherein the synchronizing of the first duration of the audio content and the second duration of the video content prevents an underflow of an audio content buffer, a video content buffer, or any combination thereof.

15 more elements