Multi-format single stream scalable coding for multi-language audio

A method, comprising:

• obtaining an encoded audio stream including a base layer bitstream, multiple enhancement layer bitstreams each representing speech audio of an input video stream used to produce the encoded audio stream in one of multiple different languages, and language selection precedence data embedded within a header of the encoded audio stream;
• decoding, from the audio stream, the base layer bitstream into background audio;
• decoding, from the audio stream, an enhancement layer bitstream indicated by the language selection precedence data into speech audio;
• re-mixing the background audio and the speech audio into an audio stream;
• combining the audio stream and a video stream into a single media stream;
• and
• outputting the single media stream for playback or further processing.

A system, comprising:

• one or more servers used with an online video platform and configured to:
• obtain an input video stream from a first device;
• encode background audio of the input video stream to a base layer bitstream;
• encode each of multiple language versions of speech audio of the input video stream to a different enhancement layer bitstream, wherein each of the different enhancement layer bitstreams represents the speech audio in one of multiple different languages;
• combine, into an encoded audio stream, the base layer bitstream, each of the enhancement layer bitstreams, and language selection precedence data for the enhancement layer bitstreams, wherein the language selection precedence data is embedded within a header of the encoded audio stream;
• and
• output the encoded audio stream for decoding at a second device responsive to a playback request for a video associated with the encoded audio stream,
• wherein the encoded audio stream configures the second device to decode one of the enhancement layer bitstreams for playback of a language version of the speech audio along with the background audio according to the language selection precedence data.