Adaptive streaming of media content with bitrate switching

Media streaming server for adaptive streaming of media content with bitrate switching, the media content comprising a plurality of consecutive media segments, the media streaming server comprising:

• a media storing unit for storing the media content in at least 2 coding modes and for storing transition segments for transitioning between coding modes, wherein the media content comprises audio or video content, and wherein the at least 2 coding modes correspond to different audio or video codec modes of the media content;
• a transmitting unit for transmitting segments of the media content encoded in one of the coding modes and for transmitting transition segments;
• a receiving unit for receiving from a client device requests for media content;
• wherein, upon receiving from the client device an indication for a coding mode switch to another coding mode, the media streaming server transmits a transition segment to the client device, wherein the transition segment comprises a portion of the media content encoded in a transition coding mode, the transition coding mode enabling a smooth transition between the coding modes,
• wherein the at least 2 coding modes comprise parametric data for controlling the encoding, and wherein in the transition coding mode the parametric data is gradually changed between the coding modes, the parametric data corresponding to parametric data of the audio or video codec mode the media content is encoded in, wherein:
• the first coding mode corresponds to a 3D video codec mode and the second coding mode corresponds to a 2D video codec mode, wherein the parametric data of the 3D video codec mode correspond to spatial positions of 3D objects used for generating the first coding mode and the parametric data of the 2D video codec mode describe corresponding object positions being projected onto a 2D plane representing 2D objects corresponding to the second coding mode, and wherein in the transition coding mode the 3D objects of the first coding mode are gradually moved towards a front of a 2D spatial space;
• or
• the first coding mode corresponds to an immersive 3D audio codec mode and the second coding mode corresponds to a 5.1 surround sound or stereo codec mode, wherein the parametric data of the immersive 3D audio codec mode correspond to individual audio objects with metadata indicative of their position and movement in 3D space and the parametric data of the 5.1 surround sound or stereo codec mode correspond to respective speaker positions, and wherein in the transition coding mode the audio objects are gradually moved to the respective positions of the speakers, wherein, if an audio object is located between two speaker positions, it is split up and the respective parts are moved to the respective speaker positions.

Media playback device for receiving adaptive streaming of media content with bitrate switching, the media content comprising a plurality of consecutive media segments, the media playback device comprising:

• a request transmitting unit for transmitting requests for media content;
• a media receiving unit for receiving segments of the media content encoded in one of a plurality of coding modes, wherein the media content comprises audio or video content, wherein the coding modes correspond to different audio or video codec modes of the media content;
• a streaming manifest receiving unit for receiving a streaming manifest of the media content indicating available switching points between a first and a second coding mode corresponding to a 3D and a 2D audio or video codec mode that had been determined, by a media streaming server, by analyzing the media content to determine boundaries between segments, such that the presence of 3D objects is at minimum where switching of coding modes is least perceptually noticeable;
• and
• a playback unit for playback of the received media segments,
• wherein the media playback device transmits an indication for a coding mode switch to another coding mode at an available switching point if a bitrate switch is desired.

Method for adaptive streaming of media content with bitrate switching, the media content comprising a plurality of consecutive media segments, the method comprising, at a media streaming server:

• determining available switching points for switching of coding modes between media segments by analyzing the media content to determine boundaries between segments, where switching of coding modes is least perceptually noticeable;
• signaling the availability of the switching points in a streaming manifest of the media content to a client device;
• transmitting segments of the media content encoded in a first coding mode having a first bitrate to the client device;
• and
• receiving, from the client device, an indication for a coding mode switch at an available switching point to a second coding mode having a second bitrate, the second bitrate being different from the first bitrate, and in response transmitting segments of the media content encoded in the second coding mode to the client device,
• wherein the media content comprises audio or video content, and wherein the first coding mode corresponds to a 3D audio or video codec mode of the media content, and the second coding mode corresponds to a 2D audio or video codec mode of the media content, and wherein the boundaries between the segments are determined such that the presence of 3D objects is at minimum.