US 12,574,589 B2 · Signaling for picture in picture in media container file and in streaming manifest

Abstract

This disclosure relates to signaling of picture-in-picture (PiP) in media container files and in streaming media manifest. In one aspect, signaling of PiP experience in container files are disclosed, where the PiP experience consists of two or more media tracks. A media track group is used to define a picture-in-picture experience, wherein the main media track or tracks and the substitute/overlay media tracks are defined. The PiP experience is identified with a Role scheme. The media tracks in the PiP can be decoded independently, or if the coding scheme supports, the substitute coded stream can replace the corresponding regions in the main picture stream in a merge mode, for which an order of importance of the substitute picture and the specific regions of the main picture are also signaled. In another aspect, a picture-in-picture experience may be signaled in streaming manifest. Such signaling may include identifying the adaptation sets with a picture-in-picture descriptor as well as using a role descriptor to identify the PiP experience, and further annotating the subpicture in a manifest where one or more subpictures are identified as one or more regions for substitutions.

Claims20

Dependent claims

A method to obtain (Picture-in-Picture) PiP information, comprising:

retrieving a media container file constructed in an ISO Base Media File Format (ISOBMFF), wherein the media container file includes a main media track and at least one sub media track to be presented in a PiP mode;
parsing the media container file to identify a media track group for a PiP experience via a preselection track group entry (Prse) box syntax element for media track group definition;
parsing the media container file to identify the main media track and at the least one sub media track belonging to the media track group via a preselection group (Pres) box syntax element within a plurality of media track definitions in the media container file;
parsing the media container file to determine a merge mode indicating whether coded data units of the at least one sub media track are to be merged with coded data units of the main media track prior to being decoded depending on presence or value of a sample flag merge syntax element within components of the Pres box syntax element of the main media track or the at least one sub media track;
parsing the media container file to determine a region information for PiP, wherein non-null region information for PiP is only extractable from a media track having a highest priority level among media tracks of the media track group;
and
decoding the main media track and the at least one sub media track in the PiP mode according to the merging mode and the region information.

4 more elements

Dependencies are inferred from the claim text.

Signaling for picture in picture in media container file and in streaming manifest

Life of this patent

Signaling for picture in picture in media container file and in streaming manifest

Life of this patent

Abstract

Claims20