# US 12,192,484 B2 · Method and apparatus for encapsulating encoded media data in a media file > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,192,484 B2 - Document ID: US12192484B2 - Status: Granted - Kind: B2 - Application number: 17/718,072 - Filed: 2022-04-11 - Published: 2022-10-20 - Granted: 2025-01-07 - Earliest claimed: 2021-04-13 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Naël Ouedraogo; Franck Denoual; Frédéric Maze; Hervé Ruellan; Lionel Tocze - Web page: https://patentgrep.com/patent/US12192484B2 ## CPC - H04N 19/172: the region being a picture, frame or field - H04N 21/2365: Multiplexing of several video streams - H04N 19/184: the unit being bits, e.g. of the compressed video stream - H04N 19/188: {the unit being a video data packet, e.g. a network abstraction layer [NAL] unit} - H04N 21/4347: {Demultiplexing of several video streams} - H04N 21/440245: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment} - H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region - H04N 21/8451: {using Advanced Video Coding [AVC]} - H04N 21/85406: {involving a specific file format, e.g. MP4 format} - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract The present invention concerns a method of encapsulating subpicture bitstreams in at least one media file, the subpicture bitstreams corresponding to encoded media data of a subpicture corresponding to a rectangular region of video data, the method comprising: obtaining the plurality of subpicture bitstreams; encapsulating each subpicture bitstream in a subpicture track; generating at least one base track referencing at least two subpicture tracks and forming a spatial arrangement of the at least two subpicture tracks; generating information describing APS referenced by samples of the at least two subpicture tracks; encapsulating the subpicture tracks, the at least one base track and the information describing APS in the at least one media file. ## Claims ### Claim 1 A method of reconstruction of an encoded media data bitstream from at least one media file, the method comprising: obtaining at least two subpicture bitstreams from the at least one media file, the at least two subpicture bitstreams respectively corresponding to encoded media data of a subpicture corresponding to a rectangular region of a video data; obtaining, from the at least one media file, information for setting a decoding order of at least two subpictures corresponding to the at least two subpicture bitstreams; and generating the encoded media data bitstream comprising reconstructed picture units based on picture units of the obtained at least two subpicture bitstreams and the obtained information, wherein generating the encoded media data bitstream includes: appending the picture units of the at least two subpicture bitstreams in the reconstructed picture units in the order determined based on the information for setting the decoding order of the at least two subpictures, the information for setting the decoding order of at least two subpictures includes ‘spor’ defined in ISO/IEC 14496-15 standard, and for each reconstructed picture unit, reordering a prefix Adaptation Parameter Set, APS, Network Adaptation Layer, NAL unit from a corresponding picture unit of the at least two subpicture bitstreams prior to a first Video Coding Layer, VCL, NAL unit in the reconstructed picture unit. ### Claim 2 (depends on 1) The method of claim 1, wherein the at least one media file further comprises at least one subpicture track describing the at least two subpicture bitstreams, and wherein the information for setting the decoding order of the at least two subpictures is comprised in a base track referencing the at least one subpicture track. ### Claim 3 (depends on 2) The method of claim 2, wherein the information for setting the decoding order of the at least two subpictures is encapsulated into a data structure describing a group of samples of the base track. ### Claim 4 (depends on 2) The method of claim 2, wherein the base track is referencing the at least one subpicture track with a track reference of type ‘subp’ or ‘recr’. ### Claim 5 (depends on 1) The method of claim 1, wherein generating the encoded media data bitstream includes, for each reconstructed picture unit, reordering a suffix APS NAL unit from a corresponding picture unit of the at least two subpicture bitstreams after a last VCL NAL unit in the reconstructed picture unit. ### Claim 6 (depends on 1) The method of claim 1, wherein the picture units of the at least two subpicture bitstreams appended in a reconstructed picture unit are the picture units of the at least two subpicture bitstreams that are time-aligned with the reconstructed picture unit. ### Claim 7 (depends on 1) The method of claim 1, wherein the at least one media file is a file compliant with International Standards Organization Base Media File Format, ISOBMFF. ### Claim 8 (depends on 1) A non-transitory computer-readable storage medium storing instructions of a computer program for implementing a method according to claim 1. ### Claim 9 A device of reconstruction of an encoded media data bitstream from at least one media file, the device comprising a processor configured for: obtaining at least two subpicture bitstreams from the at least one media file, the at least two subpicture bitstreams respectively corresponding to encoded media data of a subpicture corresponding to a rectangular region of video data; obtaining, from the at least one media file, information for setting a decoding order of at least two subpictures corresponding to the at least two subpicture bitstreams; generating the encoded media data bitstream comprising reconstructed picture units based on picture units of the obtained at least two subpicture bitstreams and the obtained information, wherein generating the encoded media data bitstream includes: appending the picture units of the at least two subpicture bitstreams in the reconstructed picture units in the order determined based on the information for setting the decoding order of the at least two subpictures, the information for setting the decoding order of at least two subpictures includes ‘spor’ defined in ISO/IEC 14496-15 standard, and for each reconstructed picture unit, reordering a prefix Adaptation Parameter Set, APS, Network Adaptation Layer, NAL unit from a corresponding picture unit of the at least two subpicture bitstreams prior to a first Video Coding Layer, VCL, NAL unit in the reconstructed picture unit.