# US 2019/0320190 A1 · Methods and apparatus for providing two-dimensional spatial relationships > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0320190 A1 - Document ID: US20190320190A1 - Status: Published application - Kind: A1 - Application number: 16/380,840 - Filed: 2019-04-10 - Published: 2019-10-17 - Earliest claimed: 2018-04-12 - Assignees: MediaTek Singapore Pte. Ltd. - Applicants: MEDIATEK Singapore Pte. Ltd. - Inventors: Xin Wang; Lulin Chen - Web page: https://patentgrep.com/patent/US20190320190A1 ## CPC - H04N 19/23: with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic - H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) - H04N 13/178: Metadata, e.g. disparity information - H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract The techniques described herein relate to methods, apparatus, and computer readable media configured to specify two-dimensional spatial relationship information. Video data includes a track group type for a group of two-dimensional tracks. The track group type is a two-dimensional spatial relationship track group type, wherein a spatial relationship of the group of tracks is specified based on a two-dimensional Cartesian coordinate system. Two-dimensional spatial relationship description data for the group of tracks, can specify a two-dimensional region based on the two-dimensional Cartesian coordinate system, and a relation of each two-dimensional track in the group of two-dimensional tracks to the two-dimensional region. Source data for the two-dimensional region can be generated by composing each two-dimensional track from the group of tracks based on the associated relation of the two-dimensional track to the two-dimensional region. ## Claims ### Claim 1 A decoding method for decoding video data, the method comprising: receiving video data comprising a track group type for a group of two-dimensional tracks; determining the track group type is a two-dimensional spatial relationship track group type, wherein a spatial relationship of the group of tracks is specified based on a two-dimensional Cartesian coordinate system; determining two-dimensional spatial relationship description data for the group of tracks, comprising determining: a two-dimensional region based on the two-dimensional Cartesian coordinate system; and a relation of each two-dimensional track in the group of two-dimensional tracks to the two-dimensional region; and generating source data for the two-dimensional region by composing each two-dimensional track from the group of tracks based on the associated relation of the two-dimensional track to the two-dimensional region. ### Claim 2 (depends on 1) The method of claim 1, wherein determining the two-dimensional region comprises determining a width and a height of the two-dimensional region. ### Claim 3 (depends on 1) The method of claim 1, wherein determining the relation of each two-dimensional track comprises determining a position, a width, a height, or some combination thereof, of the two-dimensional track in the two-dimensional region. ### Claim 4 (depends on 1) The method of claim 1, wherein generating the source data comprises generating the source data based on one or more constraints from a set of constraints. ### Claim 5 (depends on 4) The method of claim 4, wherein the set of constraints comprises one or more of: a first constraint that each two-dimensional track in the track group is associated with only one alternate track group; a second constraint that any two overlapping two-dimensional tracks in the track group have a different layer value; a third constraint that each pixel in the two-dimensional region comprises content; a fourth constraint that each two-dimensional track in the track group comprises a same source identifier and a same set of dimensions for the two-dimensional region; or some combination thereof. ### Claim 6 A method for encoding video data, the method comprising: encoding video data comprising a track group type for a group of two-dimensional tracks, wherein: the track group type is a two-dimensional spatial relationship track group type, wherein a spatial relationship of the group of tracks is specified based on a two-dimensional Cartesian coordinate system; and two-dimensional spatial relationship description data for the group of tracks is specified, comprising: a two-dimensional region based on the two-dimensional Cartesian coordinate system; and a relation of each two-dimensional track in the group of two-dimensional tracks to the two-dimensional region; such that source data can be generated for the two-dimensional region by composing each two-dimensional track from the group of tracks based on the associated relation of the two-dimensional track to the two-dimensional region. ### Claim 7 (depends on 6) The method of claim 6, wherein the two-dimensional region comprises a width and a height of the two-dimensional region. ### Claim 8 (depends on 6) The method of claim 6, wherein the relation of each two-dimensional track comprises a position, a width, a height, or some combination thereof, of the two-dimensional track in the two-dimensional region. ### Claim 9 (depends on 6) The method of claim 6, wherein the source data can be generated based on one or more constraints from a set of constraints. ### Claim 10 (depends on 9) The method of claim 9, wherein the set of constraints comprises one or more of: a first constraint that each two-dimensional track in the track group is associated with only one alternate track group; a second constraint that any two overlapping two-dimensional tracks in the track group have a different layer value; a third constraint that each pixel in the two-dimensional region comprises content; a fourth constraint that each two-dimensional track in the track group comprises a same source identifier and a same set of dimensions for the two-dimensional region; or some combination thereof. ### Claim 11 An apparatus configured to decode video data, the apparatus comprising a processor in communication with memory, the processor being configured to execute instructions stored in the memory that cause the processor to: receive video data comprising a track group type for a group of two-dimensional tracks; determine the track group type is a two-dimensional spatial relationship track group type, wherein a spatial relationship of the group of tracks is specified based on a two-dimensional Cartesian coordinate system; determine two-dimensional spatial relationship description data for the group of tracks, comprising determining: a two-dimensional region based on the two-dimensional Cartesian coordinate system; and a relation of each two-dimensional track in the group of two-dimensional tracks to the two-dimensional region; and generate source data for the two-dimensional region by composing each two-dimensional track from the group of tracks based on the associated relation of the two-dimensional track to the two-dimensional region. ### Claim 12 (depends on 11) The apparatus of claim 11, wherein determining the two-dimensional region comprises determining a width and a height of the two-dimensional region. ### Claim 13 (depends on 11) The apparatus of claim 11, wherein determining the relation of each two-dimensional track comprises determining a position, a width, a height, or some combination thereof, of the two-dimensional track in the two-dimensional region. ### Claim 14 (depends on 11) The apparatus of claim 11, wherein generating the source data comprises generating the source data based on one or more constraints from a set of constraints. ### Claim 15 (depends on 14) The apparatus of claim 14, wherein the set of constraints comprises one or more of: a first constraint that each two-dimensional track in the track group is associated with only one alternate track group; a second constraint that any two overlapping two-dimensional tracks in the track group have a different layer value; a third constraint that each pixel in the two-dimensional region comprises content; a fourth constraint that each two-dimensional track in the track group comprises a same source identifier and a same set of dimensions for the two-dimensional region; or some combination thereof. ### Claim 16 An apparatus for encoding video data, the apparatus comprising a processor in communication with memory, the processor being configured to execute instructions stored in the memory that cause the processor to: encode video data comprising a track group type for a group of two-dimensional tracks, wherein: the track group type is a two-dimensional spatial relationship track group type, wherein a spatial relationship of the group of tracks is specified based on a two-dimensional Cartesian coordinate system; and two-dimensional spatial relationship description data for the group of tracks is specified, comprising: a two-dimensional region based on the two-dimensional Cartesian coordinate system; and a relation of each two-dimensional track in the group of two-dimensional tracks to the two-dimensional region; such that source data can be generated for the two-dimensional region by composing each two-dimensional track from the group of tracks based on the associated relation of the two-dimensional track to the two-dimensional region. ### Claim 17 (depends on 16) The apparatus of claim 16, wherein the two-dimensional region comprises a width and a height of the two-dimensional region. ### Claim 18 (depends on 16) The apparatus of claim 16, wherein the relation of each two-dimensional track comprises a position, a width, a height, or some combination thereof, of the two-dimensional track in the two-dimensional region. ### Claim 19 (depends on 16) The apparatus of claim 16, wherein the source data can be generated based on one or more constraints from a set of constraints. ### Claim 20 (depends on 19) The apparatus of claim 19, wherein the set of constraints comprises one or more of: a first constraint that each two-dimensional track in the track group is associated with only one alternate track group; a second constraint that any two overlapping two-dimensional tracks in the track group have a different layer value; a third constraint that each pixel in the two-dimensional region comprises content; a fourth constraint that each two-dimensional track in the track group comprises a same source identifier and a same set of dimensions for the two-dimensional region; or some combination thereof.