US 11,146,802 B2Granted

Methods and apparatus for providing two-dimensional spatial relationships

AssigneeMediaTek Singapore Pte. Ltd.

InventorsXin Wang, Lulin Chen

Life of this patent

Estimating the term…

Loading patent…

Abstract

The techniques described herein relate to methods, apparatus, and computer readable media configured to specify two-dimensional spatial relationship information. Video data includes a track group type for a group of two-dimensional tracks. The track group type is a two-dimensional spatial relationship track group type, wherein a spatial relationship of the group of tracks is specified based on a two-dimensional Cartesian coordinate system. Two-dimensional spatial relationship description data for the group of tracks, can specify a two-dimensional region based on the two-dimensional Cartesian coordinate system, and a relation of each two-dimensional track in the group of two-dimensional tracks to the two-dimensional region. Source data for the two-dimensional region can be generated by composing each two-dimensional track from the group of tracks based on the associated relation of the two-dimensional track to the two-dimensional region.

Claims19

Dependent claims

A decoding method for decoding video data, the method comprising:

receiving video data comprising a track group type for a group of two-dimensional tracks, wherein each two-dimensional track in the group of two-dimensional tracks comprises video data for an associated two-dimensional portion of a video source;
determining that the track group type of a track group type metadata box of each of the two-dimensional tracks of the group of two-dimensional tracks is a two-dimensional spatial relationship track group type of a plurality of different track group types, wherein:
the two-dimensional spatial relationship track group type specifies a spatial relationship of the two-dimensional portions of the two-dimensional tracks in the group of two-dimensional tracks based on a two-dimensional Cartesian coordinate system;
and
each of the two-dimensional tracks of the two-dimensional spatial relationship track group type meets a set of constraints comprising at least:
a first constraint that each of the two-dimensional tracks in the group of two-dimensional tracks does not belong to more than one alternate track group;
and
a second constraint that, for each of the two-dimensional tracks in the group of two-dimensional tracks that belongs to an associated alternate track group, tracks in the associated alternate track group are in the group of two-dimensional tracks;
processing the group of two-dimensional tracks based on the determined two-dimensional spatial relationship track group type, comprising:
determining two-dimensional spatial relationship description data for the group of two-dimensional tracks, comprising determining:
a two-dimensional region of the video source based on the two-dimensional Cartesian coordinate system;
and
a spatial relation of the two-dimensional portion of the video source of each two-dimensional track in the group of two-dimensional tracks to the two-dimensional region;
and
generating source data for the two-dimensional region of the video source by composing the two-dimensional portion of the video source of each two-dimensional track from the group of tracks into the two-dimensional region based on the associated spatial relation of the two-dimensional track to the two-dimensional region.

12 more elements

A method for encoding video data, the method comprising:

encoding video data comprising a track group type for a group of two-dimensional tracks, wherein each two-dimensional track in the group of two-dimensional tracks comprises video data for an associated two-dimensional portion of a video source, wherein:
the track group type of a track group type metadata box of each of the two-dimensional tracks of the group of two-dimensional tracks is a two-dimensional spatial relationship track group type of a plurality of different track group types, wherein:
the two-dimensional spatial relationship track group type specifies a spatial relationship of the two-dimensional portions of the two-dimensional tracks in the group of two-dimensional tracks based on a two-dimensional Cartesian coordinate system;
and
each of the two-dimensional tracks of the two-dimensional spatial relationship track group type meets a set of constraints comprising at least:
a first constraint that each of the two-dimensional tracks in the group of two-dimensional tracks does not belong to more than one alternate track group;
and
a second constraint that, for each of the two-dimensional tracks in the group of two-dimensional tracks that belongs to an associated alternate track group, tracks in the associated alternate track group are in the group of two-dimensional tracks;
and
two-dimensional spatial relationship description data for the group of two:
dimensional tracks is specified, comprising:
a two-dimensional region of the video source based on the two-dimensional Cartesian coordinate system;
and
a spatial relation of the two-dimensional portion of the video source of each two-dimensional track in the group of two-dimensional tracks to the two-dimensional region;
such that source data can be generated for the two-dimensional region of the video source by composing the two-dimensional portion of the video source of each two-dimensional track from the group of tracks into the two-dimensional region based on the associated spatial relation of the two-dimensional track to the two-dimensional region.

12 more elements

An apparatus configured to decode video data, the apparatus comprising a processor in communication with memory, the processor being configured to execute instructions stored in the memory that cause the processor to:

receive video data comprising a track group type for a group of two-dimensional tracks, wherein each two-dimensional track in the group of two-dimensional tracks comprises video data for an associated two-dimensional portion of a video source;
determine that the track group type of a track group type metadata box of each of the two-dimensional tracks of the group of two-dimensional tracks is a two-dimensional spatial relationship track group type of a plurality of different track group types, wherein:
the two-dimensional spatial relationship track group type specifies a spatial relationship of the two-dimensional portions of the two-dimensional tracks in the group of two-dimensional tracks based on a two-dimensional Cartesian coordinate system;
and
each of the two-dimensional tracks of the two-dimensional spatial relationship track group type meets a set of constraints comprising at least:
a first constraint that each of the two-dimensional tracks in the group of two-dimensional tracks does not belong to more than one alternate track group;
and
a second constraint that, for each of the two-dimensional tracks in the group of two-dimensional tracks that belongs to an associated alternate track group, tracks in the associated alternate track group are in the group of two-dimensional tracks;
process the group of two-dimensional tracks based on the determined two-dimensional spatial relationship track group type, comprising:
determining two-dimensional spatial relationship description data for the group of two-dimensional tracks, comprising determining:
a two-dimensional region of the video source based on the two-dimensional Cartesian coordinate system;
and
a spatial relation of the two-dimensional portion of the video source of each two-dimensional track in the group of two-dimensional tracks to the two-dimensional region;
and
generate source data for the two-dimensional region of the video source by composing the two-dimensional portion of the video source of each two-dimensional track from the group of tracks into the two-dimensional region based on the associated spatial relation of the two-dimensional track to the two-dimensional region.

12 more elements

An apparatus for encoding video data, the apparatus comprising a processor in communication with memory, the processor being configured to execute instructions stored in the memory that cause the processor to:

encode video data comprising a track group type for a group of two-dimensional tracks, wherein each two-dimensional track in the group of two-dimensional tracks comprises video data for an associated two-dimensional portion of a video source, wherein:
the track group type of a track group type metadata box of each of the two-dimensional tracks of the group of two-dimensional tracks is a two-dimensional spatial relationship track group type of a plurality of different track group types, wherein:
the two-dimensional spatial relationship track group type specifies a spatial relationship of the two-dimensional portions of the two-dimensional tracks in the group of two-dimensional tracks based on a two-dimensional Cartesian coordinate system;
and
each of the two-dimensional tracks of the two-dimensional spatial relationship track group type meets a set of constraints comprising at least:
a first constraint that each of the two-dimensional tracks in the group of two-dimensional tracks does not belong to more than one alternate track group;
and
a second constraint that, for each of the two-dimensional tracks in the group of two-dimensional tracks that belongs to an associated alternate track group, tracks in the associated alternate track group are in the group of two-dimensional tracks;
and
two-dimensional spatial relationship description data for the group of two-dimensional tracks is specified, comprising:
a two-dimensional region of the video source based on the two-dimensional Cartesian coordinate system;
and
a spatial relation of the two-dimensional portion of the video source of each two-dimensional track in the group of two-dimensional tracks to the two-dimensional region;
such that source data can be generated for the two-dimensional region of the video source by composing the two-dimensional portion of the video source of each two-dimensional track from the group of tracks into the two-dimensional region based on the associated spatial relation of the two-dimensional track to the two-dimensional region.

11 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/380,840Filed 10 Apr 2019 · us provisional application
Priority: 12 Apr 2018
Published: US 2019/0320190 A117 Oct 2019
Granted: 12 Oct 2021
Term ends: Not estimatedThe source records don’t support an estimate.

Classification5 codes

H04N 19/23
Using video object coding: with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
H04N 13/161
Processing image signals: encoding, multiplexing or demultiplexing different image signal components
H04N 13/178
Image signals comprising non-image signal components, e.g. headers or format information: metadata, e.g. disparity information
H04N 23/698
Control of cameras or camera modules: for achieving an enlarged field of view, e.g. panoramic image capture