Back to results
US 11,388,382 B2Granted
Suggested viewport indication for panoramic video
AssigneeIntel Corporation
InventorJill M. Boyce
Life of this patent
Estimating the term…
Abstract
A suggested viewport indication is generated and sent for use in a panoramic video. In one example, a method includes receiving encoded video including viewport metadata, decoding the video, extracting the viewport metadata, generating a viewport of the decoded video based on the viewport metadata, and buffering the generated viewport for display.
Claims23
A decoder, comprising:
- first circuitry to:
- decode a video bitstream based on a supplemental enhancement information message, the supplemental enhancement information message includes an omnidirectional viewport supplemental enhancement information message associated with a video, the omnidirectional viewport supplemental enhancement information message specifies coordinates of one or more regions of spherical-coordinate geometry, bounded by four great circles, the regions corresponding to viewports recommended for display when a user does not have control of viewing orientation or has released control of the viewing orientation, the omnidirectional viewport supplemental enhancement information message includes:
- an omni_viewport_id that contains an identifying number that may be used to identify one or more recommended viewport regions;
- an omni_viewport_cancel_flag, wherein the omni_viewport_cancel_flag equal to 1 indicates that the omnidirectional viewport supplemental enhancement information message cancels persistence of any previous omnidirectional viewport supplemental enhancement information message in output order;
- an omni_viewport_persistence_flag to specify persistence of the omnidirectional viewport supplemental enhancement information message for a current layer, wherein the omni_viewport_persistence_flag equal to 0 specifies that the omnidirectional viewport supplemental enhancement information message applies to a current decoded picture only, wherein the omni_viewport_persistence_flag equal to 1 specifies that the omnidirectional viewport supplemental enhancement information message persists for the current layer in output order until one or more conditions are met;
- an omni_viewport_cnt_minus1 plus 1 specifies a number of recommended viewport regions that are indicated by the supplemental enhancement information message, wherein when the omni_viewport_cnt_minus1 is greater than 0 and there is no information on which recommended viewport is suggested to be displayed:
- when the omni_viewport_id is equal to 0 or 1, a 0-th recommended viewport is suggested to be displayed when the user does not have control of the viewing orientation or has released control of the viewing orientation;
- an omni_viewport_azimuth_centre[i] and an omni_viewport_elevation_centre[i] that indicate a centre of an i-th recommended viewport region, in units of 2−16 degrees relative to global coordinate axes;
- an omni_viewport_tilt_centre[i] that indicates a tilt angle of the i-th recommended viewport region, in units of 2−16 degrees;
- an omni_viewport_hor_range[i] that indicates an azimuth range of the i-th recommended viewport region;
- and
- an omni_viewport_ver_range[i] that indicates an elevation range of the i-th recommended viewport region;
- and
- second circuitry to output the decoded video bitstream.
11 more elements
A system comprising:
- memory;
- at least one sensor;
- a display;
- a storage device;
- communication circuitry;
- and
- at least one processor to:
- decode a video bitstream based on a supplemental enhancement information message, the supplemental enhancement information message includes an omnidirectional viewport supplemental enhancement information message associated with a video, the omnidirectional viewport supplemental enhancement information message specifies coordinates of one or more regions of spherical-coordinate geometry, bounded by four great circles, the regions corresponding to viewports recommended for display when a user does not have control of viewing orientation or has released control of the viewing orientation, the omnidirectional viewport supplemental enhancement information message includes:
- an omni_viewport_id that contains an identifying number that corresponds to the one or more regions;
- an omni_viewport_cancel_flag, wherein the omni_viewport_cancel_flag equal to 1 indicates that the omnidirectional viewport supplemental enhancement information message cancels persistence of any previous omnidirectional viewport supplemental enhancement information message in output order;
- an omni_viewport_persistence_flag to specify persistence of the omnidirectional viewport supplemental enhancement information message for a current layer, wherein the omni_viewport_persistence_flag equal to 0 specifies that the omnidirectional viewport supplemental enhancement information message applies to a current decoded picture only, wherein the omni_viewport_persistence_flag equal to 1 specifies that the omnidirectional viewport supplemental enhancement information message persists for the current layer in output order until one or more conditions are met;
- an omni_viewport_cnt_minus1, wherein the omni_viewport_cnt_minus1 plus 1 specifies a number of regions that are indicated by the omnidirectional viewport supplemental enhancement information message,
- an omni_viewport_azimuth_centre[i] and an omni_viewport_elevation_centre[i] that indicate a centre of an i-th region, in units of 2−16 degrees relative to global coordinate axes;
- an omni_viewport_tilt_centre[i] that indicates a tilt angle of the i-th region, in units of 2−16 degrees;
- an omni_viewport_hor_range[i] that indicates an azimuth range of the i-th region;
- and
- an omni_viewport_ver_range[i] that indicates an elevation range of the i-th region;
- and,
- cause output of the decoded video bitstream.
16 more elements
An apparatus comprising:
- first means for decoding a video bitstream based on a supplemental enhancement information message, the supplemental enhancement information message includes an omnidirectional viewport supplemental enhancement information message associated with a video, the omnidirectional viewport supplemental enhancement information message specifies coordinates of one or more regions of spherical-coordinate geometry, bounded by four great circles, the regions corresponding to viewports recommended for display when a user does not have control of viewing orientation or has released control of the viewing orientation, the omnidirectional viewport supplemental enhancement information message includes:
- an omni_viewport_id that contains an identifying number that corresponds to the one or more regions;
- an omni_viewport_cancel_flag, wherein the omni_viewport_cancel_flag equal to 1 indicates that the omnidirectional viewport supplemental enhancement information message cancels persistence of any previous omnidirectional viewport supplemental enhancement information message in output order;
- an omni_viewport_persistence_flag to specify persistence of the omnidirectional viewport supplemental enhancement information message for a current layer, wherein the omni_viewport_persistence_flag equal to 0 specifies that the omnidirectional viewport supplemental enhancement information message applies to a current decoded picture only, wherein the omni_viewport_persistence_flag equal to 1 specifies that the omnidirectional viewport supplemental enhancement information message persists for the current layer in output order until one or more conditions are met;
- an omni_viewport_cnt_minus1, wherein the omni_viewport_cnt_minus1 plus 1 specifies a number of regions that are indicated by the omnidirectional viewport supplemental enhancement information message,
- an omni_viewport_azimuth_centre[i] and an omni_viewport_elevation_centre[i] that indicate a centre of an i-th region, in units of 2−16 degrees relative to global coordinate axes;
- an omni_viewport_tilt_centre[i] that indicates a tilt angle of the i-th region, in units of 2−16 degrees;
- an omni_viewport_hor_range[i] that indicates an azimuth range of the i-th region;
- and
- an omni_viewport_ver_range[i] that indicates an elevation range of the i-th region;
- and,
- second means for outputting the decoded video bitstream.
9 more elements
Dependencies are inferred from the claim text.