Back to results
US 11,388,381 B2Granted
Suggested viewport indication for panoramic video
AssigneeIntel Corporation
InventorJill M. Boyce
Life of this patent
Estimating the term…
Abstract
A suggested viewport indication is generated and sent for use in a panoramic video. In one example, a method includes receiving encoded video including viewport metadata, decoding the video, extracting the viewport metadata, generating a viewport of the decoded video based on the viewport metadata, and buffering the generated viewport for display.
Claims23
An encoder, comprising:
- first circuitry to:
- generate an omnidirectional viewport supplemental enhancement information message associated with a video, the omnidirectional viewport supplemental enhancement information message specifies coordinates of one or more regions of spherical-coordinate geometry, bounded by four great circles, corresponding to viewports for display when a user does not have control of viewing orientation or has released control of the viewing orientation, the omnidirectional viewport supplemental enhancement information message includes:
- an omni_viewport_id that contains an identifying number that corresponds to the one or more regions;
- an omni_viewport_cancel_flag, wherein the omni_viewport_cancel_flag equal to 1 indicates that the omnidirectional viewport supplemental enhancement information message cancels persistence of any previous omnidirectional viewport supplemental enhancement information message in output order;
- an omni_viewport_persistence_flag to specify persistence of the omnidirectional viewport supplemental enhancement information message for a current layer, wherein the omni_viewport_persistence_flag equal to 0 specifies that the omnidirectional viewport supplemental enhancement information message applies to a current decoded picture only, wherein the omni_viewport_persistence_flag equal to 1 specifies that the omnidirectional viewport supplemental enhancement information message persists for the current layer in output order until one or more conditions are met;
- an omni_viewport_cnt_minus1, wherein the omni_viewport_cnt minus1 plus 1 specifies a number of regions that are indicated by the omnidirectional viewport supplemental enhancement information message,
- an omni_viewport_azimuth_centre[i] and an omni_viewport_elevation_centre[i] that indicate a centre of an i-th region, in units of 2−16 degrees relative to global coordinate axes;
- an omni_viewport_tilt_centre [i] that indicates a tilt angle of the i-th region, in units of 2−16 degrees;
- an omni_viewport_hor_range[i] that indicates an azimuth range of the i-th region;
- and
- an omni_viewport_ver_range[i] that indicates an elevation range of the i-th region;
- and .
- second circuitry to output the omnidirectional viewport supplemental enhancement information message.
10 more elements
A system comprising:
- memory;
- at least one sensor;
- a display;
- a storage device;
- communication circuitry;
- and
- at least one processor to:
- generate an omnidirectional viewport supplemental enhancement information message associated with a video, the omnidirectional viewport supplemental enhancement information message specifies coordinates of one or more regions of spherical-coordinate geometry, bounded by four great circles, corresponding to viewports for display when a user does not have control of viewing orientation or has released control of the viewing orientation, the omnidirectional viewport supplemental enhancement information message includes:
- an omni_viewport_id that contains an identifying number that corresponds to the one or more regions;
- an omni_viewport_cancel_flag, wherein the omni_viewport_cancel_flag equal to 1 indicates that the omnidirectional viewport supplemental enhancement information message cancels persistence of any previous omnidirectional viewport supplemental enhancement information message in output order;
- an omni_viewport_persistence_flag to specify persistence of the omnidirectional viewport supplemental enhancement information message for a current layer, wherein the omni_viewport_persistence_flag equal to 0 specifies that the omnidirectional viewport supplemental enhancement information message applies to a current decoded picture only, wherein the omni_viewport_persistence_flag equal to 1 specifies that the omnidirectional viewport supplemental enhancement information message persists for the current layer in output order until one or more conditions are met;
- an omni viewport_cnt_minus1, wherein the omni_viewport_cnt minus1 plus 1 specifies a number of regions that are indicated by the omnidirectional viewport supplemental enhancement information message,
- an omni_viewport_azimuth_centre[i] and an omni_viewport_elevation_centre[i] that indicate a centre of an i-th region, in units of 2−16 degrees relative to global coordinate axes;
- an omni_viewport_tilt_centre[i] that indicates a tilt angle of the i-th region, in units of 2−16 degrees;
- an omni_viewport_hor_range[i] that indicates an azimuth range of the i-th region;
- and
- an omni_viewport_ver_range[i] that indicates an elevation range of the i-th region;
- and .
- cause output of the omnidirectional viewport supplemental enhancement information message.
16 more elements
An apparatus comprising:
- first means for generating an omnidirectional viewport supplemental enhancement information message associated with a video, the omnidirectional viewport supplemental enhancement information message specifies coordinates of one or more regions of spherical-coordinate geometry, bounded by four great circles, corresponding to viewports for display when a user does not have control of viewing orientation or has released control of the viewing orientation, the omnidirectional viewport supplemental enhancement information message includes:
- an omni_viewport_id that contains an identifying number that corresponds to the one or more regions;
- an omni_viewport_cancel_flag, wherein the omni_viewport_cancel_flag equal to 1 indicates that the omnidirectional viewport supplemental enhancement information message cancels persistence of any previous omnidirectional viewport supplemental enhancement information message in output order;
- an omni_viewport_persistence_flag to specify persistence of the omnidirectional viewport supplemental enhancement information message for a current layer, wherein the omni_viewport_persistence_flag equal to 0 specifies that the omnidirectional viewport supplemental enhancement information message applies to a current decoded picture only, wherein the omni_viewport_persistence_flag equal to 1 specifies that the omnidirectional viewport supplemental enhancement information message persists for the current layer in output order until one or more conditions are met;
- an omni_viewport_cnt_minus1, wherein the omni_viewport_cnt_minus1 plus 1 specifies a number of regions that are indicated by the omnidirectional viewport supplemental enhancement information message,
- an omni_viewport_azimuth_centre[i] and an omni_viewport_elevation_centre[i] that indicate a centre of an i-th region, in units of 2−16 degrees relative to global coordinate axes;
- an omni_viewport_tilt_centre[i] that indicates a tilt angle of the i-th region, in units of 2−16 degrees;
- an omni_viewport_hor_range[i] that indicates an azimuth range of the i-th region;
- and
- an omni_viewport_ver_range[i] that indicates an elevation range of the i-th region;
- and .
- second means for outputting the omnidirectional viewport supplemental enhancement information message.
9 more elements
Dependencies are inferred from the claim text.