Back to results
US 11,699,211 B2Granted
Spherical rotation for encoding wide view video
AssigneeIntel Corporation
InventorJill M. Boyce
Life of this patent
Estimating the term…
Abstract
Spherical rotation is described for encoding a video that has a wide field of view, such as a spherical or hemispherical video. One example relates to receiving encoded video including rotation orientation metadata, decoding the video, extracting the rotation orientation metadata, rotating the decoded video based on the rotation orientation metadata, generating a view of the rotated decoded video, and buffering the generated view for display.
Claims21
A video encoder comprising:
- first circuitry to:
- map a wide field of view video into a planar projection;
- select a rotation of the projection;
- generate rotation orientation metadata describing the selected rotation, the rotation orientation metadata includes a sphere rotation supplemental enhancement information message that includes information on rotation angles yaw (α), pitch (β), and roll (γ) that are used for conversion between global coordinate axes and local coordinate axes, wherein roll corresponds to a rotation around an x-axis, pitch corresponds to a rotation around a y-axis, and yaw corresponds to a rotation around a z-axis, the sphere rotation supplemental enhancement information message includes:
- sphere_rotation_cancel_flag, wherein the sphere_rotation_cancel_flag equals to 1 indicates that the sphere rotation supplemental enhancement information message cancels persistence of any previous sphere rotation supplemental enhancement information message;
- sphere_rotation_persistence_flag, the sphere_rotation_persistence_flag specifies persistence of the sphere rotation supplemental enhancement information message for a current layer, wherein the sphere_rotation_persistence_flag equals to 0 to specifies that the sphere rotation supplemental enhancement information message applies to a current decoded picture only, wherein the sphere_rotation_persistence_flag equals to 1 specifies that the sphere rotation supplemental enhancement information message applies persists for the current layer until one or more conditions are met, and
- at least one of:
- yaw_rotation, wherein yaw_rotation specifies the value of the yaw rotation angle, wherein a 0 for yaw_rotation indicates that there is no yaw rotation,
- pitch_rotation, wherein pitch_rotation specifies the value of the pitch rotation angle, wherein a 0 indicates that there is no pitch rotation, or
- roll_rotation, wherein roll_rotation specifies the value of the roll rotation angle, wherein a 0 for roll_rotation indicates that there is no roll rotation;
- and
- rotate the projection based on the selected rotation;
- encode the rotated projection as encoded video including the rotation orientation metadata;
- and
- second circuitry to:
- store the encoded video.
13 more elements
A system comprising:
- memory;
- at least one sensor;
- a display;
- a storage device;
- communication circuitry;
- and
- at least one processor to:
- map a wide field of view video into a planar projection;
- select a rotation of the projection;
- generate rotation orientation metadata describing the selected rotation, the rotation orientation metadata includes a sphere rotation supplemental enhancement information message that includes information on rotation angles yaw (α), pitch (β), and roll (γ) that are used for conversion between global coordinate axes and local coordinate axes, wherein roll corresponds to a rotation around an x-axis, pitch corresponds to a rotation around a y-axis, and yaw corresponds to a rotation around a z-axis, the sphere rotation supplemental enhancement information message includes:
- sphere_rotation_cancel_flag, wherein the sphere_rotation_cancel_flag equals to 1 indicates that the sphere rotation supplemental enhancement information message cancels persistence of any previous sphere rotation supplemental enhancement information message;
- sphere_rotation_persistence_flag, the sphere_rotation_persistence_flag specifies persistence of the sphere rotation supplemental enhancement information message for a current layer, wherein the sphere_rotation_persistence_flag equals to 0 to specifies that the sphere rotation supplemental enhancement information message applies to a current decoded picture only, wherein the sphere_rotation_persistence_flag equals to 1 specifies that the sphere rotation supplemental enhancement information message applies persists for the current layer until one or more conditions are met, and
- at least one of:
- yaw_rotation, wherein yaw_rotation specifies the value of the yaw rotation angle, wherein a 0 for yaw_rotation indicates that there is no yaw rotation,
- pitch_rotation, wherein pitch_rotation specifies the value of the pitch rotation angle, wherein a 0 indicates that there is no pitch_rotation, or
- roll_rotation, wherein roll_rotation specifies the value of the roll rotation angle, wherein a 0 for roll_rotation indicates that there is no roll rotation;
- and
- rotate the projection based on the selected rotation;
- encode the rotated projection as encoded video including the rotation orientation metadata;
- and
- store the encoded video.
18 more elements
A method comprising:
- mapping a wide field of view video into a planar projection;
- selecting a rotation of the projection;
- generating rotation orientation metadata describing the selected rotation, the rotation orientation metadata includes a sphere rotation supplemental enhancement information message that includes information on rotation angles yaw (α), pitch (β), and roll (γ) that are used for conversion between global coordinate axes and local coordinate axes, wherein roll corresponds to a rotation around an x-axis, pitch corresponds to a rotation around a y-axis, and yaw corresponds to a rotation around a z-axis, the sphere rotation supplemental enhancement information message includes:
- sphere_rotation_cancel_flag, wherein the sphere_rotation_cancel_flag equals to 1 indicates that the sphere rotation supplemental enhancement information message cancels persistence of any previous sphere rotation supplemental enhancement information message;
- sphere_rotation_persistence_flag, the sphere_rotation_persistence_flag specifies persistence of the sphere rotation supplemental enhancement information message for a current layer, wherein the sphere_rotation_persistence_flag equals to 0 to specifies that the sphere rotation supplemental enhancement information message applies to a current decoded picture only, wherein the sphere_rotation_persistence_flag equals to 1 specifies that the sphere rotation supplemental enhancement information message applies persists for the current layer until one or more conditions are met, and
- at least one of:
- yaw_rotation, wherein yaw_rotation specifies the value of the yaw rotation angle, wherein a 0 for yaw_rotation indicates that there is no yaw rotation,
- pitch_rotation, wherein pitch_rotation specifies the value of the pitch rotation angle, wherein a 0 indicates that there is no pitch_rotation, or
- roll_rotation, wherein roll_rotation specifies the value of the roll rotation angle, wherein a 0 for roll_rotation indicates that there is no roll rotation;
- rotating the projection based on the selected rotation;
- encoding the rotated projection as encoded video including the rotation orientation metadata;
- and
- storing the encoded video.
10 more elements
Dependencies are inferred from the claim text.