Truncated square pyramid geometry and frame packing structure for representing virtual reality video content

A device for encoding video data, comprising:

• a memory configured to store video data;
• and
• a video encoding device in communication with the memory, wherein the video encoding device is configured to:
• obtain virtual reality video data, wherein the virtual reality video data represents a 360-degree view of a virtual environment, wherein the virtual reality video data includes a plurality of frames, and wherein each frame from the plurality of frames includes corresponding spherical video data;
• and
• map the spherical video data for a frame from the plurality of frames onto planes of a truncated square pyramid, wherein the planes of the truncated square pyramid include a base plane, a top plane, a left-side plane, a right-side plane, an up-side plane, and a bottom-side plane, wherein a size of the top plane is less than a size of the base plane, and wherein mapping the spherical video data includes:
• mapping a first portion of the spherical video data onto the base plane at full resolution;
• mapping a second portion of the spherical video data onto the top plane at a reduced resolution;
• mapping a third portion of the spherical video data onto the left-side plane at a decreasing resolution;
• mapping a fourth portion of the spherical video data onto the right-side plane at a decreasing resolution;
• mapping a fifth portion of the spherical video data onto the up-side plane at a decreasing resolution;
• and
• mapping a sixth portion of the spherical video data onto the bottom-side plane at a decreasing resolution.

A method for decoding video data, comprising:

• obtaining a frame of virtual reality video data, wherein the virtual reality video data represents a 360-degree view of a virtual environment, wherein the frame has a rectangular format;
• identifying a frame packing structure for the frame, wherein the frame packing structure provides positions for video data in the frame, wherein the frame packing structure includes planes of a truncated square pyramid, wherein the planes of the truncated square pyramid include a base plane, a top plane, a left-side plane, a right-side plane, an up-side plane, and a bottom-side plane, and wherein a size of the top plane is less than a size of the base plane;
• and
• displaying the frame using the frame packing structure.

A device for decoding video data, comprising:

• a memory configured to store the video data;
• a video decoding device in communication with the memory, wherein the video decoding device is configured to:
• obtain a frame of virtual reality video data, wherein the virtual reality video data represents a 360-degree view of a virtual environment, wherein the frame has a rectangular format;
• identify a frame packing structure for the frame, wherein the frame packing structure provides positions for video data in the frame, wherein the frame packing structure includes planes of a truncated square pyramid, wherein the planes of the truncated square pyramid include a base plane, a top plane, a left-side plane, a right-side plane, an up-side plane, and a bottom-side plane, wherein a size of the top plane is less than a size of the base plane;
• and
• display the frame using the frame packing structure.