Hybrid graphics and pixel domain architecture for 360 degree video

An apparatus configured to process video data, the apparatus comprising:

• a memory configured to store a video stream comprising pixel domain video data and graphics domain video data;
• one or more processors configured to parse the stored video stream into a graphics stream and an audio-video stream and decode the parsed video stream;
• a sensor to sense movement adaptations of a user;
• and
• a graphics processing unit configured to generate a canvas on a spherical surface with texture information from the graphics stream, and render a field of view based on the sensed movement adaptations of the user.

A method of processing video data, comprising:

• storing the video data;
• encoding a portion of the video data in a pixel domain to generate pixel domain video data;
• processing the video data in a graphics domain to generate graphics domain video data;
• and
• transmitting the graphics domain video data and the pixel domain video data.

A method of processing a video data, comprising:

• storing a video stream comprising pixel domain video data and graphics domain video data;
• parsing the stored video stream into a graphics stream and an audio-video stream and decoding the video stream;
• sensing movement adaptations of a user;
• generating a canvas on a spherical surface with texture information from the graphics stream;
• and
• rendering a field of view based on the sensed movement adaptations of the user.