3d prediction method for video coding

A method comprising:

• generating a 2D intra prediction based on one or more previously reconstructed pixels of a current frame, wherein the current frame represents a 3D scene;
• generating a 2D inter prediction based on one or more reconstructed previous frames;
• generating a Multi Focal Plane (MFP) prediction for the current frame based on a detected camera viewpoint change between a current camera viewpoint of the current frame and a previous camera viewpoint of a previous frame;
• determining a 2D intra prediction error between the 2D intra prediction and the current frame;
• determining a 2D inter prediction error between the 2D inter prediction and the current frame;
• determining an MFP prediction error between the MFP prediction and the current frame;
• selecting a MFP prediction mode based at least in part on the MFP prediction error being smaller than the 2D intra prediction error and the 2D inter prediction error;
• transmitting, to a receiver over a communication network, data indicating the MFP prediction mode is selected;
• and
• transmitting the detected camera viewpoint change.

A system comprising:

• memory;
• and
• control circuitry configured to:
• generate a 2D intra prediction based on one or more previously reconstructed pixels of a current frame, wherein the current frame is stored in the memory and represents a 3D scene;
• generate a 2D inter prediction based on one or more reconstructed previous frames;
• generate a Multi Focal Plane (MFP) prediction for the current frame based on a detected camera viewpoint change between a current camera viewpoint of the current frame and a previous camera viewpoint of a previous frame;
• determine a 2D intra prediction error between the 2D intra prediction and the current frame;
• determine a 2D inter prediction error between the 2D inter prediction and the current frame;
• determine an MFP prediction error between the MFP prediction and the current frame;
• select an MFP prediction mode based at least in part on the MFP prediction error being smaller than the 2D intra prediction error and the 2D inter prediction error;
• transmit, to a receiver over a communication network, data indicating the MFP prediction mode is selected;
• and
• transmit the detected camera viewpoint change.