Multi-Resolution Multi-View Video Rendering

A method for video rendering, the method comprising:

• receiving, from a source device, video data including multiple reference viewpoints;
• determining a target image plane corresponding to a target viewpoint,
• determining, within the target image plane, one or more target image regions,
• determining, for each target image region within the target image plane, a proxy image region, the proxy image region being larger than the corresponding target image region by a margin surrounding the corresponding target image region;
• determining, for each target image region within the target image plane, a plurality of reference pixels that fit within the corresponding proxy image region, from one or more of the multiple reference viewpoints;
• projecting, for each target image region within the target image plane, the plurality of reference pixels that fit within the corresponding proxy image region, from the one or more multiple reference viewpoints, to the target image region within the target image plane, producing a rendered target region from each target image region;
• and
• compositing one or more of the rendered target regions to create video rendering for the target image plane.

A device for video rendering, the device comprising:

• a memory;
• and
• an electronic processor configured to
• receive source content including multiple reference viewpoints,
• map the source content using a projective mapping technique,
• partition the mapped source content into a plurality of tiles,
• determine a subset of the plurality of regions for synthesis of a target view based on a proxy image region surrounding each target image region, and
• render the subset of the plurality of regions.