Virtual viewpoint synthesis method, electronic apparatus, and computer readable medium

A virtual viewpoint synthesis method, comprising:

• Pre-processing a depth image with zero parallax corresponding to an original image to obtain a processed depth image;
• generating virtual viewpoint images corresponding to a plurality of virtual viewpoints respectively according to the processed depth image and the original image;
• and
• filling holes in the virtual viewpoint images to generate a plurality of filled virtual viewpoint images,
• wherein the pre-processing the depth image with zero parallax corresponding to the original image to obtain the processed depth image comprises:
• determining edge pixels in the depth image with zero parallax according to gradients of pixels in the depth image with zero parallax in a row direction;
• determining n pixels adjacent to the edge pixels in the row direction as target pixels;
• and
• adjusting a depth value of each target pixel according to a maximum depth value of preset neighborhoods corresponding to the target pixels,
• the filling the holes in the virtual viewpoint images and generating the plurality of filled virtual viewpoint images comprises:
• traversing all pixels of a background area in a target virtual viewpoint image to determine a hole of the background area, wherein the target virtual viewpoint image is any one of the virtual viewpoint images, and depth values corresponding to all pixels of the background area are less than or equal to a preset depth value threshold;
• and
• filling, for any hole in the background area, the hole according to pixel information of at least part of pixels adjacent to the hole in the row direction,
• the filling, for any hole in the background area, the hole based on the pixel information of at least part of pixels adjacent to the hole in the row direction comprises:
• filling, for a row pixel corresponding to any row in the hole, the row pixel according to pixel information of two pixels which are closest to the row pixel in the row direction, and
• wherein the filling, for the row pixel corresponding to any row in the hole, the row pixel according to pixel information of two pixels which are closest to the row pixel in the row direction comprises:
• in response to that the two pixels belong to a same parallax plane, filling the row pixel by a linear interpolation according to the pixel information of the two pixels;
• and
• in response to that the two pixels do not belong to the same parallax plane, filling the row pixel according to the pixel information of one of the two pixels with a minimum depth value.