Immersive video conference system

A method for generating a view, comprising:

• determining a target depth map associated with a virtual viewpoint based on a set of images and a set of depth maps corresponding to the set of images, the set of images being captured by a set of image devices associated with a set of image capture viewpoints;
• determining depth difference information or angle difference information associated with the set of image capture viewpoints;
• wherein the depth difference information indicates a difference between depths of pixels in projected depth maps corresponding to respective image capture viewpoints and depths of corresponding pixels in the target depth map, the projected depth map being determined by projecting the target depth map to the corresponding image capture viewpoint, and
• the angle difference information indicates a difference between a first angle associated with the corresponding image capture viewpoint and a second angle associated with the virtual viewpoint, the first angle is determined based on a surface point corresponding to a pixel in the target depth map and a corresponding image capture viewpoint, and the second angle is determined based on the surface point and the virtual viewpoint;
• determining a set of blending weights associated with the set of image capture viewpoints based on the depth difference information or the angle difference information;
• and
• blending a set of projected images based on the set of blending weights, to determine a target view corresponding to the virtual viewpoint, the set of projected images being generated by projecting the set of images to the virtual viewpoint.

A video conference system, comprising:

• at least two conference units, each of which comprises:
• a set of image capture devices configured to capture images of participants of a video conference, the participants being in a physical conference space;
• and
• a display device disposed in the physical conference space and configured to provide the participants with immersive conference images, the immersive conference images including a view of at least one other participant of the video conference;
• wherein the at least two physical conference spaces of the at least two conference units are virtualized into at least two sub-virtual spaces which are organized into virtual conference spaces for the video conference in accordance with a layout indicated by a conference mode of the video conference.