Methods and apparatuses for immersive videoconference

Abstract

Methods and apparatuses for encoding/decoding semantic description data representative of a 3D geometric and photometric face model for immersive telepresence are provided. In an embodiment, video data comprising a face of a user is encoded by extracting semantic description data representative of a 3D geometric and photometric model of the face of the user. In another embodiment, an immersive video is decoded from the semantic description data by, determining a head pose of the face of a remote user in an immersive video; determining a parametric model of a lighting environment of the immersive video; synthesizing the face of the remote user with the head pose and the parametric model; and generating a modified immersive video comprising an image of the synthesized face of the user in the immersive video. In an embodiment, the generation of the immersive video is made recurrent by taking at input the synthesized face and the immersive video at a previous frame.

Dependencies are inferred from the claim text.