Method and apparatus for encoding multi plane image based volumetric video

An apparatus for encoding a multi-plane image (MPI)-based volumetric video, the apparatus comprising:

• at least one processor;
• and
• at least one memory operably connected to the at least one processor and storing instructions that, when executed by the one or more processors, cause the apparatus to perform operations comprising:
• generating an MPI for each frame according to time change from a plurality of multi-viewpoint images;
• identifying a dynamic region and a static region within the MPI for each frame;
• generating a first atlas based only on the dynamic region and a second atlas based only on the static region;
• and
• encoding the first atlas and the second atlas to generate a bitstream, respectively,
• wherein, for generating the first atlas and the second atlas, a transform is, respectively, applied to color values that change according to viewpoint directions to derive transform coefficients.

At least one non-transitory computer-readable medium storing at least one instruction, wherein the at least one instruction executable by at least one processor controls an apparatus for encoding a multi-plane image (MPI)-based volumetric video to:

• generate an MPI for each frame according to time change from a plurality of multi-viewpoint images;
• identify a dynamic region and a static region within the MPI for each frame;
• generate a first atlas based only on the dynamic region and a second atlas based only on the static region;
• and
• encode the first atlas and the second atlas to generate a bitstream, respectively,
• wherein, for generating the first atlas and the second atlas, a transform is, respectively, applied to color values that change according to viewpoint directions to derive transform coefficients.