Signaling displacement data for video-based mesh coding
AssigneeApple Inc.
InventorsJungsun Kim, Alexandros Tourapis, Khaled Mammou
Life of this patent
Estimating the term…
Abstract
A system comprises an encoder configured to compress and encode data for a three-dimensional mesh. To compress the three-dimensional mesh, the encoder determines displacements to be applied to sub-division locations of a base mesh. The displacement values may be signaled in their own sub-bitstream, e.g., a dedicated displacement data sub-bitstream, or may be signaled, at least in part, in an atlas data sub-bitstream that includes patch data. In some embodiments, the displacements may also be signaled, at least in part, in a video sub-bitstream or in a base-mesh sub-bitstream.
Claims20
A non-transitory, computer-readable, storage medium storing program instructions, that when executed using one or more computing devices, cause the one or more computing devices to:
- compress visual volumetric content using a dynamic mesh compression algorithm, wherein compressing the visual volumetric comprises:
- compressing a base mesh to generate a base mesh sub-bitstream to be included in a bitstream for the compressed visual volumetric content;
- determining displacement information for displacements that are to be applied to sub-division locations of the base mesh;
- and
- compressing attribute information, wherein the compressed attribute information is to be included in a video sub-bitstream of the bitstream for the compressed visual volumetric content;
- and
- provide the bitstream for the compressed visual volumetric content, wherein the displacement information is signaled, at least in part, in the bitstream in a sub-bitstream other than the video sub-bitstream, and wherein the sub-bitstream used to signal the displacement information uses a syntax that is independent of other syntaxes used for other ones of the sub-bitstreams of the bitstream.
A non-transitory, computer-readable, storage medium storing program instructions, that when executed using one or more computing devices, cause the one or more computing devices to:
- receive a bitstream representing a compressed version of visual volumetric content, the bitstream comprising:
- a base mesh sub-bitstream;
- a video sub-bitstream;
- and
- displacement information for displacements that are to be applied to sub-division locations of a base mesh signaled in the base mesh sub-bitstream,
- wherein the displacement information is signaled, at least in part, in the bitstream in a sub-bitstream other than the video sub-bitstream, and wherein the sub-bitstream used to signal the displacement information uses a syntax that is independent of other syntaxes used for other ones of the sub-bitstreams of the bitstream;
- and
- reconstruct a mesh of the visual volumetric content, wherein to reconstruct the mesh the program instructions cause the one or more computing devices to:
- sub-divide edges of the base mesh to generate the sub-division locations;
- parse the bitstream to identify the displacement information;
- and
- apply the displacements indicated in the displacement information to the sub-division locations of the base mesh.
A device, comprising:
- a memory storing program instructions;
- and
- one or more processors, wherein the program instructions, when executed on or across the one or more processors, cause the one or more processors to:
- receive a bitstream representing a compressed version of visual volumetric content, the bitstream comprising:
- a base mesh sub-bitstream;
- a video sub-bitstream;
- and
- displacement information for displacements that are to be applied to sub-division locations of a base mesh signaled in the base mesh sub-bitstream,
- wherein the displacement information is signaled, at least in part, in the bitstream in a sub-bitstream other than the video sub-bitstream, and wherein the sub-bitstream used to signal the displacement information uses a syntax that is independent of other syntaxes used for other ones of the sub-bitstreams of the bitstream;
- reconstruct a mesh of the visual volumetric content, wherein reconstructing the mesh comprises:
- sub-dividing edges of the base mesh to generate the sub-division locations;
- parsing the bitstream to identify the displacement information;
- and
- applying the displace indicated in the displacement information to the sub-division locations of the base mesh.
Dependencies are inferred from the claim text.