Dynamic local temporal-consistent textured mesh compression
AssigneeJJK Holdings, LLC
InventorsZhong Li, Jason Chieh-Sheng Yang
Life of this patent
Estimating the term…
Abstract
Mesh-based raw video data (or 3D video data) includes a sequence of frames, each of which includes geometry data (e.g., triangle meshes or other meshes) and texture map(s) defining one or more objects. The raw 3D video data is segmented based on consistent mesh topology across frames. For each segment, a consistent mesh sequence (CMS) is defined and a consistent texture atlas (CTA) is generated. The CMS and CTA for each segment are compressed and stored as compressed data files. The compressed data files can be decompressed and used to render displayable images.
Claims16
A computer-implemented method for compressing data, the method comprising:
- receiving raw three-dimensional (3D) video data descriptive of a sequence of frames, wherein the raw 3D video data for a frame includes a mesh and a texture map associated with the mesh;
- determining, from the raw 3D video data, a first segment of raw 3D video data comprising a first set of frames, wherein the first set of frames comprise a first set of vertices modifying the first set of vertices to generate a second set of vertices for the first set of frames, wherein a quantity of vertices in the second set of vertices is less than a quantity of vertices in the first set of vertices;
- constructing a consistent texture atlas for the first segment from the texture map for at least one frame in the first set of frames;
- compressing the first set of frames comprising the second set of vertices;
- compressing the consistent texture atlas;
- and
- outputting, as compressed data, the compressed first set of frames and the compressed consistent texture atlas, wherein a quantity of vertices in the second set of vertices is determined based at least in part on a target bitrate for streaming the first segment.
A non-transitory computer-readable storage medium having stored thereon instructions for causing at least one computer system to execute the instructions comprising:
- receiving raw three-dimensional (3D) video data descriptive of a sequence of frames, wherein the raw 3D video data for a frame includes a mesh and a texture map associated with the mesh;
- determining, from the raw 3D video data, a first segment of raw 3D video data comprising a first set of frames, wherein the first set of frames comprise a first set of vertices modifying the first set of vertices to generate a second set of vertices for the first set of frames;
- constructing a consistent texture atlas for the first segment from the texture map for at least one frame in the first set of frames;
- compressing the first set of frames comprising the second set of vertices;
- compressing the consistent texture atlas;
- outputting, as compressed data, the compressed first set of frames and the compressed consistent texture atlas;
- modifying the first set of vertices to generate a third set of vertices being different than the second set of vertices, wherein the quantity of vertices within the second set of vertices is greater than a quantity of vertices within the third set of vertices;
- compressing the first set of frames comprising the first set of vertices to generate a first compressed consistent mesh sequence;
- compressing the first set of frames comprising the second set of vertices to generate a second compressed consistent mesh sequence;
- and
- compressing the first set of frames comprising the third set of vertices to generate a third compressed third consistent mesh sequence.
A system for compressing data, comprising:
- one or more processors;
- and
- a memory coupled with the one or more processors, the memory configured to store instructions that when executed by the one or more processors cause the one or more processors to:
- receive raw three-dimensional (3D) video data descriptive of a sequence of frames, wherein the raw 3D video data for a frame includes a mesh and a texture map associated with the mesh;
- determine, from the raw 3D video data, a first segment of raw 3D video data comprising a first set of frames, wherein the first set of frames comprise a first set of vertices modify the first set of vertices to generate a second set of vertices for the first set of frames;
- construct a consistent texture atlas for the first segment from the texture map for at least one frame in the first set of frames;
- compress the first set of frames comprising the second set of vertices;
- compress the consistent texture atlas;
- and
- output, as compressed data, the compressed first set of frames and the compressed consistent texture atlas, wherein a quantity of vertices in the second set of vertices is determined based at least in part on a target bitrate for streaming the first segment.
Dependencies are inferred from the claim text.