Skeleton-based dynamic point cloud estimation system for sequence compression
AssigneeKwangwoon University Industry-Academic Collaboration Foundation
InventorsYoung Ho SEO, Kyung Jin KIM
Life of this patent
Estimating the term…
Abstract
Disclosed is a skeleton-based dynamic point cloud estimation system for sequence compression, capable of generating a three-dimensional skeleton and a motion vector thereof from a group of point cloud frames to estimate a point cloud of a next frame, and compressing a point cloud sequence by obtaining a residual between the estimated point cloud and an original point cloud. Since the point cloud is estimated by using the motion vector of the skeleton, and the sequence is compressed by using a difference from an original value as the residual, an amount of point clouds to be input to a compressor is significantly reduced, so that compression efficiency is improved.
Claims12
A skeleton-based dynamic point cloud estimation system for sequence compression, the skeleton-based dynamic point cloud estimation system comprising:
- a frame acquisition unit for acquiring consecutive frames of a multiview color-depth video;
- a point cloud acquisition unit for acquiring a three-dimensional point cloud from a multiview frame;
- a skeleton extraction unit for extracting a three-dimensional skeleton from the three-dimensional point cloud;
- a mesh conversion unit for converting the three-dimensional point cloud into a mesh;
- a mesh rigging unit for rigging, when a frame is a key frame, a mesh of the frame to a three-dimensional skeleton of the frame;
- a motion extraction unit for extracting, when a frame is a non-key frame, a motion vector from three-dimensional skeletons of the frame and the key frame;
- a mesh deformation unit for deforming a mesh of the key frame by using the motion vector;
- and
- a residual calculation unit for calculating a residual between a mesh of the non-key frame and the deformed mesh.
Dependencies are inferred from the claim text.