Pose aggregation for multi-view temporal video alignment
AssigneeDolby Laboratories Licensing Corporation
InventorsFabien Paul DELATTRE, Tsung-Wei HUANG, Guan-Ming SU
Life of this patent
Estimating the term…
Loading patent…
AssigneeDolby Laboratories Licensing Corporation
InventorsFabien Paul DELATTRE, Tsung-Wei HUANG, Guan-Ming SU
Estimating the term…
A system and method for temporally aligning multiple videos captured from different viewpoints. The system includes a 2D pose extractor that extracts joint coordinates of deformable objects from video frames, a view-invariant pose encoder that generates view-invariant descriptors from the joint coordinates, a frame aggregator that combines multiple descriptors from each frame into a single frame-level descriptor, and a temporal aggregator that incorporates motion information from adjacent frames. The system determines temporal alignment between videos by comparing frame descriptors in the frequency domain using an alignment algorithm. The method supports videos captured from arbitrary viewpoints without requiring metadata or audio information, handles varying numbers of subjects in different frames, operates efficiently through frequency domain processing, and can be extended to align three or more videos while maintaining temporal consistency.
A method for temporally aligning multiple videos, comprising:
A system (100) for video alignment, comprising:
A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to:
A method of training a video alignment system, comprising:
Dependencies are inferred from the claim text.