Progressive face video compression framework with adaptive visual tokens
AssigneeAlibaba (China) Co., Ltd.
InventorsBolin CHEN, Yan YE, Jie CHEN, Ru-ling LIAO
Life of this patent
Estimating the term…
Abstract
A video encoding method includes: receiving a video sequence including a first key frame and one or more inter frames following the first key frame; generating a reconstructed key frame corresponding to the first key frame; transforming the reconstructed key frame and the one or more inter frames to visual tokens with different granularities; and encoding one or more token bitstreams including coded information for one or more of the visual tokens selected based on a data transmission bandwidth.
Claims20
A video encoding method, comprising:
- receiving a video sequence comprising a first key frame and one or more inter frames following the first key frame;
- generating a reconstructed key frame corresponding to the first key frame;
- transforming the reconstructed key frame and the one or more inter frames to a plurality of visual tokens with different granularities;
- and
- encoding one or more token bitstreams comprising coded information for one or more of the plurality of visual tokens selected based on a data transmission bandwidth.
A video decoding method, comprising:
- receiving an image bitstream and one or more token bitstreams associated with a video sequence;
- decoding the image bitstream to obtain a reconstructed key frame;
- decoding the one or more token bitstreams to obtain one or more visual tokens, wherein a size of the one or more visual tokens being coded is selected based on a data transmission bandwidth;
- and
- reconstructing the video sequence based on the one or more visual tokens and the reconstructed key frame.
A method of storing one or more bitstreams, the method comprising:
- generating one or more token bitstreams by:
- receiving a video sequence comprising a first key frame and one or more inter frames following the first key frame;
- generating a reconstructed key frame corresponding to the first key frame;
- transforming the reconstructed key frame and the one or more inter frames to a plurality of visual tokens with different granularities;
- and
- encoding one or more token bitstreams comprising coded information for one or more of the plurality of visual tokens selected based on a data transmission bandwidth;
- and
- storing the one or more token bitstreams in a non-transitory computer-readable medium.
Dependencies are inferred from the claim text.