# US 2026/0101042 A1 · Progressive face video compression framework with adaptive visual tokens

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0101042 A1
- Document ID: US20260101042A1
- Status: Published application
- Kind: A1
- Application number: 19/325,131
- Filed: 2025-09-10
- Published: 2026-04-09
- Earliest claimed: 2024-10-09
- Assignees: Alibaba (China) Co., Ltd.
- Applicants: Alibaba (China) Co., Ltd.
- Inventors: Bolin CHEN; Yan YE; Jie CHEN; Ru-ling LIAO
- Web page: https://patentgrep.com/patent/US20260101042A1

## CPC

- H04N 19/139: Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
- H04N 19/172: the region being a picture, frame or field
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video encoding method includes: receiving a video sequence including a first key frame and one or more inter frames following the first key frame; generating a reconstructed key frame corresponding to the first key frame; transforming the reconstructed key frame and the one or more inter frames to visual tokens with different granularities; and encoding one or more token bitstreams including coded information for one or more of the visual tokens selected based on a data transmission bandwidth.

## Claims

### Claim 1

A video encoding method, comprising:
receiving a video sequence comprising a first key frame and one or more inter frames following the first key frame;
generating a reconstructed key frame corresponding to the first key frame;
transforming the reconstructed key frame and the one or more inter frames to a plurality of visual tokens with different granularities; and
encoding one or more token bitstreams comprising coded information for one or more of the plurality of visual tokens selected based on a data transmission bandwidth.

### Claim 2 (depends on 1)

The video encoding method of claim 1, further comprising:
extracting motion features from the reconstructed key frame and the one or more inter frames; and
transforming the motion features into the plurality of visual tokens with different granularities.

### Claim 3 (depends on 2)

The video encoding method of claim 2, wherein the motion features are two-dimensional, and transforming the motion features to the plurality of visual tokens comprises:
converting the motion features to a first one-dimensional token with a first size; and
sampling the first one-dimensional token to obtain a second one-dimensional token with a second size smaller than the first size.

### Claim 4 (depends on 2)

The video encoding method of claim 2, wherein extracting the motion features from the reconstructed key frame and the one or more inter frames comprises:
down-sampling the reconstructed key frame and the one or more inter frames by a scale factor to obtain down-sampled frames; and
processing the down-sampled frames using a convolutional neural network to obtain the motion features.

### Claim 5 (depends on 1)

The video encoding method of claim 1, wherein transforming the reconstructed key frame and the one or more inter frames to the plurality of visual tokens comprises:
sequentially obtaining the plurality of visual tokens with different sizes using a series of fully-connected (FC) layers.

### Claim 6 (depends on 1)

The video encoding method of claim 1, wherein the plurality of visual tokens comprise one-dimensional tokens with respective sizes of 256, 144, 64, and 16.

### Claim 7 (depends on 1)

The video encoding method of claim 1, further comprising:
encoding, by a Versatile Video Coding (VVC) encoder, an image bitstream comprising coded information for the first key frame, wherein the image bitstream is decodable to reconstruct the first key frame.

### Claim 8 (depends on 1)

The video encoding method of claim 1, wherein generating the reconstructed key frame corresponding to the first key frame comprises:
coding, by a Versatile Video Coding (VVC) encoder, the first key frame to generate coded information for the first key frame; and
generating the reconstructed key frame based on the coded information.

### Claim 9

A video decoding method, comprising:
receiving an image bitstream and one or more token bitstreams associated with a video sequence;
decoding the image bitstream to obtain a reconstructed key frame;
decoding the one or more token bitstreams to obtain one or more visual tokens, wherein a size of the one or more visual tokens being coded is selected based on a data transmission bandwidth; and
reconstructing the video sequence based on the one or more visual tokens and the reconstructed key frame.

### Claim 10 (depends on 9)

The video decoding method of claim 9, wherein reconstructing the video sequence based on the one or more visual tokens and the reconstructed key frame comprises:
extracting the reconstructed key frame to obtain motion features of the reconstructed key frame; and
transforming the one or more visual tokens into motion features of one or more inter frames following the reconstructed key frame.

### Claim 11 (depends on 10)

The video decoding method of claim 10, wherein the one or more visual tokens are one-dimensional, and the video decoding method further comprises:
converting the one or more visual tokens into one or more two-dimensional motion features.

### Claim 12 (depends on 11)

The video decoding method of claim 11, wherein converting the one or more visual tokens into the one or more two-dimensional motion features comprises:
applying one or more fully-connected (FC) layers, in response to the size of the one or more visual tokens.

### Claim 13 (depends on 10)

The video decoding method of claim 10, further comprising:
generating motion information and occlusion information based on the motion features of the reconstructed key frame and the motion features of the one or more inter frames; and
reconstructing the one or more inter frames based on the motion information, the occlusion information, and the reconstructed key frame.

### Claim 14 (depends on 13)

The video decoding method of claim 13, wherein obtaining the motion information and occlusion information comprises:
up-sampling the motion features;
calculating a difference between the motion features of the one or more inter frames and the motion features of the reconstructed key frame to obtain motion change information; and
processing the reconstructed key frame and the motion change information using a motion prediction network to obtain the motion information and the occlusion information.

### Claim 15 (depends on 9)

The video decoding method of claim 9, wherein the one or more token bitstreams are decodable to obtain one or more one-dimensional visual tokens with a size of 256, 144, 64, or 16.

### Claim 16

A method of storing one or more bitstreams, the method comprising:
generating one or more token bitstreams by:
receiving a video sequence comprising a first key frame and one or more inter frames following the first key frame;
generating a reconstructed key frame corresponding to the first key frame;
transforming the reconstructed key frame and the one or more inter frames to a plurality of visual tokens with different granularities; and
encoding one or more token bitstreams comprising coded information for one or more of the plurality of visual tokens selected based on a data transmission bandwidth; and
storing the one or more token bitstreams in a non-transitory computer-readable medium.

### Claim 17 (depends on 16)

The method according to claim 16, wherein generating the one or more token bitstreams further comprises:
extracting motion features from the reconstructed key frame and the one or more inter frames; and
transforming the motion features into the plurality of visual tokens with different granularities.

### Claim 18 (depends on 17)

The method according to claim 17, wherein the motion features are two-dimensional motion features, and transforming the motion features to the plurality of visual tokens comprises:
converting the motion features to a first one-dimensional token with a first size; and
sampling the first one-dimensional token to obtain a second one-dimensional token with a second size smaller than the first size.

### Claim 19 (depends on 17)

The method according to claim 17, wherein extracting the motion features from the reconstructed key frame and the one or more inter frames comprises:
down-sampling the reconstructed key frame and the one or more inter frames by a scale factor to obtain down-sampled frames; and
processing the down-sampled frames using a convolutional neural network to obtain the motion features.

### Claim 20 (depends on 16)

The method according to claim 16, further comprising:
encoding, by a Versatile Video Coding (VVC) encoder, an image bitstream comprising coded information for the first key frame, wherein the image bitstream is decodable to reconstruct the first key frame; and
storing the image bitstream in the non-transitory computer-readable medium.
