# US 2026/0101041 A1 · Methods for multi-granularity temporal trajectory representations for generative video compression

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0101041 A1
- Document ID: US20260101041A1
- Status: Published application
- Kind: A1
- Application number: 19/319,319
- Filed: 2025-09-04
- Published: 2026-04-09
- Earliest claimed: 2024-10-09
- Assignees: Alibaba (China) Co., Ltd.
- Applicants: Alibaba (China) Co., Ltd.
- Inventors: Shanzhi YIN; Bolin CHEN; Yan YE
- Web page: https://patentgrep.com/patent/US20260101041A1

## CPC

- H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/172: the region being a picture, frame or field
- H04N 19/577: Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video decoding method includes decoding an image bitstream associated with a video sequence, wherein the decoding of the image bitstream reconstructs a key reference frame; factorizing the reconstructed key reference frame into a key frame latent feature and a first group of compact motion vectors associated with the reconstructed key reference frame; decoding a feature bitstream associated with the video sequence to obtain a second group of compact motion vectors associated with an inter frame; transforming, based on the first group and second group of compact motion vectors, the key frame latent feature into a first fine-grained motion field for the reconstructed key reference frame and a second fine-grained motion field for the inter frame; predicting a dense motion based on the first and second fine-grained motion fields; and generating the inter frame based on the dense motion and the reconstructed key reference frame.

## Claims

### Claim 1

A video decoding method, comprising:
decoding an image bitstream associated with a video sequence, wherein the decoding of the image bitstream reconstructs a key reference frame;
factorizing the reconstructed key reference frame into a key frame latent feature and a first group of compact motion vectors associated with the reconstructed key reference frame;
decoding a feature bitstream associated with the video sequence to obtain a second group of compact motion vectors associated with an inter frame;
transforming, based on the first group and second group of compact motion vectors, the key frame latent feature into a first fine-grained motion field for the reconstructed key reference frame and a second fine-grained motion field for the inter frame;
predicting a dense motion based on the first and second fine-grained motion fields; and
generating the inter frame based on the dense motion and the reconstructed key reference frame.

### Claim 2 (depends on 1)

The method according to claim 1, wherein factorizing the reconstructed key reference frame into the key frame latent feature and the first group of compact motion vectors further comprises:
downsampling the reconstructed key reference frame;
feeding the downsampled reconstructed key reference frame to a feature extractor to obtain the key frame latent feature; and
feeding the key frame latent feature into to a weight predictor and a bias predictor respectively to obtain the first group of compact motion vectors, wherein the first group of compact motion vectors comprises a key weight vector and a key bias vector.

### Claim 3 (depends on 2)

The method according to claim 2, wherein a second group of compact motion vectors comprises an inter weight vector and an inter bias vector.

### Claim 4 (depends on 3)

The method according to claim 3, wherein transforming, based on the first and second group of compact motion vectors, the key frame latent feature into the first fine-grained motion field for the reconstructed key frame and the second fine-grained motion field for the inter frame further comprises:
modulation the key frame latent feature with the key weight vector and the key bias vector to generate the first fine-grained motion field for the reconstructed key frame; and
modulation the key frame latent feature with the inter weight vector and the inter bias vector to generate the second fine-grained motion field for the inter frame.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the video sequence comprises a plurality of inter frames, and a dimension of the first fine-grained motion field and the second fine-grained motion field is based on a number of the inter frames.

### Claim 6 (depends on 5)

The method according to claim 5, wherein a dimension of the first group of compact vectors and the second group of compact vectors is based on the number of the inter frames.

### Claim 7

A video encoding method, comprising:
encoding an image bitstream comprising coded information for a key reference frame of a video sequence, wherein the coded information of the image bitstream is factorizable into a key frame latent feature and a first group of compact motion vectors associated with a reconstructed key reference frame; and
encoding a feature bitstream comprising coded information for an inter frame of the video sequence, wherein the coded information of the feature bitstream comprises a second group of compact motion vectors associated with the inter frame;
wherein a first fine-grained motion field for the reconstructed key reference frame and a second fine-grained motion field for the inter frame are generated by transforming the key frame latent feature based on the first group and second group compact motion vectors;
wherein the first and second fine-grained motion fields are used for predicting a dense motion; and
wherein the dense motion is used for generating the inter frame.

### Claim 8 (depends on 7)

The method according to claim 7, wherein encoding the feature bitstream comprising coded information for the inter frame further comprises:
downsampling the inter frame;
feeding the downsampled inter frame to a feature extractor to obtain an inter frame latent feature;
feeding the inter frame latent feature into to a weight predictor and a bias predictor respectively to obtain the second group of compact motion vectors, wherein the second group of compact motion vectors comprises an inter weight vector and an inter bias vector; and
encoding the second group of compact motion vectors.

### Claim 9 (depends on 7)

The method according to claim 7, wherein the video sequence comprises a plurality of inter frames, and a dimension of the first fine-grained motion field and the second fine-grained motion field is based on a number of the inter frames.

### Claim 10 (depends on 9)

The method according to claim 9, wherein a dimension of the first group of compact vectors and the second group of compact vectors is based on the number of the inter frames.

### Claim 11

A method for signaling a bitstream, the method comprising:
receiving a video sequence;
encoding the video sequence by:
encoding an image bitstream comprising coded information for a key reference frame of a video sequence, wherein the coded information of the image bitstream is factorizable into a key frame latent feature and a first group of compact motion vectors associated with a reconstructed key reference frame; and
encoding a feature bitstream comprising coded information for an inter frame of the video sequence, wherein the coded information of the feature bitstream comprises a second group of compact motion vectors associated with the inter frame;
wherein a first fine-grained motion field for the reconstructed key reference frame and a second fine-grained motion field for the inter frame are generated by transforming the key frame latent feature based on the first group and second group compact motion vectors;
wherein the first and second fine-grained motion fields are used for predicting a dense motion; and
wherein the dense motion is used for generating the inter frame; and
signaling the image bitstream and the feature bitstream that are generated based on the encoding.

### Claim 12 (depends on 11)

The method according to claim 11, wherein encoding the feature bitstream comprising coded information for the inter frame further comprises:
downsampling the inter frame;
feeding the downsampled inter frame to a feature extractor to obtain an inter frame latent feature; and
feeding the inter frame latent feature into to a weight predictor and a bias predictor respectively to obtain the second group of compact motion vectors, wherein the second group of compact motion vectors comprises an inter weight vector and an inter bias vector.

### Claim 13 (depends on 11)

The method according to claim 11, wherein the video sequence comprises a plurality of inter frames, and a dimension of the first fine-grained motion field and the second fine-grained motion field is based on a number of the inter frames.

### Claim 14 (depends on 13)

The method according to claim 13, wherein a dimension of the first group of compact vectors and the second group of compact vectors is based on the number of the inter frames.
