# US 2026/0101054 A1 · Multivariate rate control for transcoding video content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0101054 A1
- Document ID: US20260101054A1
- Status: Published application
- Kind: A1
- Application number: 19/416,058
- Filed: 2025-12-11
- Published: 2026-04-09
- Earliest claimed: 2024-02-13
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Sam John; Balineedu Adsumilli; Akshay Gadde
- Web page: https://patentgrep.com/patent/US20260101054A1

## CPC

- H04N 19/40: using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence)
- H04N 19/147: according to rate distortion criteria (rate-distortion as a criterion for motion estimation H04N19/567)
- H04N 19/179: the unit being a scene or a shot
- H04N 19/184: the unit being bits, e.g. of the compressed video stream
- H04N 19/192: the adaptation method, adaptation tool or adaptation type being iterative or recursive
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A learning model is trained for rate-distortion behavior prediction against a corpus of a video hosting platform and used to determine optimal bitrate allocations for video data given video content complexity across the corpus of the video hosting platform. Complexity features of the video data are processed using the learning model to determine a rate-distortion cluster prediction for the video data, and transcoding parameters for transcoding the video data are selected based on that prediction. The rate-distortion clusters are modeled during the training of the learning model, such as based on rate-distortion curves of video data of the corpus of the video hosting platform and based on classifications of such video data. This approach minimizes total corpus egress and/or storage while further maintaining uniformity in the delivered quality of videos by the video hosting platform.

## Claims

### Claim 1

A method, comprising:
receiving, by a video hosting platform, an input video stream;
predicting, using a learning model trained for rate-distortion behavior prediction based on videos of a corpus of the video hosting platform, a rate-distortion behavior of video data of the input video stream based on complexity features of the video data;
determining a bitrate for transcoding the video data based on the predicted rate-distortion behavior of the video data; and
transcoding the video data using transcoding parameters corresponding to the bitrate.

### Claim 2 (depends on 1)

The method of claim 1, comprising:
determining the complexity features based on an encoder pass log associated with the input video stream.

### Claim 3 (depends on 2)

The method of claim 2, wherein the encoder pass log is based on a first pass encoding, the method comprising:
verifying, before a second pass encoding, a selection of the transcoding parameters according to one or more transcoder constraints.

### Claim 4 (depends on 1)

The method of claim 1, comprising:
determining the complexity features based on a feature map generated for the input video stream.

### Claim 5 (depends on 4)

The method of claim 4, wherein the feature map is one of a two-dimensional map of spatial features of the video data or a two-dimensional optimal flow of temporal features generated between video frames of the video data.

### Claim 6 (depends on 1)

The method of claim 1, wherein predicting the rate-distortion behavior of the video data based on the complexity features comprises:
determining a rate-distortion classification of the video data based on the complexity features; and
determining that the rate-distortion classification of the video data corresponds to a rate-distortion classification of a plurality of rate-distortion classifications of the corpus.

### Claim 7 (depends on 6)

The method of claim 6, wherein determining the bitrate for transcoding the video data based on the predicted rate-distortion behavior of the video data comprises:
determining the bitrate based on one or more quality constraints associated with an operating point of a rate-distortion curve corresponding to the rate-distortion classification of the plurality of rate-distortion classifications of the corpus.

### Claim 8 (depends on 7)

The method of claim 7, comprising:
selecting the transcoding parameters based on the operating point.

### Claim 9 (depends on 7)

The method of claim 7, wherein the one or more quality constraints indicate that a total distortion for coding the video data with a given bitrate is less than or equal to an average distortion across the corpus and that a maximum distortion for coding the video data with the given bitrate is less than a maximum distortion allowed across the corpus.

### Claim 10 (depends on 1)

The method of claim 1, wherein the video data corresponds to one or more video chunks of the input video stream.

### Claim 11 (depends on 1)

The method of claim 1, wherein the video data corresponds to one or more video frames of the input video stream or to one or more video blocks of the input video stream.

### Claim 12

An apparatus, comprising:
one or more memories; and
one or more processors configured to execute instructions stored in the one or more memories to:
determining a rate-distortion classification of video data of an input video stream for a video hosting platform to transcode based on complexity features of the video data;
predicting, using a learning model trained for rate-distortion behavior prediction based on videos of a corpus of the video hosting platform, a rate-distortion behavior of the video data based on the rate-distortion classification of the video data;
determining a bitrate for transcoding the video data based on the predicted rate-distortion behavior of the video data; and
transcoding the video data using transcoding parameters corresponding to the bitrate.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein determining the rate-distortion classification of the video data based on the complexity features comprises:
determining the complexity features based on an encoder pass log associated with the input video stream.

### Claim 14 (depends on 12)

The apparatus of claim 12, wherein determining the rate-distortion classification of the video data based on the complexity features comprises:
determining the complexity features based on a feature map generated for the input video stream.

### Claim 15 (depends on 12)

The apparatus of claim 12, wherein predicting the rate-distortion behavior of the video data based on the rate-distortion classification of the video data comprises:
determining that the rate-distortion classification of the video data corresponds to a rate-distortion classification of a plurality of rate-distortion classifications of the corpus.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein determining the bitrate for transcoding the video data based on the predicted rate-distortion behavior of the video data comprises:
determining the bitrate based on one or more quality constraints associated with an operating point of a rate-distortion curve corresponding to the rate-distortion classification of the plurality of rate-distortion classifications of the corpus.

### Claim 17

A method, comprising:
predicting, based on complexity features of video data of an input video stream to transcode, a rate-distortion behavior of the video data using a learning model trained based on videos of a corpus of a video hosting platform; and
transcoding the video data using transcoding parameters corresponding to a bitrate that is based on the predicted rate-distortion behavior of the video data.

### Claim 18 (depends on 17)

The method of claim 17, wherein predicting the rate-distortion behavior of the video data using the learning model comprises:
determining a rate-distortion classification of the video data based on the complexity features; and
determining that the rate-distortion classification of the video data corresponds to a rate-distortion classification of a plurality of rate-distortion classifications of the corpus.

### Claim 19 (depends on 18)

The method of claim 18, comprising:
determining the bitrate based on the rate-distortion classification of the plurality of rate-distortion classifications of the corpus.

### Claim 20 (depends on 18)

The method of claim 18, comprising:
selecting the transcoding parameters based on an operating point of a rate-distortion curve corresponding to the rate-distortion classification of the plurality of rate-distortion classifications of the corpus.
