# US 12,003,763 B2 · Per-title encoding using spatial and temporal resolution downscaling

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,003,763 B2
- Document ID: US12003763B2
- Status: Granted
- Kind: B2
- Application number: 17/853,549
- Filed: 2022-06-29
- Published: 2023-01-05
- Granted: 2024-06-04
- Earliest claimed: 2021-07-02
- Assignees: Bitmovin, Inc.
- Applicants: Bitmovin, Inc.
- Inventors: Hadi Amirpour; Christian Timmerer
- Web page: https://patentgrep.com/patent/US12003763B2

## CPC

- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/146: Data rate or code amount at the encoder output
- H04N 19/154: Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147)
- H04N 19/172: the region being a picture, frame or field
- H04N 19/31: in the temporal domain
- H04N 19/33: in the spatial domain
- H04N 19/587: involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
- H04N 19/61: in combination with predictive coding
- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N 21/234363: {by altering the spatial resolution, e.g. for clients with a lower screen resolution}
- H04N 21/234381: {by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping}
- H04N 21/23439: {for generating different versions}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Techniques relating to per-title encoding using spatial and temporal resolution downscaling is disclosed. A method for per-title encoding includes receiving a video input comprised of video segments, spatially downscaling the video input, temporally downscaling the video input, encoding the video input to generate an encoded video, then temporally and spatially upscaling the encoded video. Spatially downscaling may include reducing a resolution of the video input, and temporally downscaling may include reducing a framerate of the video input. Objective metrics for the upscaled encoded video show improved quality over conventional methods.

## Claims

### Claim 1

A method for per-title encoding comprising:
receiving a video input comprising a plurality of video segments;
spatially downscaling the video input to generate a first downscaled representation of the video input;
temporally downscaling the first downscaled representation of the video input to generate a second downscaled representation of the video input;
encoding the second downscaled representation of the video input to generate an encoded video, wherein the encoding is performed for a set of bitrates according to a beneficial spatial resolution and a beneficial framerate, the beneficial spatial resolution and the beneficial framerate corresponding to a convex hull;
temporally upscaling the encoded video to generate a first upscaled encoded video; and
spatially upscaling the first upscaled encoded video to generate a second upscaled encoded video.

### Claim 2 (depends on 1)

The method of claim 1, wherein the spatially downscaling the video input comprises reducing the resolution of the video input such that the first downscaled representation of the video input has a lower resolution than the video input.

### Claim 3 (depends on 2)

The method of claim 2, wherein reducing the resolution of the video input comprises reducing the resolution of each of the plurality of video segments.

### Claim 4 (depends on 1)

The method of claim 1, wherein the temporally downscaling the first downscaled representation of the video input comprises reducing the number of frames in the first downscaled representation such that the second downscaled representation has fewer frames than the video input.

### Claim 5 (depends on 4)

The method of claim 4, wherein reducing the number of frames in the first downscaled representation of the video input comprises reducing the number of frames of each of the plurality of video segments.

### Claim 6 (depends on 1)

The method of claim 1, wherein the temporally upscaling the encoded video comprises duplicating frames.

### Claim 7 (depends on 1)

The method of claim 1, wherein the temporally upscaling the encoded video comprises frame averaging.

### Claim 8 (depends on 1)

The method of claim 1, wherein the temporally upscaling the encoded video comprises video interpolation.

### Claim 9 (depends on 1)

The method of claim 1, wherein the temporally upscaling the encoded video comprises bicubic interpolation.

### Claim 10 (depends on 1)

The method of claim 1, wherein the first upscaled encoded video has the same number of frames as the video input.

### Claim 11 (depends on 1)

The method of claim 1, wherein the second upscaled encoded video has the same resolution as the video input.

### Claim 12 (depends on 1)

The method of claim 1, further comprising calculating an objective metric using the second upscaled encoded video.

### Claim 13 (depends on 12)

The method of claim 12, wherein the objective metric comprises a peak signal-to-noise ratio (PSNR).

### Claim 14 (depends on 12)

The method of claim 12, wherein the objective metric comprises a video multimethod assessment fusion (VMAF).

### Claim 15 (depends on 1)

The method of claim 1, wherein the encoding is performed according to an H.26x standard.

### Claim 16 (depends on 1)

The method of claim 1, wherein the encoded video comprises an uncompressed encoding.

### Claim 17

A system for per-title encoding comprising:
a memory comprising non-transitory computer-readable storage medium configured to store a plurality of video segments and data associated with the plurality of video segments;
one or more processors configured to execute instructions stored on the memory to:
receive a video input comprising the plurality of video segments,
spatially downscale the video input to generate a first downscaled representation of the video input,
temporally downscale the first downscaled representation of the video input to generate a second downscaled representation of the video input,
encode the second downscaled representation of the video input to generate an encoded video, wherein the encoding is performed for a set of bitrates according to a beneficial spatial resolution and a beneficial framerate, the beneficial spatial resolution and the beneficial framerate corresponding to a convex hull,
temporally upscale the encoded video to generate a first upscaled encoded video, and
spatially upscale the first upscaled encoded video to generate a second upscaled encoded video.

### Claim 18 (depends on 17)

The system of claim 17, wherein the data associated with the plurality of video segments comprises a spatial resolution.

### Claim 19 (depends on 17)

The system of claim 17, wherein the data associated with the plurality of video segments comprises a temporal resolution including a framerate.

### Claim 20 (depends on 17)

The system of claim 17, wherein the data associated with the plurality of video segments comprises an objective metric.