# US 2025/0097410 A1 · Efficient interframe mode search for av1 encoding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0097410 A1
- Document ID: US20250097410A1
- Status: Published application
- Kind: A1
- Application number: 18/467,914
- Filed: 2023-09-15
- Published: 2025-03-20
- Earliest claimed: 2023-09-15
- Assignees: Meta Platforms, Inc.
- Applicants: Meta Platforms, Inc.
- Inventors: Prasanth Jampani; Jatinder Singh; Yunqing Chen; Junqiang Lan; Hsiao-Chiang Chuang
- Web page: https://patentgrep.com/patent/US20250097410A1

## CPC

- H04N 19/109: among a plurality of temporal predictive coding modes
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/139: Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
- H04N 19/147: according to rate distortion criteria (rate-distortion as a criterion for motion estimation H04N19/567)
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/52: by predictive encoding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Technology herein provides a method, apparatus and computer readable storage medium for use in video encoding. The technology performs operations including pruning interframe candidate modes, based on one or more criteria, to provide a reduced set of candidate modes for encoding a video block, wherein a candidate mode includes an interframe mode type, a set of reference frame types, and one or more dynamic reference list (DRL) candidates, and wherein pruning interframe candidate modes comprises excluding one or more interframe mode types, determining a rate distortion (RD) cost for each of the candidate modes in the reduced set of candidate modes, selecting a candidate mode from the reduced set of candidate modes, based on the lowest RD cost, as a selected interframe mode, and encoding the video block using the selected interframe mode.

## Claims

### Claim 1

A method of video encoding comprising:
pruning interframe candidate modes, based on one or more criteria, to provide a reduced set of candidate modes for encoding a video block,
wherein a candidate mode includes an interframe mode type, a set of reference frame types, and one or more dynamic reference list (DRL) candidates, and
wherein pruning interframe candidate modes comprises excluding one or more interframe mode types;
determining a rate distortion (RD) cost for each of the candidate modes in the reduced set of candidate modes;
selecting a candidate mode from the reduced set of candidate modes, based on the lowest RD cost, as a selected interframe mode; and
encoding the video block using the selected interframe mode.

### Claim 2 (depends on 1)

The method of claim 1, wherein pruning the interframe candidate modes further comprises one or more of reducing a number of reference frame types or reducing a number of DRL candidates.

### Claim 3 (depends on 1)

The method of claim 1, wherein pruning the interframe candidate modes comprises excluding at least one interframe mode type based on an ordered list of interframe mode types.

### Claim 4 (depends on 1)

The method of claim 1, wherein pruning the interframe candidate modes comprises one or more of excluding at least one interframe mode type or reducing a number of DRL candidates based on a difference between two motion vectors.

### Claim 5 (depends on 1)

The method of claim 1, wherein pruning the interframe candidate modes comprises excluding at least one interframe mode type based on a difference between a source for the video block and a prediction for the video block, wherein the prediction is based on a respective interframe mode type.

### Claim 6 (depends on 1)

The method of claim 1, wherein pruning the interframe candidate modes comprises excluding at least one interframe mode type based on one or more of RD costs for single-reference interframe candidate modes or block size for the video block.

### Claim 7 (depends on 1)

The method of claim 1, wherein pruning the interframe candidate modes further comprises reducing a number of combinations based on a cost metric from fractional motion estimation.

### Claim 8 (depends on 1)

The method of claim 1, wherein pruning the interframe candidate modes further comprises bypassing an interpolation filter selection stage and using a predetermined filter.

### Claim 9

A video encoding apparatus comprising:
a memory to store a video block; and
logic communicatively coupled to the memory, the logic implemented at least partly in one or more of configurable hardware logic or fixed-functionality hardware logic, the logic to perform operations comprising:
pruning interframe candidate modes, based on one or more criteria, to provide a reduced set of candidate modes for encoding the video block,
wherein a candidate mode includes an interframe mode type, a set of reference frame types, and one or more dynamic reference list (DRL) candidates, and
wherein pruning interframe candidate modes comprises excluding one or more interframe mode types;
determining a rate distortion (RD) cost for each of the candidate modes in the reduced set of candidate modes;
selecting a candidate mode from the reduced set of candidate modes, based on the lowest RD cost, as a selected interframe mode; and
encoding the video block using the selected interframe mode.

### Claim 10 (depends on 9)

The video encoding apparatus of claim 9, wherein pruning the interframe candidate modes further comprises one or more of reducing a number of reference frame types or reducing a number of DRL candidates.

### Claim 11 (depends on 9)

The video encoding apparatus of claim 9, wherein pruning the interframe candidate modes comprises excluding at least one interframe mode type based on an ordered list of interframe mode types.

### Claim 12 (depends on 9)

The video encoding apparatus of claim 9, wherein pruning the interframe candidate modes comprises one or more of excluding at least one interframe mode type or reducing a number of DRL candidates based on a difference between two motion vectors.

### Claim 13 (depends on 9)

The video encoding apparatus of claim 9, wherein pruning the interframe candidate modes comprises excluding at least one interframe mode type based on a difference between a source for the video block and a prediction for the video block, wherein the prediction is based on a respective interframe mode type.

### Claim 14 (depends on 9)

The video encoding apparatus of claim 9, wherein pruning the interframe candidate modes comprises excluding at least one interframe mode type based on one or more of RD costs for single-reference interframe candidate modes or block size for the video block.

### Claim 15

At least one computer readable storage medium comprising a set of instructions which, when executed by a computing device, cause the computing device to perform operations comprising:
pruning interframe candidate modes, based on one or more criteria, to provide a reduced set of candidate modes for encoding a video block,
wherein a candidate mode includes an interframe mode type, a set of reference frame types, and one or more dynamic reference list (DRL) candidates, and
wherein pruning interframe candidate modes comprises excluding one or more interframe mode types;
determining a rate distortion (RD) cost for each of the candidate modes in the reduced set of candidate modes;
selecting a candidate mode from the reduced set of candidate modes, based on the lowest RD cost, as a selected interframe mode; and
encoding the video block using the selected interframe mode.

### Claim 16 (depends on 15)

The at least one computer readable storage medium of claim 15, wherein pruning the interframe candidate modes further comprises one or more of reducing a number of reference frame types or reducing a number of DRL candidates.

### Claim 17 (depends on 15)

The at least one computer readable storage medium of claim 15, wherein pruning the interframe candidate modes comprises excluding at least one interframe mode type based on an ordered list of interframe mode types.

### Claim 18 (depends on 15)

The at least one computer readable storage medium of claim 15, wherein pruning the interframe candidate modes comprises one or more of excluding at least one interframe mode type or reducing a number of DRL candidates based on a difference between two motion vectors.

### Claim 19 (depends on 15)

The at least one computer readable storage medium of claim 15, wherein pruning the interframe candidate modes comprises excluding at least one interframe mode type based on a difference between a source for the video block and a prediction for the video block, wherein the prediction is based on a respective interframe mode type.

### Claim 20 (depends on 15)

The at least one computer readable storage medium of claim 15, wherein pruning the interframe candidate modes comprises excluding at least one interframe mode type based on one or more of RD costs for single-reference interframe candidate modes or block size for the video block.
