# US 10,764,577 B2 · Non-MPM mode coding for intra prediction in video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,764,577 B2
- Document ID: US10764577B2
- Status: Granted
- Kind: B2
- Application number: 16/664,601
- Filed: 2019-10-25
- Published: 2020-04-30
- Granted: 2020-09-01
- Earliest claimed: 2018-10-25
- Assignees: Futurewei Technologies, Inc.; Santa Clara University
- Applicants: Futurewei Technologies, Inc.; Santa Clara University
- Inventors: Minqiang Jiang; Taru Kanchan; Jianhua Zheng; Nam Ling; Chen-Xiong Zhang
- Web page: https://patentgrep.com/patent/US10764577B2

## CPC

- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/463: by compressing encoding parameters before transmission
- H04N 19/139: Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/182: the unit being a pixel
- H04N 19/52: by predictive encoding
- H04N 19/593: involving spatial prediction techniques
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing intra coding predictions. An intra-coding process applied to pixels in a frame of media is determined. The intra-coding process is determined whether to corresponding to at least one of most probable modes. In response to determining the intra-coding process does not correspond to the at least one of the most probable modes, four angular prediction modes are extracted from a list of prediction modes. A set of candidates based on the four angular prediction modes are determined. A pre-defined order of the set of candidates is determined, wherein each candidate mode of the set of candidate modes is included in a ranked order and signaled with a particular fixed length coding, and wherein a length of the particular fixed length coding increases based on the pre-defined order of the set of candidate modes.

## Claims

### Claim 1

A computer-implemented method, comprising:
determining, by one or more processors, an intra-coding process applied to pixels in a frame of media;
determining, by the one or more processors, whether the intra-coding process corresponds to at least one of most probable modes;
in response to determining the intra-coding process does not correspond to the at least one of the most probable modes, extracting, by the one or more processors, four angular prediction modes from a list of prediction modes;
determining, by the one or more processors, a set of candidate modes based on the four angular prediction modes; and
determining, by the one or more processors, a pre-defined order of the set of candidate modes, wherein each candidate mode of the set of candidate modes is included in a ranked order and signaled with a particular fixed length coding, and wherein a length of the particular fixed length coding increases based on the pre-defined order of the set of candidate modes.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the four angular prediction modes correspond to angular directions from a list of directional prediction modes.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein determining the pre-defined order of the set of candidate modes further comprises:
generating, by the one or more processors, a statistical matrix for the pre-defined order in response to determining the intra-coding process does not correspond to the at least one of the most probable modes.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the generated statistical matrix further comprises:
applying, by the one or more processors, the candidate mode to each column of the statistical matrix;
applying, by the one or more processors, a different intra prediction mode to each row of the statistical matrix, wherein the different intra prediction mode corresponds to one of sixty one non-most probable modes; and
applying, by the one or more processors, a number of times each of the candidate modes corresponds to a current mode for previous frames of media to each cell in the statistical matrix.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, wherein determining the pre-defined order of the set of candidate modes comprises:
summing, by the one or more processors, the number of times each of the candidate modes corresponds to the current mode for each candidate mode; and
sorting, by the one or more processors, the candidate modes based on most occurring candidate mode to a least occurring candidate mode.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein determining the pre-defined order of the set of candidate modes comprises:
signaling, by the one or more processors, each candidate mode of the set of candidate modes in the ranked order with the particular fixed length coding to a decoder for decoding the frame of media.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the at least one of the most probable modes comprise a DC mode and a planar mode.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the length of the particular fixed length coding increases based on the pre-defined order of the set of candidate modes and comprises four bits, five bits, and six bits.

### Claim 9

A system comprising one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
determining, by one or more processors, an intra-coding process applied to pixels in a frame of media;
determining, by the one or more processors, whether the intra-coding process corresponds to at least one of most probable modes;
in response to determining the intra-coding process does not correspond to the at least one of the most probable modes, extracting, by the one or more processors, four angular prediction modes from a list of prediction modes;
determining, by the one or more processors, a set of candidate modes based on the four angular prediction modes; and
determining, by the one or more processors, a pre-defined order of the set of candidate modes, wherein each candidate mode of the set of candidate modes is included in a ranked order and signaled with a particular fixed length coding, and wherein a length of the particular fixed length coding increases based on the pre-defined order of the set of candidate modes.

### Claim 10 (depends on 9)

The system of claim 9, wherein the four angular prediction modes correspond to angular directions from a list of directional prediction modes.

### Claim 11 (depends on 9)

The system of claim 9, wherein determining the pre-defined order of the set of candidate modes further comprises:
generating, by the one or more processors, a statistical matrix for the pre-defined order in response to determining the intra-coding process does not correspond to the at least one of the most probable modes.

### Claim 12 (depends on 11)

The system of claim 11, wherein the generated statistical matrix further comprises:
applying, by the one or more processors, the candidate mode to each column of the statistical matrix;
applying, by the one or more processors, a different intra prediction mode to each row of the statistical matrix, wherein the different intra prediction mode corresponds to one of sixty one non-most probable modes; and
applying, by the one or more processors, a number of times each of the candidate modes corresponds to a current mode for previous frames of media to each cell in the statistical matrix.

### Claim 13 (depends on 12)

The system of claim 12, wherein determining the pre-defined order of the set of candidate modes comprises:
summing, by the one or more processors, the number of times each of the candidate modes corresponds to the current mode for each candidate mode; and
sorting, by the one or more processors, the candidate modes based on most occurring candidate mode to a least occurring candidate mode.

### Claim 14 (depends on 9)

The system of claim 9, wherein determining the pre-defined order of the set of candidate modes signaling each candidate mode of the set of candidate modes in a ranked order with a particular fixed length coding comprises:
signaling, by the one or more processors, each candidate mode of the set of candidate modes in the ranked order with the particular fixed length coding to a decoder for decoding the frame of media.

### Claim 15 (depends on 9)

The system of claim 9, wherein the at least one of the most probable modes comprise a DC mode and a planar mode.

### Claim 16 (depends on 9)

The system of claim 9, wherein the length of the particular fixed length coding increases based on the pre-defined order of the set of candidate modes and comprises four bits, five bits, and six bits.

### Claim 17

One or more non-transitory computer-readable media comprising instructions stored thereon that are executable by one or more processing devices and upon such execution cause the one or more processing devices to perform operations comprising:
determining, by one or more processors, an intra-coding process applied to pixels in a frame of media;
determining, by the one or more processors, whether the intra-coding process corresponds to at least one of most probable modes;
in response to determining the intra-coding process does not correspond to the at least one of the most probable modes, extracting, by the one or more processors, four angular prediction modes from a list of prediction modes;
determining, by the one or more processors, a set of candidate modes based on the four angular prediction modes; and
determining, by the one or more processors, a pre-defined order of the set of candidate modes, wherein each candidate mode of the set of candidate modes is included in a ranked order and signaled with a particular fixed length coding, and wherein a length of the particular fixed length coding increases based on the pre-defined order of the set of candidate modes.

### Claim 18 (depends on 17)

The one or more non-transitory computer-readable media of claim 17, wherein the four angular prediction modes correspond to angular directions from a list of directional prediction modes.

### Claim 19 (depends on 17)

The one or more non-transitory computer-readable media of claim 17, wherein determining the pre-defined order of the set of candidate modes further comprises:
generating, by the one or more processors, a statistical matrix for the pre-defined order in response to determining the intra-coding process does not correspond to the at least one of the most probable modes.

### Claim 20 (depends on 17)

The one or more non-transitory computer-readable media of claim 17, wherein the generated statistical matrix further comprises:
applying, by the one or more processors, the candidate mode to each column of the statistical matrix;
applying, by the one or more processors, a different intra prediction mode to each row of the statistical matrix, wherein the different intra prediction mode corresponds to one of sixty one non-most probable modes; and
applying, by the one or more processors, a number of times each of the candidate modes corresponds to a current mode for previous frames of media to each cell in the statistical matrix.
