# US 11,310,515 B2 · Methods and apparatus for improvement for intra-inter prediction mode

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,310,515 B2
- Document ID: US11310515B2
- Status: Granted
- Kind: B2
- Application number: 16/673,097
- Filed: 2019-11-04
- Published: 2020-05-14
- Granted: 2022-04-19
- Earliest claimed: 2018-11-14
- Assignees: Tencent America LLC
- Applicants: Tencent America LLC
- Inventors: Liang Zhao; Xin Zhao; Xiang Li; Shan Liu
- Web page: https://patentgrep.com/patent/US11310515B2

## CPC

- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/593: involving spatial prediction techniques
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/82: involving filtering within a prediction loop
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An improved scheme for intra-inter prediction mode and an adaptive intra-inter prediction mode for video coding/decoding, including selecting a set of weightings in an intra-inter mode and applying position dependent intra prediction combination to modify at least one of an inter prediction sample and a reconstructed sample of an inter coded coding unit.

## Claims

### Claim 1

A method for video decoding, the method performed by at least one processor and comprising:
selecting, based on whether an intra mode uses different initial weighting factors of position dependent intra prediction combination (PDPC) than PDPC, a set of weightings in an intra-inter mode; and
applying PDPC to modify at least one of an inter prediction sample and a reconstructed sample of an inter coded coding unit (CU).

### Claim 2 (depends on 1)

The method according to claim 1,
wherein applying PDPC comprises modifying only a luma component of the inter coded CU.

### Claim 3 (depends on 1)

The method according to claim 1, further comprising:
signaling an interPDPCFlag in response to determining that a coding block (CB) is coded by a Merge mode.

### Claim 4 (depends on 1)

The method according to claim 1, further comprising:
applying PDPC to reconstructed samples before applying any of in-loop deblocking filters comprising deblocking, sample adaptive offset (SAO), and adaptive loop filter (ALF).

### Claim 5 (depends on 1)

The method according to claim 1, further comprising:
assigning a default intra prediction mode to a current coding block (CB), and
applying the default intra prediction mode to CBs, following the current CB, for at least intra mode coding and most probable mode (MPM) derivation.

### Claim 6 (depends on 1)

The method according to claim 1, further comprising:
applying sets of PDPC filters to at least one of inter prediction samples, other than the inter prediction sample, and reconstructed samples of inter coded CUs other than the reconstructed sample of the inter coded CU,
wherein each of the PDPC filters are defined for respective ones of a plurality of block sizes.

### Claim 7 (depends on 6)

The method according to claim 6, further comprising:
signaling at least one interPDPCFlag indicating whether to applying PDPC;
determining whether the interPDPCFlag is set equal to true;
in response to determining that the interPDPCFlag is set equal to a first value, signaling a second flag indicating at least one of the PDPC filters to be applied, after inter prediction, to the at least one of inter prediction samples and reconstructed samples of inter coded CUs; and
in response to determining that the interPDPCFlag is set equal to a second value, determining to exclude PDPC from the at least one of inter prediction samples and reconstructed samples of inter coded CUs.

### Claim 8 (depends on 1)

The method according to claim 1, further comprising:
signaling whether the weighting are equal to each other; and
weighting, in response to determining that the signaling indicates that the weightings are unequal, an inter-prediction in PDPC filtering depending on whether neighboring blocks are any of intra coded, inter coded, and intra-inter coded.

### Claim 9 (depends on 1)

The method according to claim 1,
wherein intra prediction is absent from the intra-inter mode.

### Claim 10 (depends on 9)

The method according to claim 9,
wherein applying PDPC directly on top of inter-prediction comprises applying
pred(x,y)=(w_intra*wL×R−1,y+w_intra*wT×Rx,−1 w_intra*wTL×R−1,−1+(N−w_intra*wL−w_intra*wT+w_intra*wTL)×InterPred(x,y)+N/2)>>log 2(N)
wherein InterPred indicates an input inter prediction, w_intra is selected from a set of predefined values depending on whether the neighboring blocks are at least one of intra coded, inter coded, and intra-inter coded, and
wherein N indicates one of 8, 16, 32, 64, 128, and 256.

### Claim 11

An apparatus comprising:
at least one memory configured to store computer program code;
at least one hardware processor configured to access the computer program code and operate as instructed by the computer program code, the computer program code including:
selecting code configured to cause the at least one processor to select, based on whether an intra mode uses different initial weighting factors of position dependent intra prediction combination (PDPC) than PDPC, a set of weightings in an intra-inter mode; and
applying code configured to cause the at least one processor to apply PDPC to modify at least one of an inter prediction sample and a reconstructed sample of an inter coded coding unit (CU).

### Claim 12 (depends on 11)

The apparatus according to claim 11,
wherein the applying code is further configured to cause the at least one processor to modify only a luma component of the inter coded CU in order to apply PDPC.

### Claim 13 (depends on 11)

The apparatus according to claim 11,
wherein the signaling code is further configured to cause the at least one processor to signal an interPDPCFlag in response to determining that a coding block (CB) is coded by a Merge mode.

### Claim 14 (depends on 11)

The apparatus according to claim 11,
wherein the applying code is further configured to cause the at least one processor to apply PDPC to reconstructed samples before applying any of in-loop deblocking filters comprising deblocking, sample adaptive offset (SAO), and adaptive loop filter (ALF).

### Claim 15 (depends on 11)

The apparatus according to claim 11, further comprising:
assigning code configured to cause the at least one processor to assign a default intra prediction mode to a current coding block (CB),
wherein the applying code is further configured to cause the at least one processor to apply the default intra prediction mode to CBs, following the current CB, for at least intra mode coding and most probable mode (MPM) derivation.

### Claim 16 (depends on 11)

The apparatus according to claim 11,
wherein the applying code is further configured to cause the at least one processor to apply sets of PDPC filters to at least one of inter prediction samples, other than the inter prediction sample, and reconstructed samples of inter coded CUs other than the reconstructed sample of the inter coded CU, and
wherein each of the PDPC filters are defined for respective ones of a plurality of block sizes.

### Claim 17 (depends on 16)

The apparatus according to claim 16,
wherein the signaling code is further configured to cause the at least one processor to:
signal at least one interPDPCFlag indicating whether to applying PDPC;
determine whether the interPDPCFlag is set equal to true;
in response to determining that the interPDPCFlag is set equal to a first value, signal a second flag indicating at least one of the PDPC filters to be applied, after inter prediction, to the at least one of inter prediction samples and reconstructed samples of inter coded CUs; and
in response to determining that the interPDPCFlag is set equal to a second value, determine to exclude PDPC from the at least one of inter prediction samples and reconstructed samples of inter coded CUs.

### Claim 18 (depends on 11)

The apparatus according to claim 11, further comprising:
signaling code configured to cause the at least one processor to signal whether the weightings are equal to each other; and
weighting code configured to cause the at least one processor to weight, in response to determining that the weightings are unequal, an inter-prediction in PDPC filtering depending on whether neighboring blocks are any of intra coded, inter coded, and intra-inter coded.

### Claim 19 (depends on 11)

The apparatus according to claim 11,
wherein intra prediction is absent from the intra-inter mode,
wherein applying PDPC directly on top of inter-prediction comprises applying
pred(x,y)=(w_intra*wL×R−1,y+w_intra*wT×Rx,−1−w_intra*wTL×R−1,−1+(N−w_intra*wL−w_intra*wT+w_intra*wTL)×InterPred(x,y)+N/2)>>log 2(N)
wherein InterPred indicates an input inter prediction, w_intra is selected from a set of predefined values depending on whether the neighboring blocks are at least one of intra coded, inter coded, and intra-inter coded, and
wherein N indicates one of 8, 16, 32, 64, 128, and 256.

### Claim 20

A non-transitory computer readable medium storing a program causing a computer to execute a process, the process comprising:
selecting, based on whether an intra mode uses different initial weighting factors of position dependent intra prediction combination (PDPC) than PDPC, a set of weightings in an intra-inter mode; and
applying PDPC to modify at least one of an inter prediction sample and a reconstructed sample of an inter coded coding unit (CU).
