# US 2020/0404312 A1 · System and method for video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404312 A1
- Document ID: US20200404312A1
- Status: Published application
- Kind: A1
- Application number: 16/906,993
- Filed: 2020-06-19
- Published: 2020-12-24
- Earliest claimed: 2019-06-21
- Assignees: Panasonic Intellectul Property Corporation of America
- Applicants: Panasonic Intellectul Property Corporation of America
- Inventors: Che-Wei KUO; Jing Ya LI; Chong Soon LIM; Han Boon TEO; Hai Wei SUN; Rohith MARS; Tadamasa TOMA; Takahiro NISHI; Kiyofumi ABE; Yusuke KATO
- Web page: https://patentgrep.com/patent/US20200404312A1

## CPC

- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/50: using predictive coding (H04N19/61 takes precedence)
- H04N 19/124: Quantisation
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/436: using parallelised computational arrangements
- H04N 19/593: involving spatial prediction techniques
- H04N 19/96: Tree coding, e.g. quad-tree coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An encoder includes circuitry and memory coupled to the circuitry. The circuitry determines whether a first virtual pipeline decoding unit (VPDU) is split into smaller blocks and whether a second VPDU is split into smaller blocks. In response to a determination the first VPDU is not split into smaller blocks and a determination the second VPDU is split into smaller blocks, a block of chroma samples is predicted without using luma samples. In response to a determination the first VPDU is split into smaller blocks and a determination the second VPDU is split into smaller blocks, the block of chroma samples is predicted using luma samples. In response to a determination the first VPDU is not split into smaller blocks and a determination the second VPDU is not split into smaller block, the block of chroma samples is predicted using luma samples. The block is encoded using the predicted chroma samples.

## Claims

### Claim 1

An encoder, comprising:
circuitry; and
memory coupled to the circuitry;
wherein the circuitry, in operation, performs the following:
determining whether a first virtual pipeline decoding unit (VPDU) is split into smaller blocks and whether a second VPDU is split into smaller blocks;
in response to a determination the first VPDU is not split into smaller blocks and a determination the second VPDU is split into smaller blocks, predicting a block of chroma samples without using luma samples;
in response to a determination the first VPDU is split into smaller blocks and the determination the second VPDU is split into smaller blocks, predicting the block of chroma samples using luma samples;
in response to the determination the first VPDU is not split into smaller blocks and a determination the second VPDU is not split into smaller block, predicting the block of chroma samples using luma samples; and
encoding the block using the predicted chroma samples.

### Claim 2 (depends on 1)

The encoder of claim 1, wherein a current block is in the first VPDU.

### Claim 3 (depends on 1)

The encoder of claim 1, wherein a current block is in the second VPDU.

### Claim 4 (depends on 1)

The encoder of claim 1, wherein the first VPDU is a luma VPDU.

### Claim 5 (depends on 1)

The encoder of claim 1, wherein the first VPDU is a chroma VPDU.

### Claim 6 (depends on 1)

The encoder of claim 1, wherein the second VPDU is a luma VPDU.

### Claim 7 (depends on 1)

The encoder of claim 1, wherein the second VPDU is a chroma VPDU.

### Claim 8 (depends on 1)

The encoder of claim 1, wherein the circuitry, in operation, determines whether a VPDU is split into smaller blocks based on a split flag associated with the VPDU.

### Claim 9 (depends on 8)

The encoder of claim 8 wherein the split flag is a quad-tree split flag.

### Claim 10 (depends on 8)

The encoder of claim 8 wherein the split flag is a binary-tree split flag.

### Claim 11 (depends on 8)

The encoder of claim 8 wherein the split flag is a ternary-tree split flag.

### Claim 12 (depends on 1)

The encoder of claim 1, wherein the circuitry, in operation, determines whether a VPDU is split into smaller blocks based on a block split depth.

### Claim 13 (depends on 12)

The encoder of claim 12, wherein the block split depth is a quad-tree split depth.

### Claim 14 (depends on 12)

The encoder of claim 12, wherein the block split depth is a binary-tree split depth.

### Claim 15 (depends on 12)

The encoder of claim 12, wherein the block split depth is a ternary-tree split depth.

### Claim 16 (depends on 1)

The encoder of claim 1, wherein the circuitry, in operation, repeats the determining of whether a VPDU is split until a threshold block size is reached.

### Claim 17 (depends on 16)

The encoder of claim 16, wherein the threshold block size is a default threshold block size.

### Claim 18 (depends on 16)

The encoder of claim 16, wherein the threshold block size is signaled.

### Claim 19 (depends on 1)

The encoder of claim 1, wherein partition shapes of smaller blocks are limited to a determined set of shapes and block sizes of smaller blocks are limited to a determined set of block sizes.

### Claim 20

An encoder, comprising:
a block splitter, which, in operation, splits a first image into a plurality of blocks;
an intra predictor, which, in operation, predicts blocks included in the first image, using reference blocks included in the first image;
an inter predictor, which, in operation, predicts blocks included in the first image, using reference blocks included in a second image different from the first image;
a loop filter, which, in operation, filters blocks included in the first image;
a transformer, which, in operation, transforms a prediction error between an original signal and a prediction signal generated by the intra predictor or the inter predictor, to generate transform coefficients;
a quantizer, which, in operation, quantizes the transform coefficients to generate quantized coefficients; and
an entropy encoder, which, in operation, variable encodes the quantized coefficients to generate an encoded bitstream including the encoded quantized coefficients and control information,
wherein predicting a block includes:
determining whether a first virtual pipeline decoding unit (VPDU) is split into smaller blocks and whether a second VPDU is split into smaller blocks;
in response to a determination the first VPDU is not split into smaller blocks and a determination the second VPDU is split into smaller blocks, predicting the block of chroma samples without using luma samples;
in response to a determination the first VPDU is split into smaller blocks and the determination the second VPDU is split into smaller blocks, predicting the block of chroma samples using luma samples; and
in response to the determination the first VPDU is not split into smaller blocks and a determination the second VPDU is not split into smaller block, predicting the block of chroma samples using luma samples.

### Claim 21 (depends on 20)

The encoder of claim 20, wherein a current block is in the first VPDU.

### Claim 22 (depends on 20)

The encoder of claim 20, wherein a current block is in the second VPDU.

### Claim 23 (depends on 20)

The encoder of claim 20, wherein the first VPDU is a luma VPDU.

### Claim 24 (depends on 20)

The encoder of claim 20, wherein the first VPDU is a chroma VPDU.

### Claim 25 (depends on 20)

The encoder of claim 20, wherein the second VPDU is a luma VPDU.

### Claim 26 (depends on 20)

The encoder of claim 20, wherein the second VPDU is a chroma VPDU.

### Claim 27 (depends on 20)

The encoder of claim 20, wherein the determining whether a VPDU is split into smaller blocks is based on a split flag associated with the VPDU.

### Claim 28 (depends on 27)

The encoder of claim 27, wherein the split flag is at least one split flag selected from:
a quad-tree split flag;
a binary-tree split flag; and
a ternary-tree split flag.

### Claim 29 (depends on 28)

The encoder of claim 28, wherein the at least one split flag includes a binary-tree split flag and a ternary tree split flag.

### Claim 30 (depends on 20)

The encoder of claim 20, wherein the determining whether a VPDU is split into smaller blocks is based on a block split depth.

### Claim 31 (depends on 30)

The encoder of claim 30, wherein the block split depth is at least one block split-depth selected from
a quad-tree split depth;
a binary-tree split depth; and
a ternary-tree split depth.

### Claim 32 (depends on 20)

The encoder of claim 20, wherein the determining of whether a VPDU is split is repeated until a threshold block size is reached.

### Claim 33 (depends on 32)

The encoder of claim 32, wherein the threshold block size is a default threshold block size.

### Claim 34 (depends on 32)

The encoder of claim 32, wherein the threshold block size is signaled.

### Claim 35 (depends on 20)

The encoder of claim 20, wherein partition shapes of smaller blocks are limited to a determined set of shapes and block sizes of smaller blocks are limited to a determined set of block sizes.

### Claim 36

A decoder, comprising:
circuitry;
memory coupled to the circuitry;
wherein the circuitry, in operation, performs the following:
determining whether a first virtual pipeline decoding unit (VPDU) is split into smaller blocks and whether a second VPDU is split into smaller blocks;
in response to a determination the first VPDU is not split into smaller blocks and a determination the second VPDU is split into smaller blocks, predicting a block of chroma samples without using luma samples;
in response to a determination the first VPDU is split into smaller blocks and the determination the second VPDU is split into smaller blocks, predicting the block of chroma samples using luma samples;
in response to the determination the first VPDU is not split into smaller blocks and a determination the second VPDU is not split into smaller block, predicting the block of chroma samples using luma samples; and
decoding the block using the predicted chroma samples.

### Claim 37 (depends on 36)

The decoder of claim 36, wherein a current block is in the first VPDU.

### Claim 38 (depends on 36)

The decoder of claim 36, wherein a current block is in the second VPDU.

### Claim 39 (depends on 36)

The decoder of claim 36, wherein the first VPDU is a luma VPDU.

### Claim 40 (depends on 36)

The decoder of claim 36, wherein the first VPDU is a chroma VPDU.

### Claim 41 (depends on 36)

The decoder of claim 36, wherein the second VPDU is a luma VPDU.

### Claim 42 (depends on 36)

The decoder of claim 36, wherein the second VPDU is a chroma VPDU.

### Claim 43 (depends on 36)

The decoder of claim 36 wherein the first VPDU is a luma VPDU and the second VPDU is a chroma VPDU.

### Claim 44 (depends on 36)

The decoder of claim 36, wherein the circuitry, in operation, determines whether a VPDU is split into smaller blocks based on a split flag associated with the VPDU.

### Claim 45 (depends on 44)

The decoder of claim 44 wherein the split flag is a quad-tree split flag.

### Claim 46 (depends on 44)

The decoder of claim 44 wherein the split flag is a binary-tree split flag.

### Claim 47 (depends on 44)

The decoder of claim 44 wherein the split flag is a ternary-tree split flag.

### Claim 48 (depends on 36)

The decoder of claim 36, wherein the circuitry, in operation, determines whether a VPDU is split into smaller blocks based on a plurality of split flags associated with the VPDU.

### Claim 49 (depends on 36)

The decoder of claim 36, wherein the circuitry, in operation, determines whether a VPDU is split into smaller blocks based on a block split depth.

### Claim 50 (depends on 49)

The decoder of claim 49, wherein the block split depth is a quad-tree split depth.

### Claim 51 (depends on 49)

The decoder of claim 49, wherein the block split depth is a binary-tree split depth.

### Claim 52 (depends on 49)

The decoder of claim 49, wherein the block split depth is a ternary-tree split depth.

### Claim 53 (depends on 36)

The decoder of claim 36, wherein the circuitry, in operation, repeats the determining of whether a VPDU is split until a threshold block size is reached.

### Claim 54 (depends on 53)

The decoder of claim 53, wherein the threshold block size is a default threshold block size.

### Claim 55 (depends on 53)

The decoder of claim 53, wherein the threshold block size is signaled.

### Claim 56 (depends on 36)

The decoder of claim 36, wherein partition shapes of smaller blocks are limited to a determined set of shapes and block sizes of smaller blocks are limited to a determined set of block sizes.

### Claim 57

A decoding device, comprising:
a decoder, which, in operation, decodes an encoded bitstream to output quantized coefficients;
an inverse quantizer, which, in operation, inverse quantizes the quantized coefficients to output transform coefficients;
an inverse transformer, which, in operation, inverse transforms the transform coefficients to output a prediction error;
an intra predictor, which, in operation, predicts blocks included in a first image, using a reference blocks included in the first image;
an inter predictor, which, in operation, predicts blocks included in the first image, using reference blocks included in a second image different from the first image;
a loop filter which, in operation, filters blocks included in the first image; and
an output, which, in operation, outputs a picture including the first image,
wherein predicting a block includes:
determining whether a first virtual pipeline decoding unit (VPDU) is split into smaller blocks and whether a second VPDU is split into smaller blocks;
in response to a determination the first VPDU is not split into smaller blocks and a determination the second VPDU is split into smaller blocks, predicting the block of chroma samples without using luma samples;
in response to a determination the first VPDU is split into smaller blocks and the determination the second VPDU is split into smaller blocks, predicting the block of chroma samples using luma samples; and
in response to the determination the first VPDU is not split into smaller blocks and a determination the second VPDU is not split into smaller block, predicting the block of chroma samples using luma samples.

### Claim 58 (depends on 57)

The decoding device of claim 57, wherein a current block is in the first VPDU.

### Claim 59 (depends on 57)

The decoding device of claim 57, wherein a current block is in the second VPDU.

### Claim 60 (depends on 57)

The decoding device of claim 57, wherein the first VPDU is a luma VPDU.

### Claim 61 (depends on 57)

The decoding device of claim 57, wherein the first VPDU is a chroma VPDU.

### Claim 62 (depends on 57)

The decoding device of claim 57, wherein the second VPDU is a luma VPDU.

### Claim 63 (depends on 57)

The decoding device of claim 57, wherein the second VPDU is a chroma VPDU.

### Claim 64 (depends on 57)

The decoding device of claim 57, wherein the determining whether a VPDU is split into smaller blocks is based on a split flag associated with the VPDU.

### Claim 65 (depends on 64)

The decoding device of claim 64 wherein the split flag is at least one split flag selected from:
a quad-tree split flag;
a binary-tree split flag; and
a ternary-tree split flag.

### Claim 66 (depends on 57)

The decoding device of claim 57, wherein the determining whether a VPDU is split into smaller blocks is based on a block split depth.

### Claim 67 (depends on 66)

The decoding device of claim 66, wherein the block split depth is at least one split depth selected from:
a quad-tree split depth;
a binary-tree split depth; and
a ternary-tree split depth.

### Claim 68 (depends on 57)

The decoding device of claim 57, wherein the determining of whether a VPDU is split is repeated until a threshold block size is reached.

### Claim 69 (depends on 68)

The decoding device of claim 68, wherein the threshold block size is a default threshold block size.

### Claim 70 (depends on 68)

The decoding device of claim 68, wherein the threshold block size is signaled.

### Claim 71 (depends on 57)

The decoding device of claim 57, wherein partition shapes of smaller blocks are limited to a determined set of shapes and block sizes of smaller blocks are limited to a determined set of block sizes.

### Claim 72

An encoding method, comprising:
determining whether a first virtual pipeline decoding unit (VPDU) is split into smaller blocks and whether a second VPDU is split into smaller blocks;
in response to a determination the first VPDU is not split into smaller blocks and a determination the second VPDU is split into smaller blocks, predicting a block of chroma samples without using luma samples;
in response to a determination the first VPDU is split into smaller blocks and the determination the second VPDU is split into smaller blocks, predicting the block of chroma samples using luma samples;
in response to the determination the first VPDU is not split into smaller blocks and a determination the second VPDU is not split into smaller block, predicting the block of chroma samples using luma samples; and
encoding the block using the predicted chroma samples.

### Claim 73 (depends on 72)

The encoding method of claim 72, wherein a current block is in the first VPDU.

### Claim 74 (depends on 72)

The encoding method of claim 72, wherein a current block is in the second VPDU.

### Claim 75 (depends on 72)

The encoding method of claim 72, wherein the first VPDU is a luma VPDU.

### Claim 76 (depends on 72)

The encoding method of claim 72, wherein the first VPDU is a chroma VPDU.

### Claim 77 (depends on 72)

The encoding method of claim 72, wherein the determining whether a VPDU is split into smaller blocks is based on a split flag associated with the VPDU.

### Claim 78 (depends on 72)

The encoding method of claim 72, wherein the determining whether a VPDU is split into smaller blocks is based on a block split depth.

### Claim 79 (depends on 72)

The encoding of claim 72, wherein the determining of whether a VPDU is split is repeated until a threshold block size is reached.

### Claim 80 (depends on 72)

The encoding method of claim 72, wherein partition shapes of smaller blocks are limited to a determined set of shapes and block sizes of smaller blocks are limited to a determined set of block sizes.

### Claim 81

A decoding method, comprising:
determining whether a first virtual pipeline decoding unit (VPDU) is split into smaller blocks and whether a second VPDU is split into smaller blocks;
in response to a determination the first VPDU is not split into smaller blocks and a determination the second VPDU is split into smaller blocks, predicting a block of chroma samples without using luma samples;
in response to a determination the first VPDU is split into smaller blocks and the determination the second VPDU is split into smaller blocks, predicting the block of chroma samples using luma samples;
in response to the determination the first VPDU is not split into smaller blocks and a determination the second VPDU is not split into smaller block, predicting the block of chroma samples using luma samples; and
decoding the block using the predicted chroma samples.

### Claim 82 (depends on 81)

The decoding method of claim 81, wherein a current block is in the first VPDU.

### Claim 83 (depends on 81)

The decoding method of claim 81, wherein a current block is in the second VPDU.

### Claim 84 (depends on 81)

The decoding method of claim 81, wherein the first VPDU is a luma VPDU.

### Claim 85 (depends on 81)

The decoding method of claim 81, wherein the first VPDU is a chroma VPDU.

### Claim 86 (depends on 81)

The decoding method of claim 81, wherein the determining whether a VPDU is split into smaller blocks is based on a split flag associated with the VPDU.

### Claim 87 (depends on 81)

The decoding method of claim 81, wherein the determining whether a VPDU is split into smaller blocks is based on a block split depth.

### Claim 88 (depends on 81)

The decoding of claim 81, wherein the determining of whether a VPDU is split is repeated until a threshold block size is reached.

### Claim 89 (depends on 81)

The decoding method of claim 81, wherein partition shapes of smaller blocks are limited to a determined set of shapes and block sizes of smaller blocks are limited to a determined set of block sizes.
