US 11,909,998 B2Granted

System and method for video coding

AssigneePanasonic Intellectual Property Corporation of America

InventorsChe-Wei Kuo, JIng Ya Li, Chong Soon Lim, Han Boon Teo, Hai Wei Sun, Rohith Mars, Tadamasa Toma, Takahiro Nishi, Kiyofumi Abe, Yusuke Kato

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

An encoder includes circuitry and memory. The circuitry determines whether a first virtual pipeline decoding unit (VPDU) is split into smaller blocks and whether a second VPDU is split into smaller blocks. In response to a determination the first VPDU is not split into smaller blocks and a determination the second VPDU is split into smaller blocks, a block of chroma samples is predicted without using luma samples. In response to a determination the first VPDU is split into smaller blocks and a determination the second VPDU is split into smaller blocks, the block of chroma samples is predicted using luma samples. In response to a determination the first VPDU is not split into smaller blocks and a determination the second VPDU is not split into smaller block, the block of chroma samples is predicted using luma samples. The block is encoded using the predicted chroma samples.

Claims25

Dependent claims

An encoder, comprising:

circuitry;
and
memory coupled to the circuitry;
wherein the circuitry, in operation, performs the following:
determining a threshold luma block size for each 64×64 luma virtual pipeline decoding unit (VPDU) of a coding tree unit;
comparing a size of a first 64×64 luma VPDU of the coding tree unit to the determined threshold luma block size for the first 64×64 luma VPDU and determining whether the first 64×64 luma VPDU is split into smaller blocks based on the comparison of the size of the first 64×64 luma VPDU to the determined threshold luma block size for the first 64×64 luma VPDU;
comparing a size of a corresponding second 32×32 chroma VPDU to a threshold chroma block size and determining whether the corresponding second 32×32 chroma VPDU is split into smaller blocks based on the comparison of the size of the corresponding second 32×32 chroma VPDU to the threshold chroma block size;
in response to a determination the first 64×64 luma VPDU is not split into smaller blocks and a determination the corresponding second 32×32 chroma VPDU is split into smaller blocks, predicting a block of chroma samples of the corresponding second 32×32 chroma VPDU without using luma samples;
in response to a determination the first 64×64 luma VPDU is split into smaller blocks and the determination the corresponding second 32×32 chroma VPDU is split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU using luma samples;
in response to the determination the first 64×64 luma VPDU is not split into smaller blocks and a determination the corresponding second 32×32 chroma VPDU is not split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU using luma samples;
and
encoding the block using the predicted chroma samples.

9 more elements

An encoder, comprising:

a block splitter, which, in operation, splits a first image into a plurality of blocks;
an intra predictor, which, in operation, predicts blocks included in the first image, using reference blocks included in the first image;
an inter predictor, which, in operation, predicts blocks included in the first image, using reference blocks included in a second image different from the first image;
a loop filter, which, in operation, filters blocks included in the first image;
a transformer, which, in operation, transforms a prediction error between an original signal and a prediction signal generated by the intra predictor or the inter predictor, to generate transform coefficients;
a quantizer, which, in operation, quantizes the transform coefficients to generate quantized coefficients;
and
an entropy encoder, which, in operation, variable encodes the quantized coefficients to generate an encoded bitstream including the encoded quantized coefficients and control information,
wherein predicting a block includes:
determining a threshold luma block size for each 64×64 luma virtual pipeline decoding unit (VPDU) of a coding tree unit;
comparing a size of a first 64×64 luma VPDU of the coding tree unit to the determined threshold luma block size for the first 64×64 luma VPDU and determining whether the first 64×64 luma VPDU is split into smaller blocks based on the comparison of the size of the first 64×64 luma VPDU to the determined threshold luma block size for the first 64×64 luma VPDU;
comparing a size of a corresponding second 32×32 chroma VPDU to a threshold chroma block size and determining whether the corresponding second 32×32 chroma VPDU is split into smaller blocks based on the comparison of the size of the corresponding second 32×32 chroma VPDU to the threshold chroma block size;
in response to a determination the first 64×64 luma VPDU is not split into smaller blocks and a determination the corresponding second 32×32 chroma VPDU is split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU without using luma samples;
in response to a determination the first 64×64 luma VPDU is split into smaller blocks and the determination the corresponding second 32×32 chroma VPDU is split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU using luma samples;
and
in response to the determination the first 64×64 luma VPDU is not split into smaller blocks and a determination the corresponding second 32×32 chroma VPDU is not split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU using luma samples.

13 more elements

A decoder, comprising:

circuitry;
memory coupled to the circuitry;
wherein the circuitry, in operation, performs the following:
determining a threshold luma block size for each 64×64 luma virtual pipeline decoding unit (VPDU) of a coding tree unit;
comparing a size of a first 64×64 luma VPDU of the coding tree unit to the determined threshold luma block size for the first 64×64 luma VPDU and determining whether the first 64×64 luma VPDU is split into smaller blocks based on the comparison of the size of the first 64×64 luma VPDU to the determined threshold luma block size for the first 64×64 luma VPDU;
comparing a size of a corresponding second 32×32 chroma VPDU to a threshold chroma block size and determining whether the corresponding second 32×32 chroma VPDU is split into smaller blocks based on the comparison of the size of the corresponding second 32×32 chroma VPDU to the threshold chroma block size;
in response to a determination the first 64×64 luma VPDU is not split into smaller blocks and a determination the corresponding second 32×32 chroma VPDU is split into smaller blocks, predicting a block of chroma samples of the corresponding second 32×32 chroma VPDU without using luma samples;
in response to a determination the first 64×64 luma VPDU is split into smaller blocks and the determination the corresponding second 32×32 chroma VPDU is split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU using luma samples;
in response to the determination the first 64×64 luma VPDU is not split into smaller blocks and a determination the corresponding second 32×32 chroma VPDU is not split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU using luma samples;
and
decoding the block using the predicted chroma samples.

8 more elements

A decoding device, comprising:

a decoder, which, in operation, decodes an encoded bitstream to output quantized coefficients;
an inverse quantizer, which, in operation, inverse quantizes the quantized coefficients to output transform coefficients;
an inverse transformer, which, in operation, inverse transforms the transform coefficients to output a prediction error;
an intra predictor, which, in operation, predicts blocks included in a first image, using a reference blocks included in the first image;
an inter predictor, which, in operation, predicts blocks included in the first image, using reference blocks included in a second image different from the first image;
a loop filter which, in operation, filters blocks included in the first image;
and
an output, which, in operation, outputs a picture including the first image,
wherein predicting a block includes:
determining a threshold luma block size for each 64×64 luma virtual pipeline decoding unit (VPDU) of a coding tree unit;
comparing a size of a first 64×64 luma VPDU of the coding tree unit to the determined threshold luma block size for the first 64×64 luma VPDU and determining whether the first 64×64 luma VPDU is split into smaller blocks based on the comparison of the size of the first 64×64 luma VPDU to the determined threshold luma block size for the first 64×64 luma VPDU;
comparing a size of a corresponding second 32×32 chroma VPDU to a threshold chroma block size and determining whether the corresponding second 32×32 chroma VPDU is split into smaller blocks based on the comparison of the size of the corresponding second 32×32 chroma VPDU to the threshold chroma block size;
in response to a determination the first 64×64 luma VPDU is not split into smaller blocks and a determination the corresponding second 32×32 chroma VPDU is split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU without using luma samples;
in response to a determination the first 64×64 luma VPDU is split into smaller blocks and the determination the corresponding second 32×32 chroma VPDU is split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU using luma samples;
and
in response to the determination the first 64×64 luma VPDU is not split into smaller blocks and a determination the corresponding second 32×32 chroma VPDU is not split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU using luma samples.

13 more elements

An encoding method, comprising:

determining a threshold luma block size for each 64×64 luma virtual pipeline decoding unit (VPDU) of a coding tree unit;
comparing a size of a first 64×64 luma VPDU of the coding tree unit to the determined threshold luma block size for the first 64×64 luma VPDU and determining whether the first 64×64 luma VPDU is split into smaller blocks based on the comparison of the size of the first 64×64 luma VPDU to the determined threshold luma block size for the first 64×64 luma VPDU;
comparing a size of a corresponding second 32×32 chroma VPDU to a threshold chroma block size and determining whether the corresponding second 32×32 chroma VPDU is split into smaller blocks based on the comparison of the size of the corresponding second 32×32 chroma VPDU to the threshold chroma block size;
in response to a determination the first 64×64 luma VPDU is not split into smaller blocks and a determination the corresponding second 32×32 chroma VPDU is split into smaller blocks, predicting a block of chroma samples of the corresponding second 32×32 chroma VPDU without using luma samples;
in response to a determination the first 64×64 luma VPDU is split into smaller blocks and the determination the corresponding second 32×32 chroma VPDU is split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU using luma samples;
in response to the determination the first 64×64 luma VPDU is not split into smaller blocks and a determination the corresponding second 32×32 chroma VPDU is not split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU using luma samples;
and
encoding the block using the predicted chroma samples.

5 more elements

A decoding method, comprising:

determining a threshold luma block size for each 64×64 luma virtual pipeline decoding unit (VPDU) of a coding tree unit;
comparing a size of a first 64×64 luma VPDU of the coding tree unit to the determined threshold luma block size for the first 64×64 luma VPDU and determining whether the first 64×64 luma VPDU is split into smaller blocks based on the comparison of the size of the first 64×64 luma VPDU to the determined threshold luma block size for the first 64×64 luma VPDU;
comparing a size of a corresponding second 32×32 chroma VPDU to a threshold chroma block size and determining whether the corresponding second 32×32 chroma VPDU is split into smaller blocks based on the comparison of the size of the corresponding second 32×32 chroma VPDU to the threshold chroma block size;
in response to a determination the first 64×64 luma VPDU is not split into smaller blocks and a determination the corresponding second 32×32 chroma VPDU is split into smaller blocks, predicting a block of chroma samples of the corresponding second 32×32 chroma VPDU without using luma samples;
in response to a determination the first 64×64 luma VPDU is split into smaller blocks and the determination the corresponding second 32×32 chroma VPDU is split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU using luma samples;
in response to the determination the first 64×64 luma VPDU is not split into smaller blocks and a determination the corresponding second 32×32 chroma VPDU is not split into smaller blocks, predicting the block of chroma samples of the corresponding second 32×32 chroma VPDU using luma samples;
and
decoding the block using the predicted chroma samples.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/906,993Filed 19 Jun 2020 · us provisional application
Priority: 21 Jun 2019
Published: US 2020/0404312 A124 Dec 2020
Granted: 20 Feb 2024
Term ends: Not estimatedThe source records don’t support an estimate.

Classification10 codes

H04N 19/11
Selection of coding mode or of prediction mode: among a plurality of spatial predictive coding modes
H04N 19/50
Methods or arrangements for coding, decoding, compressing or decompressing digital video signals: using predictive coding
H04N 19/124
Characterised by the element, parameter or selection affected or controlled by the adaptive coding: quantisation
H04N 19/174
The unit being an image region, e.g. an object: the region being a slice, e.g. a line of blocks or a group of blocks

Family

Application62/864,783Us provisional application · filed 21 Jun 2019
US 2020/0404312 A1Pre-grant publication · published 24 Dec 2020
US 11,909,998 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key