# US 2020/0404276 A1 · Context modeling for low-frequency non-separable transformation signaling for video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404276 A1
- Document ID: US20200404276A1
- Status: Published application
- Kind: A1
- Application number: 16/905,663
- Filed: 2020-06-18
- Published: 2020-12-24
- Earliest claimed: 2019-06-21
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Alican Nalci; Hilmi Enes Egilmez; Vadim Seregin; Muhammed Zeyd Coban; Marta Karczewicz
- Web page: https://patentgrep.com/patent/US20200404276A1

## CPC

- H04N 19/13: Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/184: the unit being bits, e.g. of the compressed video stream
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/61: in combination with predictive coding
- H04N 19/649: {the transform being applied to non rectangular image segments}
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- H04N 19/157: Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An example method includes determining a color component of a unit of video data; determining, based at least on the color component, a context for context-adaptive binary arithmetic coding (CABAC) a syntax element that specifies a value of a low-frequency non-separable transform (LFNST) index for the unit of video data; CABAC decoding, based on the determined context and via a syntax structure for the unit of video data, the syntax element that specifies the value of the LFNST index for the unit of video data; and inverse-transforming, based on a transform indicated by the value of the LFNST index, transform coefficients of the unit of video data.

## Claims

### Claim 1

A method of decoding video data, the method comprising:
determining a color component of a unit of video data;
determining, based at least on the color component, a context for context-adaptive binary arithmetic coding (CABAC) a syntax element that specifies a value of a low-frequency non-separable transform (LFNST) index for the unit of video data;
CABAC decoding, based on the determined context and via a syntax structure for the unit of video data, the syntax element that specifies the value of the LFNST index for the unit of video data; and
inverse-transforming, based on a transform indicated by the value of the LFNST index, transform coefficients of the unit of video data.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
obtaining, for the unit of video data, a value of a multiple transform selection (MTS) index,
wherein determining the context comprises determining the context based on the value of the MTS index.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
determining a block size of the unit of video data,
wherein determining the context comprises determining the context based on the block size of the unit of video data.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
determining a number of non-zero transform coefficients at a level of the unit of video data,
wherein determining the context comprises determining the context based on the number of non-zero transform coefficients.

### Claim 5 (depends on 1)

The method of claim 1, wherein the unit of video data is a coding unit (CU) of video data.

### Claim 6 (depends on 1)

The method of claim 1, wherein the unit of video data is a transform unit (TU) of video data.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
determining a depth of the TU in a partition structure,
wherein determining the context comprises determining the context based on the depth of the TU.

### Claim 8 (depends on 6)

The method of claim 6, wherein the TU is a first TU in a coding unit (CU) of video data, the method further comprising:
inferring, for other TUs in the CU, values of LFNST indices based on the value of the LFNST index for the first TU.

### Claim 9 (depends on 1)

The method of claim 1, wherein the syntax element that specifies the value of the LFNST index for the unit of video data comprises a lfnst_idx syntax element or a tu_lfnst_idx syntax element.

### Claim 10 (depends on 1)

The method of claim 1, wherein determining the context comprises determining a value of ctxInc for a bin of the syntax element, the value of the mine representing an increment to apply to a previous context.

### Claim 11

A method of encoding video data, the method comprising:
selecting, from a plurality of low-frequency non-separable transforms (LFNSTs), a LFNST having an LFNST index;
transforming, using the LFNST, transform coefficients of a unit of video data;
determining a color component of the unit of video data;
determining, based at least on the color component, a context for context-adaptive binary arithmetic coding (CABAC) a syntax element that specifies the value of the LFNST index for the unit of video data; and
CABAC encoding, based on the determined context and via a syntax structure for the unit of video data, the syntax element that specifies the value of the LFNST index for the unit of video data.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
obtaining, for the unit of video data, a value of a multiple transform selection (MTS) index,
wherein determining the context comprises determining the context based on the value of the MTS index.

### Claim 13 (depends on 11)

The method of claim 11, further comprising:
determining a block size of the unit of video data,
wherein determining the context comprises determining the context based on the block size of the unit of video data.

### Claim 14 (depends on 11)

The method of claim 11, further comprising:
determining a number of non-zero transform coefficients at a level of the unit of video data,
wherein determining the context comprises determining the context based on the number of non-zero transform coefficients.

### Claim 15 (depends on 11)

The method of claim 11, wherein the unit of video data is a coding unit (CU) of video data.

### Claim 16 (depends on 11)

The method of claim 11, wherein the unit of video data is a transform unit (TU) of video data.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
determining a depth of the TU in a partition structure,
wherein determining the context comprises determining the context based on depth of the TU.

### Claim 18 (depends on 16)

The method of claim 16, wherein the TU is a first TU in a coding unit (CU) of video data, the method further comprising:
refrain from encoding syntax elements that specify values of LFNST indices for other TUs in the CU.

### Claim 19 (depends on 11)

The method of claim 11, wherein the syntax element that specifies the value of the LFNST index for the unit of video data comprises a lfnst_idx syntax element or a tu_lfnst_idx syntax element.

### Claim 20 (depends on 11)

The method of claim 11, wherein determining the context comprises determining a value of ctxInc for a bin of the syntax element.

### Claim 21

A device for coding video data, the device comprising:
a memory; and
one or more processors implemented in circuitry and configured to:
determine a color component of a unit of video data;
determine, based at least on the color component, a context for context-adaptive binary arithmetic coding (CABAC) a syntax element that specifies a value of a low-frequency non-separable transform (LFNST) index for the unit of video data;
CABAC code, based on the determined context and via a syntax structure for the unit of video data, the syntax element that specifies the value of the LFNST index for the unit of video data; and
transform, based on a transform indicated by the value of the LFNST index, transform coefficients of the unit of video data.

### Claim 22 (depends on 21)

The device of claim 21, wherein the one or more processors are further configured to:
obtain, for the unit of video data, a value of a multiple transform selection (MIS) index,
wherein, to determine the context, the one or more processors are configured to determine the context based on the value of the MTS index.

### Claim 23 (depends on 21)

The device of claim 21, wherein the one or more processors are further configured to:
determine a block size of the unit of video data,
wherein, to determine the context, the one or more processors are configured to determine the context based on the block size of the unit of video data.

### Claim 24 (depends on 21)

The device of claim 21, wherein the one or more processors are further configured to:
determine a number of non-zero transform coefficients at a level of the unit of video data,
wherein, to determine the context, the one or more processors are configured to determine the context based on the number of non-zero transform coefficients.

### Claim 25 (depends on 21)

The device of claim 21, wherein the unit of video data is a coding unit (CU) of video data.

### Claim 26 (depends on 21)

The device of claim 21, wherein the unit of video data is a transform unit (TU) of video data.

### Claim 27 (depends on 26)

The device of claim 26, wherein the one or more processors are further configured to:
determine a depth of the TU in a partition structure,
wherein, to determine the context, the one or more processors are configured to determine the context based on the depth of the TU.

### Claim 28 (depends on 26)

The device of claim 26, wherein the TU is a first TU in a coding unit (CU) of video data, and wherein the one or more processors are configured to:
infer, for other TUs in the CU, values of LFNST indices based on the value of the LFNST index for the first TU.

### Claim 29 (depends on 21)

The device of claim 21, wherein the syntax element that specifies the value of the LFNST index for the unit of video data comprises a lfnst_idx syntax element or a tu_lfnst_idx syntax element.

### Claim 30 (depends on 21)

The device of claim 21, wherein, to determine the context, the one or more processors are configured to determine a value of ctxInc for a bin of the syntax element.
