# US 2023/0067650 A1 · Methods and devices for prediction dependent residual scaling for video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0067650 A1
- Document ID: US20230067650A1
- Status: Published application
- Kind: A1
- Application number: 17/976,745
- Filed: 2022-10-28
- Published: 2023-03-02
- Earliest claimed: 2021-04-30
- Assignees: Beijing Dajia Internet Information Technology Co., Ltd.
- Applicants: Beijing Daja Internet Information Technology Co., Ltd.
- Inventors: Xiaoyu XIU; Yi-Wen CHEN; Tsung-Chuan MA; Hong-Jheng JHU; Wei CHEN; Xianglin WANG; Bing YU
- Web page: https://patentgrep.com/patent/US20230067650A1

## CPC

- H04N 19/182: the unit being a pixel
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/107: between spatial and temporal predictive coding, e.g. picture refresh
- H04N 19/126: Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/593: involving spatial prediction techniques
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and devices are provided for reducing the decoding latency introduced by luma mapping with chroma scaling (LMCS). In one method, during decoding of a coding unit (CU) that is coded by an inter mode or Combined Inter and Intra Prediction (CIIP) mode under LMCS framework, a plurality of reconstructed samples of luma component is obtained in a mapped domain, a plurality of converted samples of luma component is obtained in an original domain by converting the plurality of reconstructed samples of luma component from the mapped domain into the original domain, and the plurality of converted samples of luma component is used in the original domain, without clipping, in deriving chroma scaling factors for decoding the chroma samples of the CU.

## Claims

### Claim 1

A method for video decoding, comprising:
during decoding of a coding unit (CU) that is coded by an inter mode or Combined Inter and Intra Prediction (CIIP) mode in a case where luma mapping with chroma scaling (LMCS) is enabled,
obtaining a plurality of reconstructed samples of luma component in a mapped domain;
obtaining a plurality of converted samples of luma component in an original domain by converting the plurality of reconstructed samples of luma component from the mapped domain into the original domain; and
deriving chroma scaling factors for decoding chroma samples of the CU by using a plurality of corresponding reconstructed samples of luma component, without clipping.

### Claim 2 (depends on 1)

The method of claim 1, wherein when the CU is coded by an inter mode, obtaining the plurality of reconstructed samples of luma component in the mapped domain comprises:
calculating a plurality of inter prediction samples of luma component in the original domain;
converting the plurality of inter prediction samples of luma component from the original domain into the mapped domain, without clipping, to obtain a plurality of converted inter prediction samples of luma component in the mapped domain; and
adding the plurality of converted inter prediction samples of luma component in the mapped domain, to a plurality of residual samples of luma component in the mapped domain, resulting in the plurality of reconstructed samples of luma component in the mapped domain.

### Claim 3 (depends on 1)

The method of claim 1, wherein when the CU is coded by the CIIP mode, obtaining the plurality of reconstructed samples of luma component in the mapped domain comprises:
calculating a plurality of inter prediction samples of luma component in the original domain;
converting the plurality of inter prediction samples of luma component from the original domain into the mapped domain, without clipping, to obtain a plurality of converted inter prediction samples of luma component in the mapped domain; and
adding the plurality of converted inter prediction samples of luma component in the mapped domain, to a plurality of residual samples of luma component in the mapped domain, resulting in the plurality of reconstructed samples of luma component in the mapped domain.

### Claim 4

A computing device comprising:
one or more processors;
a non-transitory storage coupled to the one or more processors; and
a plurality of programs stored in the non-transitory storage that, when executed by the one or more processors, cause the computing device to perform acts comprising:
during decoding of a coding unit (CU) that is coded by an inter mode or Combined Inter and Intra Prediction (CIIP) mode in a case where luma mapping with chroma scaling (LMCS) is enabled, obtaining a plurality of reconstructed samples of luma component in a mapped domain;
obtaining a plurality of converted samples of luma component in an original domain by converting the plurality of reconstructed samples of luma component from the mapped domain into the original domain; and
deriving chroma scaling factors for decoding chroma samples of the CU by using a plurality of corresponding reconstructed samples of luma component, without clipping.

### Claim 5 (depends on 4)

The computing device of claim 4, wherein when the CU is coded by an inter mode, obtaining the plurality of reconstructed samples of luma component in the mapped domain comprises:
calculating a plurality of inter prediction samples of luma component in the original domain;
converting the plurality of inter prediction samples of luma component from the original domain into the mapped domain, without clipping, to obtain a plurality of converted inter prediction samples of luma component in the mapped domain; and
adding the plurality of converted inter prediction samples of luma component in the mapped domain, to a plurality of residual samples of luma component in the mapped domain, resulting in the plurality of reconstructed samples of luma component in the mapped domain.

### Claim 6 (depends on 4)

The computing device of claim 4, wherein when the CU is coded by the CIIP mode, obtaining the plurality of reconstructed samples of luma component in the mapped domain comprises:
calculating a plurality of inter prediction samples of luma component in the original domain;
converting the plurality of inter prediction samples of luma component from the original domain into the mapped domain, without clipping, to obtain a plurality of converted inter prediction samples of luma component in the mapped domain; and
adding the plurality of converted inter prediction samples of luma component in the mapped domain, to a plurality of residual samples of luma component in the mapped domain, resulting in the plurality of reconstructed samples of luma component in the mapped domain.

### Claim 7

A non-transitory computer readable storage medium storing a plurality of programs for execution by a computing device having one or more processors, wherein the plurality of programs, when executed by the one or more processors, cause the computing device to perform acts comprising:
during decoding of a coding unit (CU) that is coded by an inter mode or Combined Inter and Intra Prediction (CIIP) mode in a case where luma mapping with chroma scaling (LMCS) is enabled, obtaining a plurality of reconstructed samples of luma component in a mapped domain;
obtaining a plurality of converted samples of luma component in an original domain by converting the plurality of reconstructed samples of luma component from the mapped domain into the original domain; and
deriving chroma scaling factors for decoding chroma samples of the CU by using a plurality of corresponding reconstructed samples of luma component, without clipping.

### Claim 8 (depends on 7)

The non-transitory computer readable storage medium of claim 7, wherein when the CU is coded by an inter mode, obtaining the plurality of reconstructed samples of luma component in the mapped domain comprises:
calculating a plurality of inter prediction samples of luma component in the original domain;
converting the plurality of inter prediction samples of luma component from the original domain into the mapped domain, without clipping, to obtain a plurality of converted inter prediction samples of luma component in the mapped domain; and
adding the plurality of converted inter prediction samples of luma component in the mapped domain, to a plurality of residual samples of luma component in the mapped domain, resulting in the plurality of reconstructed samples of luma component in the mapped domain.

### Claim 9 (depends on 7)

The non-transitory computer readable storage medium of claim 7, wherein when the CU is coded by the CIIP mode, obtaining the plurality of reconstructed samples of luma component in the mapped domain comprises:
calculating a plurality of inter prediction samples of luma component in the original domain;
converting the plurality of inter prediction samples of luma component from the original domain into the mapped domain, without clipping, to obtain a plurality of converted inter prediction samples of luma component in the mapped domain; and
adding the plurality of converted inter prediction samples of luma component in the mapped domain, to a plurality of residual samples of luma component in the mapped domain, resulting in the plurality of reconstructed samples of luma component in the mapped domain.
