# US 12,010,298 B2 · Model parameter derivation of local illumination compensation in the luma mapping with chroma scaling-mapped domain in video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,010,298 B2
- Document ID: US12010298B2
- Status: Granted
- Kind: B2
- Application number: 18/325,738
- Filed: 2023-05-30
- Published: 2023-09-28
- Granted: 2024-06-11
- Earliest claimed: 2020-06-24
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Chun-Chi Chen; Han Huang; Vadim Seregin; Marta Karczewicz
- Web page: https://patentgrep.com/patent/US12010298B2

## CPC

- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- G06T 9/004: {Predictors, e.g. intraframe, interframe coding}
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/189: characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N 19/51: Motion estimation or motion compensation
- H04N 19/82: involving filtering within a prediction loop
- H04N 19/98: Adaptive-dynamic-range coding [ADRC]
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An example device for decoding video data includes memory configured to store the video data and one or more processors implemented in circuitry and communicatively coupled to the memory. The one or more processors are configured to reshape a pixel domain reference template block using a forward mapping function into a mapped domain reference template block and derive local illumination compensation (LIC) model parameters from the mapped domain reference template block and a mapped domain neighboring reconstruction template block. The one or more processors are configured to apply the LIC model parameters to motion-compensated prediction signals and decode the video data based on the application of the LIC model parameters.

## Claims

### Claim 1

A method of decoding video data, the method comprising:
reshaping a pixel domain reference template block using a forward mapping function into a mapped domain reference template block, wherein the forward mapping function comprises:
FwdMap(Y_pred)=((b2−b1)/(a2−a1))*(Y_pred−a1)+b1,
where Y_pred is a luma prediction signal, i is a piece index, a1 is an input pivot point of i, a2 is an input pivot point of i+1, b1 is a mapped pivot point of i, and b2 is a mapped pivot point of i+1;
deriving local illumination compensation (LIC) model parameters from the mapped domain reference template block and a mapped domain neighboring reconstruction template block;
applying the LIC model parameters to motion-compensated prediction signals; and
decoding the video data based on the application of the LIC model parameters.

### Claim 2 (depends on 1)

The method of claim 1, wherein applying the LIC model parameters further comprises applying an integer shift to the motion-compensated prediction signals.

### Claim 3 (depends on 2)

The method of claim 2, wherein the integer shift is a right shift by 6.

### Claim 4 (depends on 1)

The method of claim 1, wherein the motion-compensated prediction signals are in a pixel domain.

### Claim 5 (depends on 1)

The method of claim 1, wherein the motion-compensated prediction signals are in a mapped domain.

### Claim 6 (depends on 1)

The method of claim 1, wherein the LIC model parameters are applied on a coding unit (CU) basis.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
determining that luma mapping with chroma scaling is enabled for the CU.

### Claim 8

A device for decoding video data, the device comprising:
memory configured to store the video data; and
one or more processors implemented in circuitry and communicatively coupled to the memory, the one or more processors being configured to:
reshape a pixel domain reference template block using a forward mapping function into a mapped domain reference template block, wherein the forward mapping function comprises:
FwdMap(Y_pred)=((b2−b1)/(a2−a1))*(Y_pred−a1)+b1,
where Y_pred is a luma prediction signal, i is a piece index, a1 is an input pivot point of i, a2 is an input pivot point of i+1, b1 is a mapped pivot point of i, and b2 is a mapped pivot point of i+1;
derive local illumination compensation (LIC) model parameters from the mapped domain reference template block and a mapped domain neighboring reconstruction template block;
apply the LIC model parameters to motion-compensated prediction signals; and
decode the video data based on the application of the LIC model parameters.

### Claim 9 (depends on 8)

The device of claim 8, wherein as part of applying the LIC model parameters, the one or more processors are further configured to:
apply an integer shift to the motion-compensated prediction signals.

### Claim 10 (depends on 9)

The device of claim 9, wherein the integer shift is a right shift by 6.

### Claim 11 (depends on 8)

The device of claim 8, wherein the motion-compensated prediction signals are in a pixel domain.

### Claim 12 (depends on 8)

The device of claim 8, wherein the motion-compensated prediction signals are in a mapped domain.

### Claim 13 (depends on 8)

The device of claim 8, wherein the one or more processors apply the LIC model parameters on a coding unit (CU) basis.

### Claim 14 (depends on 13)

The device of claim 13, wherein the one or more processors are further configured to:
determine that luma mapping with chroma scaling is enabled for the CU.

### Claim 15 (depends on 8)

The device of claim 8, further comprising:
a display configured to display the video data.

### Claim 16 (depends on 8)

The device of claim 8, further comprising:
a camera configured to capture the video data.

### Claim 17 (depends on 8)

The device of claim 8, wherein the device comprises a mobile telephone.

### Claim 18

A non-transitory computer readable storage medium having instructions stored thereon which, when executed, cause one or more processors to:
reshape a pixel domain reference template block using a forward mapping function into a mapped domain reference template block, wherein the forward mapping function comprises:
FwdMap(Y_pred)=((b2−b1)/(a2−a1))*(Y_pred−a1)+b1,
where Y_pred is a luma prediction signal, i is a piece index, a1 is an input pivot point of i, a2 is an input pivot point of i+1, b1 is a mapped pivot point of i, and b2 is a mapped pivot point of i+1;
derive local illumination compensation (LIC) model parameters from the mapped domain reference template block and a mapped domain neighboring reconstruction template block;
apply the LIC model parameters to motion-compensated prediction signals; and
decode the video data based on the application of the LIC model parameters.

### Claim 19 (depends on 18)

The non-transitory computer readable storage medium of claim 18, wherein as part of applying the LIC model parameters, the instructions cause the one or more processors to:
apply an integer shift to the motion-compensated prediction signals.

### Claim 20

A device for decoding video data, the device comprising:
means for reshaping a pixel domain reference template block using a forward mapping function into a mapped domain reference template block, wherein the forward mapping function comprises:
FwdMap(Y_pred)=((b2−b1)/(a2−a1))*(Y_pred−a1)+b1,
where Y_pred is a luma prediction signal, i is a piece index, a1 is an input pivot point of i, a2 is an input pivot point of i+1, b1 is a mapped pivot point of i, and b2 is a mapped pivot point of i+1;
means for deriving local illumination compensation (LIC) model parameters from the mapped domain reference template block and a mapped domain neighboring reconstruction template block;
means for applying the LIC model parameters to motion-compensated prediction signals; and
means for decoding the video data based on the application of the LIC model parameters.