# US 11,910,020 B2 · Signaling of reshaping information in video processing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,910,020 B2 - Document ID: US11910020B2 - Status: Granted - Kind: B2 - Application number: 17/357,166 - Filed: 2021-06-24 - Published: 2021-10-14 - Granted: 2024-02-20 - Earliest claimed: 2019-03-08 - Assignees: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc. - Applicants: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc. - Inventors: Kai Zhang; Li Zhang; Hongbin Liu; Yue Wang - Web page: https://patentgrep.com/patent/US11910020B2 ## CPC - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) - H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking - H04N 19/17: the unit being an image region, e.g. an object - H04N 19/172: the region being a picture, frame or field - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/186: the unit being a colour or a chrominance component - H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) - H04N 19/50: using predictive coding (H04N19/61 takes precedence) - H04N 19/577: Motion compensation with bidirectional frame interpolation, i.e. using B-pictures - H04N 19/80: Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence) - H04N 19/82: involving filtering within a prediction loop - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A video processing method is provided, including: performing a conversion between a coded representation of a video including one or more video regions and the video, wherein the coded representation includes reshaping model information applicable for in-loop reshaping (ILR) of some of the one or more video regions, wherein the reshaping model information provides information for a reconstruction of a video unit of a video region based on a representation in a first domain and a second domain and/or scaling chroma residue of a chroma video unit, wherein the reshaping model information includes a parameter set that includes a first syntax element that derives a number of bits used to represent a second syntax element specifying an absolute delta codeword value from a corresponding bin, and wherein the first syntax element has a value smaller than a threshold. ## Claims ### Claim 1 A method of processing video data, comprising: determining, during a conversion between a current chroma video block of a video region of a video and a bitstream of the video, that a scaling process is applied on chroma residual samples of the current chroma video block; and performing the conversion by applying the scaling process on the chroma residual samples based on at least one scaling factor varScale, wherein in the scaling process, the chroma residual samples are scaled before being used to reconstruct the current chroma video block, and wherein the at least one scaling factor varScale is derived based on a variable invAvgLuma which is derived using specific luma samples by an offset-based average operation, and the variable invAvgLuma is calculated depending on a color format of the video, the color format of the video being 4:4:4 format, 4:2:0 format, or 4:2:2 format, wherein the calculated value of invAvgLuma is dependent on position variables used for determining the specific luma samples, and the values of the position variables are determined using the color format of the video, different values of the position variables corresponding to different color formats including 4:4:4 format, 4:2:0 format, and 4:2:2 format, and wherein the scaling process is based on a first piecewise linear model, and wherein an index identifies a piece to which the variable invAvgLuma belongs, and the at least one scaling factor varScale is derived based on the index. ### Claim 2 (depends on 1) The method of claim 1, wherein, for a luma video block of the video region, at least one of the following is performed: 1) A forward mapping process for the luma video block, in which prediction samples of the luma video block are converted from an original domain to a reshaped domain; or 2) an inverse mapping process, which is an inverse operation of the forward mapping process, in which reconstructed samples of the luma video block in the reshaped domain are converted to the original domain. ### Claim 3 (depends on 2) The method of claim 2, wherein a second piecewise linear model is used to map the prediction samples of the luma video block into particular values during the forward mapping process. ### Claim 4 (depends on 2) The method of claim 2, wherein a filtering process is applied on the converted reconstructed samples of the luma video block in the original domain generated in the inverse mapping process. ### Claim 5 (depends on 3) The method of claim 3, wherein a first syntax element and a second syntax element for the second piecewise linear model are included in the bitstream, the first syntax element plus 1 specifying a number of bits used for representation of the second syntax elements, and the second syntax element specifying an absolute delta code word value for an i-th bin, which is associated the particular values. ### Claim 6 (depends on 5) The method of claim 5, wherein a value of the first syntax element is smaller than a threshold. ### Claim 7 (depends on 6) The method of claim 6, wherein the threshold depends on a bit depth. ### Claim 8 (depends on 1) The method of claim 1, wherein the first piecewise linear model is used for an inverse mapping process, which is an inverse operation of a forward mapping process, in which reconstructed samples of a luma video block of the video region in a reshaped domain are converted to an original domain, wherein in the forward mapping process for the luma video block, prediction samples of the luma video block are converted from the original domain to the reshaped domain. ### Claim 9 (depends on 2) The method of claim 2, wherein a third syntax element and a fourth syntax element are included in the bitstream, the third syntax element specifying a difference between a maximum allowed bin index and a maximum bin index to be used in the forward mapping process, and the fourth syntax element specifying a minimum bin index to be used in the forward mapping process. ### Claim 10 (depends on 9) The method of claim 9, wherein a value of the third syntax element is in a range from 0 to the maximum allowed bin index. ### Claim 11 (depends on 9) The method of claim 9, wherein a value of the fourth syntax element is smaller than or equal to the maximum bin index to be used in the forward mapping process. ### Claim 12 (depends on 9) The method of claim 9, wherein a value of the fourth syntax element is in a range from 0 to the maximum bin index to be used in the forward mapping process. ### Claim 13 (depends on 9) The method of claim 9, wherein the maximum allowed bin index is equal to 15. ### Claim 14 (depends on 1) The method of claim 1, wherein the conversion includes encoding the current chroma video block into the bitstream. ### Claim 15 (depends on 1) The method of claim 1, wherein the conversion includes decoding the current chroma video block from the bitstream. ### Claim 16 An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to: determine, during a conversion between a current chroma video block of a video region of a video and a bitstream of the video, that a scaling process is applied on chroma residual samples of the current chroma video block; and perform the conversion by applying the scaling process on the chroma residual samples based on at least one scaling factor varScale, wherein in the scaling process, the chroma residual samples are scaled before being used to reconstruct the current chroma video block, and wherein the at least one scaling factor varScale is derived based on a variable invAvgLuma which is derived using specific luma samples by an offset-based average operation, and the variable invAvgLuma is calculated depending on a color format of the video, the color format of the video being 4:4:4 format, 4:2:0 format, or 4:2:2 format, wherein the calculated value of invAvgLuma is dependent on position variables used for determining the specific luma samples, and the values of the position variables are determined using the color format of the video, different values of the position variables corresponding to different color formats including 4:4:4 format, 4:2:0 format, and 4:2:2 format, and wherein the scaling process is based on a first piecewise linear model, and wherein an index identifies a piece to which the variable invAvgLuma belongs, and the at least one scaling factor varScale is derived based on the index. ### Claim 17 A non-transitory computer-readable storage medium storing instructions that cause a processor to: determine, during a conversion between a current chroma video block of a video region of a video and a bitstream of the video, that a scaling process is applied on chroma residual samples of the current chroma video block; and perform the conversion by applying the scaling process on the chroma residual samples based on at least one scaling factor varScale, wherein in the scaling process, the chroma residual samples are scaled before being used to reconstruct the current chroma video block, and wherein the at least one scaling factor varScale is derived based on a variable invAvgLuma which is derived using specific luma samples by an offset-based average operation, and the variable invAvgLuma is calculated depending on a color format of the video, the color format of the video being 4:4:4 format, 4:2:0 format, or 4:2:2 format, wherein the calculated value of invAvgLuma is dependent on position variables used for determining the specific luma samples, and the values of the position variables are determined using the color format of the video, different values of the position variables corresponding to different color formats including 4:4:4 format, 4:2:0 format, and 4:2:2 format, and wherein the scaling process is based on a first piecewise linear model, and wherein an index identifies a piece to which the variable invAvgLuma belongs, and the at least one scaling factor varScale is derived based on the index. ### Claim 18 A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises: determining that a scaling process is applied on chroma residual samples of a current chroma video block of a video region of a video; and generating the bitstream by applying the scaling process on the chroma residual samples based on at least one scaling factor varScale, wherein in the scaling process, the chroma residual samples are scaled before being used to reconstruct the current chroma video block, and wherein the at least one scaling factor varScale is derived based on a variable invAvgLuma which is derived using specific luma samples by an offset-based average operation, and the variable invAvgLuma is calculated depending on a color format of the video, the color format of the video being 4:4:4 format, 4:2:0 format, or 4:2:2 format, wherein the calculated value of invAvgLuma is dependent on position variable sused for determining the specific luma samples, and the values of the position variables are determined using the color format of the video, different values of the position variables corresponding to different color formats including 4:4:4 format, 4:2:0 format, and 4:2:2 format, and wherein the scaling process is based on a first piecewise linear model, and wherein an index identifies a piece to which the variable invAvgLuma belongs, and the at least one scaling factor varScale is derived based on the index. ### Claim 19 (depends on 16) The apparatus of claim 16, wherein, for a luma video block of the video region, at least one of the following is performed: 1) A forward mapping process for the luma video block, in which prediction samples of the luma video block are converted from an original domain to a reshaped domain; or 2) an inverse mapping process, which is an inverse operation of the forward mapping process, in which reconstructed samples of the luma video block in the reshaped domain are converted to the original domain. ### Claim 20 (depends on 19) The apparatus of claim 19, wherein a second piecewise linear model is used to map the prediction samples of the luma video block into particular values during the forward mapping process.