# US 2020/0404286 A1 · Binarization in transform skip residual coding > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0404286 A1 - Document ID: US20200404286A1 - Status: Published application - Kind: A1 - Application number: 16/909,892 - Filed: 2020-06-23 - Published: 2020-12-24 - Earliest claimed: 2019-06-24 - Assignees: QUALCOMM Incorporated - Applicants: QUALCOMM Incorporated - Inventors: Marta Karczewicz; Yung-Hsuan Chao; Muhammed Zeyd Coban; Hongtao Wang - Web page: https://patentgrep.com/patent/US20200404286A1 ## CPC - H04N 19/13: Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC] - H04L 65/70: Media network packetisation - H04L 65/756: adapting media to device capabilities - H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)} - H04L 65/764: {at the destination (reformatting of additional data in video clients H04N21/4355)} - H04N 19/124: Quantisation - H04N 19/136: Incoming video signal characteristics or properties - H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence) - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder - H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract A video decoder can be configured to determine that a block of video data is encoded without transforming residual data for the block; determine a quantization parameter for the block of video data; based on the determined quantization parameter, determine a range for levels of quantized residual values of the block; divide the range into k intervals, wherein k is an integer value; determine a level for a quantized residual value of the block based on the k intervals by receiving information indicating the level for the quantized residual value is within a particular interval of the k intervals, receiving information indicating a difference value that represents a difference between a reference level value for the particular interval and the level for the quantized residual value of the block, and based on the reference level value and the difference value, determining the level for the quantized residual value. ## Claims ### Claim 1 A method of decoding video data, the method comprising: determining that a block of video data is encoded without transforming residual data for the block; determining a quantization parameter for the block of video data; based on the determined quantization parameter, determining a range for levels of quantized residual values of the block of video data; dividing the range into k intervals, wherein k is an integer value; determining a level for a quantized residual value of the block of video data based on the k intervals, wherein determining the level for the quantized residual value of the block of video data based on the k intervals comprises: receiving information indicating the level for the quantized residual value is within a particular interval of the k intervals; receiving information indicating a difference value, wherein the difference value represents a difference between a reference level value for the particular interval and the level for the quantized residual value of the block of video data; and based on the reference level value and the difference value, determining the level for the quantized residual value; and outputting decoded video data based on the level for the quantized residual value. ### Claim 2 (depends on 1) The method of claim 1, further comprising: dequantizing the level for the quantized residual value to determine a level for a dequantized residual value; receiving a syntax element indicating a sign for the dequantized residual value; and based on the level for the dequantized residual value and the sign for the dequantized residual value, determining the dequantized residual value. ### Claim 3 (depends on 2) The method of claim 2, further comprising: determining a residual block for the block of video data, wherein the residual block comprises the dequantized residual value; adding the residual block to a prediction block for the block of video data to determine a reconstructed block for the block of video data; generating a picture of decoded video data based on the reconstructed block; and outputting the picture of decoded video data. ### Claim 4 (depends on 1) The method of claim 1, wherein a first interval of the k intervals includes values ranging from 1 to a first threshold, the method further comprising: receiving a syntax element indicating that the level for the quantized residual value is greater than zero. ### Claim 5 (depends on 1) The method of claim 1, wherein a first interval of the k intervals includes values ranging from 2 to a first threshold, the method further comprising: receiving a syntax element indicating that the level for the quantized residual value is greater than zero; receiving a syntax element indicating that the level for the quantized residual value is greater than one. ### Claim 6 (depends on 1) The method of claim 1, further comprising: for a first interval of the k intervals, receiving a syntax element indicating that the level for the quantized residual value is greater than values included in the first interval; for a second interval of the k intervals, receiving a syntax element indicating that the level for the quantized residual value is included in the second interval; wherein the syntax element indicating the difference value indicates a difference between a reference level value for the second interval and the level for the quantized residual value of the block of video data. ### Claim 7 (depends on 1) The method of claim 1, further comprising: receiving, for respective intervals of the k intervals, flags indicating that the level for the quantized residual value is greater than values included in the respective intervals for the flags until receiving a flag indicating the level for the quantized residual value is within an interval associated with the flag. ### Claim 8 (depends on 1) The method of claim 1, wherein the k intervals include an interval ranging from 0 to a first threshold, an interval ranging from the first threshold plus 1 to a second threshold, and an interval ranging from the second threshold plus 1 to a third threshold, the method further comprising: determining the first threshold, the second threshold, and the third threshold based on the quantization parameter. ### Claim 9 (depends on 1) The method of claim 1, wherein the k intervals include an interval ranging from 1 to a first threshold, an interval ranging from the first threshold plus 1 to a second threshold, and an interval ranging from the second threshold plus 1 to a third threshold, the method further comprising: determining the first threshold, the second threshold, and the third threshold based on the quantization parameter. ### Claim 10 (depends on 1) The method of claim 1, wherein the k intervals include an interval ranging from 2 to a first threshold, an interval ranging from the first threshold plus 1 to a second threshold, and an interval ranging from the second threshold plus 1 to a third threshold, the method further comprising: determining the first threshold, the second threshold, and the third threshold based on the quantization parameter. ### Claim 11 (depends on 10) The method of claim 10, wherein the k intervals include an interval ranging from the third threshold plus 1 to a maximum value for the range. ### Claim 12 (depends on 1) The method of claim 1, wherein the k intervals include the following intervals: [2,t1],[t1+1,t2],[t2+1,t3], . . . [tk-2+1,tk-1],[tk-1+1,maxTsLevel], wherein maxTsLevel represents a maximum possible level for the levels of quantized residual values of the block of video data based on the quantization parameter for the block of video data, and wherein tn represents an upper threshold for the n-th interval, wherein n ranges from 0 to k−1. ### Claim 13 (depends on 1) The method of claim 1, further comprising: bypass decoding the syntax element indicating the difference value. ### Claim 14 A method of generating a bitstream of encoded video data, the method comprising: determining that a block of video data is encoded without transforming residual data for the block; determining a level for a quantized residual value of the block of video data; determining a quantization parameter for the block of video data; based on the determined quantization parameter, determining a range for levels of quantized residual values of the block of video data; dividing the range into k intervals, wherein k is an integer value; determining a particular interval of the k intervals that includes the level for the quantized residual value; determining a difference value, wherein the difference value represents a difference between a reference level value for the particular interval and the level for the quantized residual value of the block of video data; and signaling the level for the quantized residual value of the block of video data based on the k intervals, wherein signaling the level for the quantized residual value of the block of video data based on the k intervals comprises: generating, for inclusion in the bitstream of encoded video data, one or more syntax elements indicating the particular interval; generating, for inclusion in the bitstream of encoded video data, a syntax element indicating the difference value; and outputting the bitstream of encoded video data. ### Claim 15 (depends on 14) The method of claim 14, wherein determining the level for the quantized residual value of the block of video data comprises: determining a level for a residual value; and quantizing the level for the residual value to determine the level for the quantized residual value. ### Claim 16 (depends on 15) The method of claim 15, further comprising: generating, for inclusion in the bitstream of encoded video data, a syntax element indicating a sign for the residual value. ### Claim 17 (depends on 14) The method of claim 14, wherein a first interval of the k intervals includes values ranging from 1 to a first threshold, the method further comprising: generating, for inclusion in the bitstream of encoded video data, a syntax element indicating that the level of the quantized residual value is greater than zero. ### Claim 18 (depends on 14) The method of claim 14, wherein a first interval of the k intervals includes values ranging from 2 to a first threshold, the method further comprising: generating, for inclusion in the bitstream of encoded video data, a syntax element indicating that the level for the quantized residual value is greater than zero; generating, for inclusion in the bitstream of encoded video data, a syntax element indicating that the level for the quantized residual value is greater than one. ### Claim 19 (depends on 14) The method of claim 14, further comprising: for a first interval of the k intervals, generating, for inclusion in the bitstream of encoded video data, a syntax element indicating that the level for the quantized residual value is greater than values included in the first interval; for a second interval of the k intervals, generating, for inclusion in the bitstream of encoded video data, a syntax element indicating that the level for the quantized residual value is included in the second interval; wherein the syntax element indicating the difference value indicates a difference between a reference level value for the second interval and the level for the quantized residual value of the block of video data. ### Claim 20 (depends on 14) The method of claim 14, further comprising: generating, for inclusion in the bitstream of encoded video data, for respective intervals of the k intervals, flags indicating that the level for the quantized residual value is greater than values included in the respective intervals for the flags until generating, for inclusion in the bitstream of encoded video data, a flag indicating the level for the quantized residual value is within an interval associated with the flag. ### Claim 21 (depends on 14) The method of claim 14, wherein the k intervals include an interval ranging from 0 to a first threshold, an interval ranging from the first threshold plus 1 to a second threshold, and an interval ranging from the second threshold plus 1 to a third threshold, the method further comprising: determining the first threshold, the second threshold, and the third threshold based on the quantization parameter. ### Claim 22 (depends on 14) The method of claim 14, wherein the k intervals include an interval ranging from 1 to a first threshold, an interval ranging from the first threshold plus 1 to a second threshold, and an interval ranging from the second threshold plus 1 to a third threshold, the method further comprising: determining the first threshold, the second threshold, and the third threshold based on the quantization parameter. ### Claim 23 (depends on 14) The method of claim 14, wherein the k intervals include an interval ranging from 2 to a first threshold, an interval ranging from the first threshold plus 1 to a second threshold, and an interval ranging from the second threshold plus 1 to a third threshold, the method further comprising: determining the first threshold, the second threshold, and the third threshold based on the quantization parameter. ### Claim 24 (depends on 23) The method of claim 23, wherein the k intervals include an interval ranging from the third threshold plus 1 to a maximum value for the range. ### Claim 25 (depends on 14) The method of claim 14, wherein the k intervals include the following intervals: [2,t1],[t1+1,t2],[t2+1,t3], . . . [tk-2+1,tk-1],[tk-1+1,maxTsLevel], wherein maxTsLevel represents a maximum possible level for the levels of quantized residual values of the block of video data based on the quantization parameter for the block of video data, and wherein tn represents an upper threshold for the n-th interval, wherein n ranges from 0 to k−1. ### Claim 26 (depends on 14) The method of claim 14, further comprising: bypass encoding the syntax element indicating the difference value. ### Claim 27 A device for decoding video data, the device comprising: a memory configured to store video data; and one or more processors configured to: determine that a block of video data is encoded without transforming residual data for the block; determine a quantization parameter for the block of video data; based on the determined quantization parameter, determine a range for levels of quantized residual values of the block of video data; divide the range into k intervals, wherein k is an integer value; determine a level for a quantized residual value of the block of video data based on the k intervals, wherein to determine the level for the quantized residual value of the block of video data based on the k intervals, the one or more processors are further configured to: receive information indicating the level for the quantized residual value is within a particular interval of the k intervals; receive information indicating a difference value, wherein the difference value represents a difference between a reference level value for the particular interval and the level for the quantized residual value of the block of video data; and based on the reference level value and the difference value, determine the level for the quantized residual value; and output decoded video data based on the level for the quantized residual value. ### Claim 28 (depends on 27) The device of claim 27, wherein the one or more processors are further configured to: dequantize the level for the quantized residual value to determine a level for a dequantized residual value; receive a syntax element indicating a sign for the dequantized residual value; and based on the level for the dequantized residual value and the sign for the dequantized residual value, determine the dequantized residual value. ### Claim 29 (depends on 28) The device of claim 28, wherein the one or more processors are further configured to: determine a residual block for the block of video data, wherein the residual block comprises the dequantized residual value; add the residual block to a prediction block for the block of video data to determine a reconstructed block for the block of video data; generate a picture of decoded video data based on the reconstructed block; and output the picture of decoded video data. ### Claim 30 (depends on 27) The device of claim 27, wherein a first interval of the k intervals includes values ranging from 1 to a first threshold, wherein the one or more processors are further configured to: receive a syntax element indicating that the level for the quantized residual value is greater than zero. ### Claim 31 (depends on 27) The device of claim 27, wherein a first interval of the k intervals includes values ranging from 2 to a first threshold, wherein the one or more processors are further configured to: receive a syntax element indicating that the level for the quantized residual value is greater than zero; receive a syntax element indicating that the level for the quantized residual value is greater than one. ### Claim 32 (depends on 27) The device of claim 27, wherein the one or more processors are further configured to: for a first interval of the k intervals, receive a syntax element indicating that the level for the quantized residual value is greater than values included in the first interval; for a second interval of the k intervals, receive a syntax element indicating that the level for the quantized residual value is included in the second interval; wherein the syntax element indicating the difference value indicates a difference between a reference level value for the second interval and the level for the quantized residual value of the block of video data. ### Claim 33 (depends on 27) The device of claim 27, wherein the one or more processors are further configured to: receive, for respective intervals of the k intervals, flags indicating that the level for the quantized residual value is greater than values included in the respective intervals for the flags until receiving a flag indicating the level for the quantized residual value is within an interval associated with the flag. ### Claim 34 (depends on 27) The device of claim 27, wherein the k intervals include an interval ranging from 0 to a first threshold, an interval ranging from the first threshold plus 1 to a second threshold, and an interval ranging from the second threshold plus 1 to a third threshold, wherein the one or more processors are further configured to: determine the first threshold, the second threshold, and the third threshold based on the quantization parameter. ### Claim 35 (depends on 27) The device of claim 27, wherein the k intervals include an interval ranging from 1 to a first threshold, an interval ranging from the first threshold plus 1 to a second threshold, and an interval ranging from the second threshold plus 1 to a third threshold, wherein the one or more processors are further configured to: determine the first threshold, the second threshold, and the third threshold based on the quantization parameter. ### Claim 36 (depends on 27) The device of claim 27, wherein the k intervals include an interval ranging from 2 to a first threshold, an interval ranging from the first threshold plus 1 to a second threshold, and an interval ranging from the second threshold plus 1 to a third threshold, wherein the one or more processors are further configured to: determine the first threshold, the second threshold, and the third threshold based on the quantization parameter. ### Claim 37 (depends on 36) The device of claim 36, wherein the k intervals include an interval ranging from the third threshold plus 1 to a maximum value for the range. ### Claim 38 (depends on 27) The device of claim 27, wherein the k intervals include the following intervals: [2,t1],[t1+1,t2],[t2+1,t3], . . . [tk-2+1,tk-1],[tk-1+1,maxTsLevel], wherein maxTsLevel represents a maximum possible level for the levels of quantized residual values of the block of video data based on the quantization parameter for the block of video data, and wherein tn represents an upper threshold for the n-th interval, wherein n ranges from 0 to k−1. ### Claim 39 (depends on 27) The device of claim 27, wherein the one or more processors are further configured to: bypass decode the syntax element indicating the difference value. ### Claim 40 (depends on 27) The device of claim 27, wherein the device comprises a wireless communication device, further comprising a receiver configured to receive encoded video data and a display configured to display the decoded video data. ### Claim 41 (depends on 40) The device of claim 40, wherein the wireless communication device comprises a telephone handset and wherein the receiver is configured to demodulate, according to a wireless communication standard, a signal comprising the encoded video data. ### Claim 42 A device for encoding video data, the device comprising: a memory configured to store video data; and one or more processors configured to: determine that a block of video data is encoded without transforming residual data for the block; determine a level for a quantized residual value of the block of video data; determine a quantization parameter for the block of video data; based on the determined quantization parameter, determine a range for levels of quantized residual values of the block of video data; divide the range into k intervals, wherein k is an integer value; determine a particular interval of the k intervals that includes the level for the quantized residual value; determine a difference value, wherein the difference value represents a difference between a reference level value for the particular interval and the level for the quantized residual value of the block of video data; signal the level for the quantized residual value of the block of video data based on the k intervals, wherein to signal the level for the quantized residual value of the block of video data based on the k intervals the one or more processors are further configured to: generate, for inclusion in the bitstream of encoded video data, one or more syntax elements indicating the particular interval; generate, for inclusion in the bitstream of encoded video data, a syntax element indicating the difference value; and output the bitstream of encoded video data. ### Claim 43 (depends on 42) The device of claim 42, wherein to determine the level for the quantized residual value of the block of video data, the one or more processors are further configured to: determine a level for a residual value; and quantize the level for the residual value to determine the level for the quantized residual value. ### Claim 44 (depends on 43) The device of claim 43, the one or more processors are further configured to: generate, for inclusion in the bitstream of encoded video data, a syntax element indicating a sign for the residual value. ### Claim 45 (depends on 42) The device of claim 42, wherein a first interval of the k intervals includes values ranging from 1 to a first threshold, wherein the one or more processors are further configured to: generate, for inclusion in the bitstream of encoded video data, a syntax element indicating that the level of the quantized residual value is greater than zero. ### Claim 46 (depends on 42) The device of claim 42, wherein a first interval of the k intervals includes values ranging from 2 to a first threshold, wherein the one or more processors are further configured to: generate, for inclusion in the bitstream of encoded video data, a syntax element indicating that the level for the quantized residual value is greater than zero; generate, for inclusion in the bitstream of encoded video data, a syntax element indicating that the level for the quantized residual value is greater than one. ### Claim 47 (depends on 42) The device of claim 42, wherein the one or more processors are further configured to: for a first interval of the k intervals, generate, for inclusion in the bitstream of encoded video data, a syntax element indicating that the level for the quantized residual value is greater than values included in the first interval; for a second interval of the k intervals, generate, for inclusion in the bitstream of encoded video data, a syntax element indicating that the level for the quantized residual value is included in the second interval; wherein the syntax element indicating the difference value indicates a difference between a reference level value for the second interval and the level for the quantized residual value of the block of video data. ### Claim 48 (depends on 42) The device of claim 42, wherein the one or more processors are further configured to: generate, for inclusion in the bitstream of encoded video data, for respective intervals of the k intervals, flags indicating that the level for the quantized residual value is greater than values included in the respective intervals for the flags until generating, for inclusion in the bitstream of encoded video data, a flag indicating the level for the quantized residual value is within an interval associated with the flag. ### Claim 49 (depends on 42) The device of claim 42, wherein the k intervals include an interval ranging from 0 to a first threshold, an interval ranging from the first threshold plus 1 to a second threshold, and an interval ranging from the second threshold plus 1 to a third threshold, wherein the one or more processors are further configured to: determine the first threshold, the second threshold, and the third threshold based on the quantization parameter. ### Claim 50 (depends on 42) The device of claim 42, wherein the k intervals include an interval ranging from 1 to a first threshold, an interval ranging from the first threshold plus 1 to a second threshold, and an interval ranging from the second threshold plus 1 to a third threshold, wherein the one or more processors are further configured to: determine the first threshold, the second threshold, and the third threshold based on the quantization parameter. ### Claim 51 (depends on 42) The device of claim 42, wherein the k intervals include an interval ranging from 2 to a first threshold, an interval ranging from the first threshold plus 1 to a second threshold, and an interval ranging from the second threshold plus 1 to a third threshold, wherein the one or more processors are further configured to: determine the first threshold, the second threshold, and the third threshold based on the quantization parameter. ### Claim 52 (depends on 51) The device of claim 51, wherein the k intervals include an interval ranging from the third threshold plus 1 to a maximum value for the range. ### Claim 53 (depends on 42) The device of claim 42, wherein the k intervals include the following intervals: [2,t1],[t1+1,t2],[t2+1,t3], . . . [tk-2+1,tk-1],[tk-1+1,maxTsLevel], wherein maxTsLevel represents a maximum possible level for the levels of quantized residual values of the block of video data based on the quantization parameter for the block of video data, and wherein tn represents an upper threshold for the n-th interval, wherein n ranges from 0 to k−1. ### Claim 54 (depends on 42) The device of claim 42, wherein the one or more processors are further configured to: bypass encode the syntax element indicating the difference value. ### Claim 55 (depends on 42) The device of claim 42, wherein the device comprises a wireless communication device, further comprising a transmitter configured to transmit encoded video data. ### Claim 56 (depends on 55) The device of claim 55, wherein the wireless communication device comprises a telephone handset and wherein the transmitter is configured to modulate, according to a wireless communication standard, a signal comprising the encoded video data. ### Claim 57 A computer readable storage medium storing instructions that when executed by one or more processors cause the one or more processors to determine that a block of video data is encoded without transforming residual data for the block; determine a quantization parameter for the block of video data; based on the determined quantization parameter, determine a range for levels of quantized residual values of the block of video data; divide the range into k intervals, wherein k is an integer value; determine a level for a quantized residual value of the block of video data based on the k intervals, wherein to determine the level for the quantized residual value of the block of video data based on the k intervals, the instructions cause the one or more processors to: receive information indicating the level for the quantized residual value is within a particular interval of the k intervals; receive information indicating a difference value, wherein the difference value represents a difference between a reference level value for the particular interval and the level for the quantized residual value of the block of video data; and based on the reference level value and the difference value, determine the level for the quantized residual value; and output decoded video data based on the level for the quantized residual value. ### Claim 58 An apparatus for decoding video data, the apparatus comprising: means for determining that a block of video data is encoded without transforming residual data for the block; means for determining a quantization parameter for the block of video data; means for determining a range for levels of quantized residual values of the block of video data based on the determined quantization parameter; means for dividing the range into k intervals, wherein k is an integer value; means for determining a level for a quantized residual value of the block of video data based on the k intervals, wherein the means for determining the level for the quantized residual value of the block of video data based on the k intervals comprises: means for receiving information indicating the level for the quantized residual value is within a particular interval of the k intervals; means for receiving information indicating a difference value, wherein the difference value represents a difference between a reference level value for the particular interval and the level for the quantized residual value of the block of video data; and means for determining the level for the quantized residual value based on the reference level value and the difference value; and means for outputting decoded video data based on the level for the quantized residual value.