# US 2021/0243442 A1 · Learned low-complexity adaptive quantization for video compression > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0243442 A1 - Document ID: US20210243442A1 - Status: Published application - Kind: A1 - Application number: 17/166,639 - Filed: 2021-02-03 - Published: 2021-08-05 - Earliest claimed: 2020-02-05 - Assignees: QUALCOMM Incorporated - Applicants: QUALCOMM Incorporated - Inventors: Amir Said; Reza Pourreza - Web page: https://patentgrep.com/patent/US20210243442A1 ## CPC - H04N 19/124: Quantisation - G06N 20/00: Machine learning - H04N 19/126: Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/18: the unit being a set of transform coefficients - H04N 19/186: the unit being a colour or a chrominance component - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - G06N 3/08: Learning methods - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract A video encoder may determine a set of quantization offset parameters for a group of scaled transform coefficients for a block of video data based on side information associated with the block of video data. The video encoder may further quantize the group of scaled transform coefficients for the block of video data to generate quantized transform coefficients for the block of video data based at least in part on the set of quantization offset parameters. The video encoder may further generate an encoded video bitstream based at least in part on the quantized transform coefficients for the block of video data. ## Claims ### Claim 1 A method of encoding video data, the method comprising: determining a set of quantization offset parameters for a group of scaled transform coefficients for a block of video data based on side information associated with the block of video data; quantizing the group of scaled transform coefficients for the block of video data to generate quantized transform coefficients for the block of video data based at least in part on the set of quantization offset parameters; and generating an encoded video bitstream based at least in part on the quantized transform coefficients for the block of video data. ### Claim 2 (depends on 1) The method of claim 1, wherein determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprises: selecting the set of quantization offset parameters for the group of scaled transform coefficients from a plurality of sets of quantization offset parameters based on the side information associated with the block of video data. ### Claim 3 (depends on 2) The method of claim 2, wherein selecting the set of quantization offset parameters for the group of scaled transform coefficients from the plurality of sets of quantization offset parameters comprises: determining an index associated with the group of scaled transform coefficients based at least in part on the side information associated with the block of video data; and indexing, using the index associated with the group of scaled transform coefficients, into the plurality of sets of quantization offset parameters to select the set of quantization offset parameters for the group of scaled transform coefficients. ### Claim 4 (depends on 2) The method of claim 2, wherein: the group of scaled transform coefficients comprises scaled transform coefficients for a subblock of the block of video data; and the side information associated with the block of video data comprises a location of the subblock within the block of video data and a block size of the block of video data. ### Claim 5 (depends on 4) The method of claim 4, wherein selecting the set of quantization offset parameters for the group of scaled transform coefficients from the plurality of sets of quantization offset parameters comprises: selecting the set of quantization offset parameters for the group of scaled transform coefficients from the plurality of sets of quantization offset parameters without using scaled transform coefficient values of the group of scaled transform coefficients for the subblock of the block of video data. ### Claim 6 (depends on 1) The method of claim 1, wherein determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprises: determining, based on the side information associated with the block of video data, a set of parameters for parametrization of the set of quantization offset parameters, the set of parameters having a smaller size than the set of quantization offset parameters; and determining the set of quantization offset parameters for the group of scaled transform coefficients based on the set of parameters having the smaller size. ### Claim 7 (depends on 1) The method of claim 1, wherein determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data further comprises: determining, using a neural network and based on the side information associated with the block of video data, the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data. ### Claim 8 (depends on 7) The method of claim 7, wherein determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data further comprises: determining, using at least one of: a classification technique or a regression technique, the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data. ### Claim 9 (depends on 1) The method of claim 1, further comprising: dividing a plurality of scaled transform coefficients of the block of video data into a plurality of groups of scaled transform coefficients associated with subblocks of the block of video data, wherein the plurality of groups of scaled transform coefficients includes the group of scaled transform coefficients for the block of video data; wherein determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprises determining, for each of the plurality of groups of scaled transform coefficients, a corresponding set of quantization offset parameters; and wherein quantizing the group of scaled transform coefficients for the block of video data includes quantizing each of the plurality of groups of scaled transform coefficients based on the corresponding set of quantization offset parameters. ### Claim 10 (depends on 1) The method of claim 1, wherein quantizing the group of scaled transform coefficients for the block of video data further comprises: determining, for each scaled transform coefficient of the group of scaled transform coefficients, a corresponding quantization offset parameter from the set of quantization offset parameters; and quantizing each scaled transform coefficient of the group of scaled transform coefficients based at least in part on the corresponding quantization offset parameter. ### Claim 11 (depends on 1) The method of claim 1, wherein the side information includes one or more of: a slice type of the block of video data, block size of the block of video data, or an indication of whether the block of video data comprises a luminance component or a chrominance component. ### Claim 12 (depends on 1) The method of claim 1, wherein determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprises: determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data without using one or more bit cost estimates determined via entropy coding. ### Claim 13 (depends on 1) The method of claim 1, wherein the set of quantization offset parameters comprises quantization offset vectors. ### Claim 14 A device for encoding video data, the device comprising: a memory; processing circuitry in communication with the memory, the processing circuitry being configured to: determine a set of quantization offset parameters for a group of scaled transform coefficients for a block of video data based on side information associated with the block of video data; quantize the group of scaled transform coefficients for the block of video data to generate quantized transform coefficients for the block of video data based at least in part on the set of quantization offset parameters; and generate an encoded video bitstream based at least in part on the quantized transform coefficients for the block of video data. ### Claim 15 (depends on 14) The device of claim 14, wherein to determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data, the processing circuitry is further configured to: select the set of quantization offset parameters for the group of scaled transform coefficients from a plurality of sets of quantization offset parameters based on the side information associated with the block of video data. ### Claim 16 (depends on 15) The device of claim 15, wherein to select the set of quantization offset parameters for the group of scaled transform coefficients from the plurality of sets of quantization offset parameters, the processing circuitry is further configured to: determine an index associated with the group of scaled transform coefficients based at least in part on the side information associated with the block of video data; and index, using the index associated with the group of scaled transform coefficients, into the plurality of sets of quantization offset parameters to select the set of quantization offset parameters for the group of scaled transform coefficients. ### Claim 17 (depends on 15) The device of claim 15, wherein: the group of scaled transform coefficients comprises scaled transform coefficients for a subblock of the block of video data; and the side information associated with the block of video data comprises a location of the subblock within the block of video data and a block size of the block of video data. ### Claim 18 (depends on 17) The device of claim 17, wherein to select the set of quantization offset parameters for the group of scaled transform coefficients from the plurality of sets of quantization offset parameters, the processing circuitry is further configured to: select the set of quantization offset parameters for the group of scaled transform coefficients from the plurality of sets of quantization offset parameters without using scaled transform coefficient values of the group of scaled transform coefficients for the subblock of the block of video data. ### Claim 19 (depends on 14) The device of claim 14, wherein to determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data, the processing circuitry is further configured to: determine, based on the side information associated with the block of video data, a set of parameters for parametrization of the set of quantization offset parameters, the set of parameters having a smaller size than the set of quantization offset parameters; and determine the set of quantization offset parameters for the group of scaled transform coefficients based on the set of parameters having the smaller size. ### Claim 20 (depends on 14) The device of claim 14, wherein to determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data, the processing circuitry is further configured to: determine, using a neural network and based on the side information associated with the block of video data, the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data. ### Claim 21 (depends on 20) The device of claim 20, wherein to determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data, the processing circuitry is further configured to: determine, using at least one of: a classification technique or a regression technique, the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data. ### Claim 22 (depends on 14) The device of claim 14, wherein the processing circuitry is further configured to: divide a plurality of scaled transform coefficients of the block of video data into a plurality of groups of scaled transform coefficients associated with subblocks of the block of video data, wherein the plurality of groups of scaled transform coefficients include the group of scaled transform coefficients for the block of video data; wherein to determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data, the processing circuitry is further configured to determine, for each of the plurality of groups of scaled transform coefficients, a corresponding set of quantization offset parameters; and wherein quantizing the group of scaled transform coefficients for the block of video data includes quantizing each of the plurality of groups of scaled transform coefficients based on the corresponding set of quantization offset parameters. ### Claim 23 (depends on 14) The device of claim 14, wherein to quantize the group of scaled transform coefficients for the block of video data, the processing circuitry is further configured to: determine, for each scaled transform coefficient of the group of scaled transform coefficients, a corresponding quantization offset parameter from the set of quantization offset parameters; and quantize each scaled transform coefficient of the group of scaled transform coefficients based at least in part on the corresponding quantization offset parameter. ### Claim 24 (depends on 14) The device of claim 14, wherein the side information includes one or more of: a slice type of the block of video data, block size of the block of video data, or an indication whether the block of video data comprises a luminance component or a chrominance component. ### Claim 25 (depends on 14) The device of claim 14, wherein to determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data, the processing circuitry is further configured to: determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data without using one or more bit cost estimates determined via entropy coding. ### Claim 26 (depends on 14) The device of claim 14 wherein the set of quantization offset parameters comprises quantization offset vectors. ### Claim 27 (depends on 14) The device of claim 14, wherein the device comprises one or more of a camera, a computer, or a mobile device. ### Claim 28 An apparatus for encoding video data, the apparatus comprising: means for determining a set of quantization offset parameters for a group of scaled transform coefficients for a block of video data based on side information associated with the block of video data; means for quantizing the group of scaled transform coefficients for the block of video data to generate quantized transform coefficients for the block of video data based at least in part on the set of quantization offset parameters; and means for generating an encoded video bitstream based at least in part on the quantized transform coefficients for the block of video data. ### Claim 29 (depends on 28) The apparatus of claim 28, wherein the means for determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data further comprises: means for selecting the set of quantization offset parameters for the group of scaled transform coefficients from a plurality of sets of quantization offset parameters based on the side information associated with the block of video data. ### Claim 30 (depends on 29) The apparatus of claim 29, wherein the means for selecting the set of quantization offset parameters for the group of scaled transform coefficients from the plurality of sets of quantization offset parameters further comprises: means for determining an index associated with the group of scaled transform coefficients based at least in part on the side information associated with the block of video data; and means for indexing, using the index associated with the group of scaled transform coefficients, into the plurality of sets of quantization offset parameters to select the set of quantization offset parameters for the group of scaled transform coefficients. ### Claim 31 (depends on 29) The apparatus of claim 29, wherein: the group of scaled transform coefficients comprises scaled transform coefficients for a subblock of the block of video data; and the side information associated with the block of video data comprises a location of the subblock within the block of video data and a block size of the block of video data. ### Claim 32 (depends on 31) The apparatus of claim 31, wherein the means for selecting the set of quantization offset parameters for the group of scaled transform coefficients from the plurality of sets of quantization offset parameters further comprises: means for selecting the set of quantization offset parameters for the group of scaled transform coefficients from the plurality of sets of quantization offset parameters without using scaled transform coefficient values of the group of scaled transform coefficients for the subblock of the block of video data. ### Claim 33 (depends on 28) The apparatus of claim 28, wherein the means for determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data further comprises: means for determining, based on the side information associated with the block of video data, a set of parameters for parametrization of the set of quantization offset parameters, the set of parameters having a smaller size than the set of quantization offset parameters; and means for determining the set of quantization offset parameters for the group of scaled transform coefficients based on the set of parameters having the smaller size. ### Claim 34 (depends on 28) The apparatus of claim 28, wherein the means for determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data further comprises: means for determining, using a neural network and based on the side information associated with the block of video data, the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data. ### Claim 35 (depends on 34) The apparatus of claim 34, wherein the means for determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprises: means for determining, using at least one of: a classification technique or a regression technique, the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data. ### Claim 36 (depends on 28) The apparatus of claim 28, further comprising: means for dividing a plurality of scaled transform coefficients of the block of video data into a plurality of groups of scaled transform coefficients associated with subblocks of the block of video data, wherein the plurality of groups of scaled transform coefficients include the group of scaled transform coefficients for the block of video data; wherein the means for determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprises means for determining, for each of the plurality of groups of scaled transform coefficients, a corresponding set of quantization offset parameters; wherein the means for quantizing the group of scaled transform coefficients for the block of video data further includes means for quantizing each of the plurality of groups of scaled transform coefficients based on the corresponding set of quantization offset parameters. ### Claim 37 (depends on 28) The apparatus of claim 28, wherein the means for quantizing the group of scaled transform coefficients for the block of video data further comprises: means for determining, for each scaled transform coefficient of the group of scaled transform coefficients, a corresponding quantization offset parameter from the set of quantization offset parameters; and means for quantizing each scaled transform coefficient of the group of scaled transform coefficients based at least in part on the corresponding quantization offset parameter. ### Claim 38 (depends on 28) The apparatus of claim 28, wherein the side information includes one or more of: a slice type of the block of video data, block size of the block of video data, or an indication of whether the block of video data comprises a luminance component or a chrominance component. ### Claim 39 (depends on 28) The apparatus of claim 28, wherein the means for determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprises: means for determining the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data without using one or more bit cost estimates determined via entropy coding. ### Claim 40 (depends on 28) The apparatus of claim 28, wherein the set of quantization offset parameters comprises quantization offset vectors. ### Claim 41 A computer-readable storage medium having stored thereon instructions that, when executed, cause one or more processors to: determine a set of quantization offset parameters for a group of scaled transform coefficients for a block of video data based on side information associated with the block of video data; quantize the group of scaled transform coefficients for the block of video data to generate quantized transform coefficients for the block of video data based at least in part on the set of quantization offset parameters; and generate an encoded video bitstream based at least in part on the quantized transform coefficients for the block of video data. ### Claim 42 (depends on 41) The computer-readable storage medium of claim 41, wherein the instructions that cause the one or more processors to determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprise instructions that cause the one or more processors to: select the set of quantization offset parameters for the group of scaled transform coefficients from a plurality of sets of quantization offset parameters based on the side information associated with the block of video data. ### Claim 43 (depends on 42) The computer-readable storage medium of claim 42, wherein the instructions that cause the one or more processors to select the set of quantization offset parameters for the group of scaled transform coefficients from the plurality of sets of quantization offset parameters comprise instructions that cause the one or more processors to: determine an index for the group of scaled transform coefficients based at least in part on the side information associated with the block of video data; and index, using the index, into the plurality of sets of quantization offset parameters to select the set of quantization offset parameters for the group of scaled transform coefficients. ### Claim 44 (depends on 42) The computer-readable storage medium of claim 42, wherein: the group of scaled transform coefficients comprises scaled transform coefficients for a subblock of the block of video data; and the side information associated with the block of video data comprises a location of the subblock within the block of video data and a block size of the block of video data. ### Claim 45 (depends on 44) The computer-readable storage medium of claim 44, wherein the instructions that cause the one or more processors to select the set of quantization offset parameters for the group of scaled transform coefficients from the plurality of sets of quantization offset parameters comprise instructions that cause the one or more processors to: select the set of quantization offset parameters for the group of scaled transform coefficients from the plurality of sets of quantization offset parameters without using scaled transform coefficient values of the group of scaled transform coefficients for the subblock of the block of video data. ### Claim 46 (depends on 41) The computer-readable storage medium of claim 41, wherein the instructions that cause the one or more processors to determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprise instructions that cause the one or more processors to: determine, based on the side information associated with the block of video data, a set of parameters for parametrization of the set of quantization offset parameters, the set of parameters having a smaller size than the set of quantization offset parameters; and determine the set of quantization offset parameters for group of scaled transform coefficients based on the set of parameters having the smaller size. ### Claim 47 (depends on 41) The computer-readable storage medium of claim 41, wherein the instructions that cause the one or more processors to determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprise instructions that cause the one or more processors to: determine, using a neural network and based on the side information associated with the block of video data, the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data. ### Claim 48 (depends on 47) The computer-readable storage medium of claim 47, wherein the instructions that cause the one or more processors to determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprise instructions that cause the one or more processors to: determine, using at least one of: a classification technique or a regression technique, the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data. ### Claim 49 (depends on 41) The computer-readable storage medium of claim 41, wherein the instructions further cause the one or more processors to: divide a plurality of scaled transform coefficients of the block of video data into a plurality of groups of scaled transform coefficients associated with subblocks of the block of video data, wherein the plurality of groups of scaled transform coefficients include the group of scaled transform coefficients for the block of video data; wherein the instructions that cause the one or more processors to determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprise instructions that cause the one or more processors to determine, for each of the plurality of groups of scaled transform coefficients, a corresponding set of quantization offset parameters; and wherein the instructions that cause the one or more processors to quantize the group of scaled transform coefficients for the block of video data comprise instructions that cause the one or more processors to quantize each of the plurality of groups of scaled transform coefficients based on the corresponding set of quantization offset parameters. ### Claim 50 (depends on 41) The computer-readable storage medium of claim 41, wherein the instructions that cause the one or more processors to quantize the group of scaled transform coefficients for the block of video data comprise instructions that cause the one or more processors to: determine, for each scaled transform coefficient of the group of scaled transform coefficients, a corresponding quantization offset parameter from the set of quantization offset parameters; and quantize each scaled transform coefficient of the group of scaled transform coefficients based at least in part on the corresponding quantization offset parameter. ### Claim 51 (depends on 41) The computer-readable storage medium of claim 41, wherein the side information includes one or more of: a slice type of the block of video data, block size of the block of video data, or an indication of whether the block of video data comprises a luminance component or a chrominance component. ### Claim 52 (depends on 41) The computer-readable storage medium of claim 41, wherein the instructions that cause the one or more processors to determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data comprise instructions that cause the one or more processors to: determine the set of quantization offset parameters for the group of scaled transform coefficients for the block of video data without using one or more bit cost estimates determined via entropy coding. ### Claim 53 (depends on 41) The computer-readable storage medium of claim 41, wherein the set of quantization offset parameters comprises quantization offset vectors.