# US 11,122,268 B2 · Adaptive quantization for enhancement layer video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,122,268 B2
- Document ID: US11122268B2
- Status: Granted
- Kind: B2
- Application number: 16/384,704
- Filed: 2019-04-15
- Published: 2019-10-10
- Granted: 2021-09-14
- Earliest claimed: 2008-06-03
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Shankar Regunathan; Shijun Sun; Chengjie Tu; Chih-Lung Lin
- Web page: https://patentgrep.com/patent/US11122268B2

## CPC

- H04N 19/126: Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
- H04N 19/124: Quantisation
- H04N 19/172: the region being a picture, frame or field
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/187: the unit being a scalable video layer
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N 19/197: {including determination of the initial value of an encoding parameter (H04N19/56 takes precedence)}
- H04N 19/34: Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/463: by compressing encoding parameters before transmission
- H04N 19/593: involving spatial prediction techniques
- H04N 19/61: in combination with predictive coding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/184: the unit being bits, e.g. of the compressed video stream
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Techniques and tools for encoding enhancement layer video with quantization that varies spatially and/or between color channels are presented, along with corresponding decoding techniques and tools. For example, an encoding tool determines whether quantization varies spatially over a picture, and the tool also determines whether quantization varies between color channels in the picture. The tool signals quantization parameters for macroblocks in the picture in an encoded bit stream. In some implementations, to signal the quantization parameters, the tool predicts the quantization parameters, and the quantization parameters are signaled with reference to the predicted quantization parameters. A decoding tool receives the encoded bit stream, predicts the quantization parameters, and uses the signaled information to determine the quantization parameters for the macroblocks of the enhancement layer video. The decoding tool performs inverse quantization that can vary spatially and/or between color channels.

## Claims

### Claim 1

A computer system comprising one or more processing units and memory, wherein the computer system implements an encoding system comprising:
a video encoder configured to encode video for a picture organized in multiple channels, the multiple channels including a luma channel and two chroma channels, wherein the video encoder is configured to:
vary quantization spatially and between the multiple channels of the video for the picture; and
for a current unit of the video for the picture, predict a unit-level quantization parameter (“QP”) for the current unit using multiple unit-level QPs for spatially neighboring units; and
a buffer configured to store, for output in a bitstream, the encoded video for the picture, the encoded video for the picture including QP information that indicates multiple QPs that at least in part parameterize the varied quantization of the video for the picture, the QP information including the unit-level QP for the current unit signaled as a differential QP relative to the predicted unit-level QP for the current unit.

### Claim 2 (depends on 1)

The computer system of claim 1, wherein the units are blocks, and wherein the video encoder is further configured to determine whether to use spatial quantization variation between the blocks of the video for the picture based at least in part on a user setting that controls speed and complexity of the encoding.

### Claim 3 (depends on 1)

The computer system of claim 1, wherein the units are blocks, and wherein the video encoder is further configured to determine whether to use spatial quantization variation between the blocks of the video for the picture based at least in part on analysis of complexity and spatial variance of the video for the picture.

### Claim 4 (depends on 1)

The computer system of claim 1, wherein the video encoder is further configured to perform the quantization on transform coefficients of units of the video for the picture.

### Claim 5 (depends on 1)

The computer system of claim 1, wherein the QP information further comprises picture-level information that indicates one or more picture-level QPs for the video for the picture or respective channels of the video for the picture.

### Claim 6 (depends on 1)

The computer system of claim 1, wherein the spatially neighboring units include a left unit that is to the left of the current unit and an above unit that is above the current unit, and wherein, to predict the unit-level QP for the current unit, the video encoder is configured to use one or more prediction rules based upon QP for the left unit and QP for the above unit.

### Claim 7 (depends on 6)

The computer system of claim 6, wherein, according to the one or more prediction rules, when the QP for the left unit equals the QP for the above unit, then the predicted unit-level QP for the current unit is the QP for the left unit.

### Claim 8 (depends on 6)

The computer system of claim 6, wherein, according to the one or more prediction rules:
when the QP for the left unit is not available, another QP is substituted for the QP for the left unit; and
when the QP for the above unit is not available, another QP is substituted for the QP for the above unit.

### Claim 9 (depends on 1)

The computer system of claim 1, wherein the units are blocks, and wherein the video encoder is further configured to:
determine whether to use spatial quantization variation between the blocks of the video for the picture; and
determine whether to use quantization variation between channels; and wherein the encoded video further includes:
information that indicates whether the spatial quantization variation is used between the blocks of the video for the picture; and
information that indicates whether the quantization variation between channels is used.

### Claim 10

One or more computer-readable media having stored thereon encoded data in a bitstream for video for a picture organized in multiple channels, the multiple channels including a luma channel and two chroma channels, the encoded data including quantization parameter (“QP”) information that indicates multiple QPs that at least in part parameterize inverse quantization of the video for the picture, the QP information including a differential QP for a unit-level QP for a current unit of the video for the picture, wherein the one or more computer-readable media are selected from the group consisting of volatile memory, non-volatile memory, magnetic disk, CD-ROM, and DVD, and wherein the encoded data is organized to facilitate decoding the video for the picture by operations that include varying inverse quantization spatially and between the multiple channels of the video for the picture, the operations further including, for the current unit:
predicting the unit-level QP for the current unit using multiple unit-level QPs for spatially neighboring units; and
combining the predicted unit-level QP for the current unit with the differential QP from the bitstream for the current unit.

### Claim 11 (depends on 10)

The one or more computer-readable media of claim 10, wherein the encoded data further includes quantized transform coefficients of the current unit, and wherein the operations further include, for the current unit:
performing the inverse quantization on the quantized transform coefficients of the current unit.

### Claim 12 (depends on 10)

The one or more computer-readable media of claim 10, wherein the QP information further comprises picture-level information that indicates one or more picture-level QPs for the video for the picture or respective channels of the video for the picture.

### Claim 13 (depends on 10)

The one or more computer-readable media of claim 10, wherein the spatially neighboring units include a left unit that is to the left of the current unit and an above unit that is above the current unit, and wherein the predicting the unit-level QP for the current unit uses one or more prediction rules based upon QP for the left unit and QP for the above unit.

### Claim 14

In a computing device that implements a video decoder, a method comprising:
receiving encoded data in a bitstream for video for a picture organized in multiple channels, the multiple channels including a luma channel and two chroma channels, the encoded data including quantization parameter (“QP”) information that indicates multiple QPs that at least in part parameterize inverse quantization of the video for the picture, the QP information including a differential QP for a unit-level QP for a current unit of the video for the picture; and
decoding the video for the picture, including varying inverse quantization spatially and between the multiple channels of the video for the picture, and further including for the current unit:
predicting the unit-level QP for the current unit using multiple unit-level QPs for spatially neighboring units; and
combining the predicted unit-level QP for the current unit with the differential QP from the bitstream for the current unit.

### Claim 15 (depends on 14)

The method of claim 14, wherein the decoding includes performing the inverse quantization on quantized transform coefficients of units of the video for the picture.

### Claim 16 (depends on 14)

The method of claim 14, wherein the QP information further comprises picture-level information that indicates one or more picture-level QPs for the video for the picture or respective channels of the video for the picture.

### Claim 17 (depends on 14)

The method of claim 14, wherein the spatially neighboring units include a left unit that is to the left of the current unit and an above unit that is above the current unit, and wherein the predicting the unit-level QP for the current unit uses one or more prediction rules based upon QP for the left unit and QP for the above unit.

### Claim 18 (depends on 17)

The method of claim 17, wherein, according to the one or more prediction rules, when the QP for the left unit equals the QP for the above unit, then the predicted unit-level QP for the current unit is the QP for the left unit.

### Claim 19 (depends on 17)

The method of claim 17, wherein, according to the one or more prediction rules:
when the QP for the left unit is not available, another QP is substituted for the QP for the left unit; and
when the QP for the above unit is not available, another QP is substituted for the QP for the above unit.

### Claim 20 (depends on 14)

The method of claim 14, wherein the units are blocks, wherein the encoded data further includes information in the bitstream that indicates whether spatial quantization variation is used between the blocks of the video for the picture, and wherein the decoding further comprises determining whether to use the spatial quantization variation between the blocks of the video for the picture.