# US 2022/0286667 A1 · Video coding using reference picture resampling supporting region of interest

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0286667 A1
- Document ID: US20220286667A1
- Status: Published application
- Kind: A1
- Application number: 17/422,710
- Filed: 2020-03-11
- Published: 2022-09-08
- Earliest claimed: 2019-03-11
- Assignees: Dolby Laboratories Licensing Corporation
- Applicants: Dolby Laboratories Licensing Corporation
- Inventors: Taoran LU; Fangjun PU; Peng YIN; Sean Thomas McCarthy; Tao CHEN
- Web page: https://patentgrep.com/patent/US20220286667A1

## CPC

- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/33: in the spatial domain
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods, systems, and bitstream syntax are described for canvas size, single layer or multi-layer, sealable decoding, with support for regions of interest (ROI). using a decoder supporting reference picture resampling. Offset parameters for a region of interest in a current picture and offset parameters for an ROI in a reference picture are taken into consideration when computing scaling factors to apply reference picture resampling Syntax elements for supporting ROI regions under reference picture resampling arc also presented.

## Claims

### Claim 1

A method to decode a coded bitstream with region of interest (ROI) support, the method performed by a processor and comprising:
receiving a coded bitstream comprising coded pictures and syntax parameters for one or more regions of interest (ROI) within the coded pictures, wherein the syntax parameters comprise a picture header with ROI picture header parameters and a slice header with ROI slice header parameters, wherein the ROI picture header parameters comprise an ROI enabling flag and ROI offset parameters for a scaling window, and the ROI slice header parameters comprise an ROI switch parameter denoting whether ROI scaling is enabled at a slice level and whether the ROI offset parameters in the picture header are applied to a reference picture or a current picture; and
decoding a coded region in a current picture in the coded bitstream, wherein decoding the coded region comprises:
for the current picture and an active reference picture in an Inter slice:
initializing a default scaling window in the Inter slice using values defined in a picture parameter set;
if detecting that the ROI enabling flag is set to 1:
overriding the parameters of the default scaling window based on the ROI offset parameters and the ROI switch parameter to generate an ROI scaling window; and
applying reference picture resampling using the ROI scaling window.

### Claim 2 (depends on 1)

The method of claim 1, wherein for the active reference picture, the ROI switch parameter comprises three values: 0, denoting to not override the default scaling window, 1, denoting to generate the ROI scaling window in the active reference picture, and 2, denoting to generate the ROI scaling window in the current picture.

### Claim 3 (depends on 1)

The method of claim 1, wherein the ROI offset parameters comprise absolute left, right, top, and bottom offsets for the scaling window which replace original offset values of the scaling window.

### Claim 4 (depends on 1)

The method of claim 1, wherein the ROI offset parameters comprise delta left, right, top, and bottom offsets for the scaling window which need to be added to original offset values of the scaling window.

### Claim 5

A method to decode a coded bitstream with region of interest (ROI) support, the method performed by a processor and comprising:
receiving a coded bitstream comprising coded pictures and syntax parameters for one or more regions of interest (ROI) within the coded pictures, wherein the syntax parameters comprise a picture header with ROI picture header parameters and a slice header with ROI slice header parameters, wherein the ROI picture header parameters comprise an ROI switch parameter and ROI offset parameters for a scaling window, and the ROI slice header parameters comprise a slice ROI enable flag, wherein the ROI switch parameter denotes whether ROI scaling is enabled, and if enabled, whether the ROI offset parameters in the picture header are applied to a reference picture or a current picture; and
decoding a coded region in a current picture in the coded bitstream, wherein decoding the coded region comprises:
for the current picture and an active reference picture in an Inter slice:
initializing a default scaling window in the Inter slice using values defined in a picture parameter set;
if detecting using the ROI switch parameter that ROI scaling is enabled:
if detecting that the slice ROI enable flag is enabled:
overriding the parameters of the default scaling window based on the ROI offset parameters and the ROI switch parameters to generate an ROI scaling window; and
applying reference picture resampling using the ROI scaling window.

### Claim 6 (depends on 5)

The method of claim 5, wherein the ROI switch parameter comprises three values:
0, denoting no ROI scaling is enabled, 1, denoting to generate the ROI scaling window in the active reference picture, and 2, denoting to generate the ROI scaling window in the current picture.

### Claim 7 (depends on 5)

The method of claim 5, wherein the ROI offset parameters comprise absolute left, right, top, and bottom offsets for the scaling window which replace original offset values of the scaling window.

### Claim 8 (depends on 5)

The method of claim 5, wherein the ROI offset parameters comprise delta left, right, top, and bottom offsets for the scaling window which need to be added to original offset values of the scaling window.

### Claim 9

A non-transitory processor-readable medium having stored thereon an encoded video stream structure, the encoded video stream structure comprising:
an encoded picture section including an encoding of a sequence of video pictures; and
a signaling section including an encoding of:
syntax parameters for one more regions of interest (ROI) in a current picture and/or in a reference picture, the syntax parameters comprising one or more of:
a picture header comprising a picture header flag indicating whether ROI window offset parameters may be used for reference picture rescaling (RPR) or not, and left, right, top, and bottom ROI window offset parameters; and
a slice header comprising a slice ROI switch indicating whether for a current inter slice, ROI scaling is enabled or not, and if enabled, whether the ROI window offset parameters are used to modify a default scaling window for a reference picture or a current picture.

### Claim 10

A non-transitory processor-readable medium having stored thereon an encoded video stream structure, the encoded video stream structure comprising:
an encoded picture section including an encoding of a sequence of video pictures; and
a signaling section including an encoding of:
syntax parameters for one more regions of interest (ROI) in a current picture and/or in a reference picture, the syntax parameters comprising one or more of:
a picture header comprising a picture header ROI switch indicating whether ROI window offset parameters may be used for reference picture resealing (RPR) or not, and whether the ROI window offset parameters are for a reference frame or a current frame, and left, right, top, and bottom ROI window offset parameters; and
a slice header comprising a slice ROI enable flag indicating whether for a current inter slice, ROI scaling is enabled or not.

### Claim 11 (depends on 1)

A non-transitory computer-readable storage medium having stored thereon computer-executable instructions for executing with one or more processors a method in accordance with claim 1.

### Claim 12 (depends on 1)

An apparatus comprising a processor and configured to perform the method of claim 1.
