# US 12,010,295 B2 · Collocated picture indication in video bitstreams

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,010,295 B2
- Document ID: US12010295B2
- Status: Granted
- Kind: B2
- Application number: 17/886,104
- Filed: 2022-08-11
- Published: 2022-12-08
- Granted: 2024-06-11
- Earliest claimed: 2020-02-14
- Assignees: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Applicants: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Inventors: Zhipin Deng; Li Zhang; Kai Zhang; Ye-kui Wang; Kui Fan
- Web page: https://patentgrep.com/patent/US12010295B2

## CPC

- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/139: Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/172: the region being a picture, frame or field
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/184: the unit being bits, e.g. of the compressed video stream
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/52: by predictive encoding
- H04N 19/547: Motion estimation performed in a transform domain
- H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/82: involving filtering within a prediction loop
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods, apparatus, systems for video processing, including video encoding or video decoding are described. One example method includes performing a conversion between a video including a video picture that includes a video slice and a bitstream of the video. The bitstream conforms to a format rule specifying that a slice type of the video slice determines a manner by which certain information from a picture header for the video picture is inherited by a slice header of the video slice.

## Claims

### Claim 1

A method of processing video data, comprising:
performing a conversion between a video comprising a video picture that includes a video slice and a bitstream of the video;
wherein the bitstream conforms to a format rule;
wherein the format rule specifies that a value of first certain information in a slice header for the video slice indicates a collocated picture used for a temporal motion vector prediction is derived from a reference list 0 each time a slice type of the video slice is P and a value of a first syntax element in a picture header of the video picture indicates that the temporal motion vector prediction is enabled for the video picture; and
wherein the format rule further specifies whether the value of the first certain information in the slice header for the video slice is inherited from the picture header for the video picture is determined at least based on the slice type of the video slice and a value of a second syntax element indicating whether reference picture list information is present in the picture header, and wherein the second syntax element is pps_rpl_info_in_ph_flag.

### Claim 2 (depends on 1)

The method of claim 1, wherein the format rule further specifies that the value of the first certain information in the slice header for the video slice indicates that the collocated picture used for the temporal motion vector prediction is derived from the reference list 0 each time the slice type of the video slice is P, the value of the first syntax element in the picture header of the video picture indicates that the temporal motion vector prediction is enabled for the video picture and the value of the second syntax element indicates that the reference picture list information is present in the picture header.

### Claim 3 (depends on 1)

The method of claim 1, wherein the format rule further specifies that a value of a third syntax element in the slice header of the video slice, which specifies a reference index of the collocated picture used for the temporal motion vector prediction, is in a range of 0 to a maximum reference index for the reference list 0 allowed to be used to the video slice, inclusive, when the slice type of the video slice is P and the temporal motion vector prediction is enabled.

### Claim 4 (depends on 1)

The method of claim 1, wherein the format rule further specifies that a value of a third syntax element in the slice header of the video slice, which specifies a reference index of the collocated picture used for the temporal motion vector prediction, refers to an entry in the reference list 0 and is in a range of 0 to a maximum reference index for the reference list 0 allowed to be used to the video slice, inclusive, when the slice type of the video slice is B and the value of the first certain information in the slice header for the video slice indicates the collocated picture used for the temporal motion vector prediction is derived from the reference list 0.

### Claim 5 (depends on 1)

The method of claim 1, wherein the conversion comprises encoding the video into the bitstream.

### Claim 6 (depends on 1)

The method of claim 1, wherein the conversion comprises decoding the video from the bitstream.

### Claim 7

An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
perform a conversion between a video comprising a video picture that includes a video slice and a bitstream of the video;
wherein the bitstream conforms to a format rule;
wherein the format rule specifies that a value of first certain information in a slice header for the video slice indicates a collocated picture used for a temporal motion vector prediction is derived from a reference list 0 each time a slice type of the video slice is P and a value of a first syntax element in a picture header of the video picture indicates that the temporal motion vector prediction is enabled for the video picture; and
wherein the format rule further specifies whether the value of the first certain information in the slice header for the video slice is inherited from the picture header for the video picture is determined at least based on the slice type of the video slice and a value of a second syntax element indicating whether reference picture list information is present in the picture header, and wherein the second syntax element is pps_rpl_info_in_ph_flag.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the format rule further specifies that the value of the first certain information in the slice header for the video slice indicates that the collocated picture used for the temporal motion vector prediction is derived from the reference list 0 each time the slice type of the video slice is P, the value of the first syntax element in the picture header of the video picture indicates that the temporal motion vector prediction is enabled for the video picture and the value of the second syntax element indicates that the reference picture list information is present in the picture header.

### Claim 9 (depends on 7)

The apparatus of claim 7, wherein the format rule further specifies that a value of a third syntax element in the slice header of the video slice, which specifies a reference index of the collocated picture used for the temporal motion vector prediction, is in a range of 0 to a maximum reference index for the reference list 0 allowed to be used to the video slice, inclusive, when the slice type of the video slice is P and the temporal motion vector prediction is enabled.

### Claim 10 (depends on 7)

The apparatus of claim 7, wherein the format rule further specifies that a value of a third syntax element in the slice header of the video slice, which specifies a reference index of the collocated picture used for the temporal motion vector prediction, refers to an entry in the reference list 0 and is in a range of 0 to a maximum reference index for the reference list 0 allowed to be used to the video slice, inclusive, when the slice type of the video slice is B and the value of the first certain information in the slice header for the video slice indicates the collocated picture used for the temporal motion vector prediction is derived from the reference list 0.

### Claim 11

A non-transitory computer-readable storage medium storing instructions that cause a processor to:
perform a conversion between a video comprising a video picture that includes a video slice and a bitstream of the video;
wherein the bitstream conforms to a format rule;
wherein the format rule specifies that a value of first certain information in a slice header for the video slice indicates a collocated picture used for a temporal motion vector prediction is derived from a reference list 0 each time a slice type of the video slice is P and a value of a first syntax element in a picture header of the video picture indicates that the temporal motion vector prediction is enabled for the video picture; and
wherein the format rule further specifies whether the value of the first certain information in the slice header for the video slice is inherited from the picture header for the video picture is determined at least based on the slice type of the video slice and a value of a second syntax element indicating whether reference picture list information is present in the picture header, and wherein the second syntax element is pps_rpl_info_in_ph_flag.

### Claim 12 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the format rule further specifies that the value of the first certain information in the slice header for the video slice indicates that the collocated picture used for the temporal motion vector prediction is derived from the reference list 0 each time the slice type of the video slice is P, the value of the first syntax element in the picture header of the video picture indicates that the temporal motion vector prediction is enabled for the video picture and the value of the second syntax element indicates that the reference picture list information is present in the picture header.

### Claim 13 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the format rule further specifies that a value of a third syntax element in the slice header of the video slice, which specifies a reference index of the collocated picture used for the temporal motion vector prediction, is in a range of 0 to a maximum reference index for the reference list 0 allowed to be used to the video slice, inclusive, when the slice type of the video slice is P and the temporal motion vector prediction is enabled.

### Claim 14 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the format rule further specifies that a value of a third syntax element in the slice header of the video slice, which specifies a reference index of the collocated picture used for the temporal motion vector prediction, refers to an entry in the reference list 0 and is in a range of 0 to a maximum reference index for the reference list 0 allowed to be used to the video slice, inclusive, when the slice type of the video slice is B and the value of the first certain information in the slice header for the video slice indicates the collocated picture used for the temporal motion vector prediction is derived from the reference list 0.

### Claim 15

A method for storing a bitstream of a video, comprising:
generating the bitstream of the video comprising a video picture that includes a video slice, and
storing the bitstream in a non-transitory computer-readable recording medium,
wherein the bitstream conforms to a format rule;
wherein the format rule specifies that a value of first certain information in a slice header for the video slice indicates a collocated picture used for a temporal motion vector prediction is derived from a reference list 0 each time a slice type of the video slice is P and a value of a first syntax element in a picture header of the video picture indicates that the temporal motion vector prediction is enabled for the video picture; and
wherein the format rule further specifies whether the value of the first certain information in the slice header for the video slice is inherited from the picture header for the video picture is determined at least based on the slice type of the video slice and a value of a second syntax element indicating whether reference picture list information is present in the picture header, and wherein the second syntax element is pps_rpl_info_in_ph_flag.

### Claim 16 (depends on 15)

The method of claim 15, wherein the format rule further specifies that the value of the first certain information in the slice header for the video slice indicates that the collocated picture used for the temporal motion vector prediction is derived from the reference list 0 each time the slice type of the video slice is P, the value of the first syntax element in the picture header of the video picture indicates that the temporal motion vector prediction is enabled for the video picture and the value of the second syntax element indicates that the reference picture list information is present in the picture header.

### Claim 17 (depends on 15)

The method of claim 15, wherein the format rule further specifies that a value of a third syntax element in the slice header of the video slice, which specifies a reference index of the collocated picture used for the temporal motion vector prediction, is in a range of 0 to a maximum reference index for the reference list 0 allowed to be used to the video slice, inclusive, when the slice type of the video slice is P and the temporal motion vector prediction is enabled; or wherein the format rule further specifies that the value of the third syntax element in the slice header of the video slice, which specifies the reference index of the collocated picture used for the temporal motion vector prediction, refers to an entry in the reference list 0 and is in the range of 0 to the maximum reference index for the reference list 0 allowed to be used to the video slice, inclusive, when the slice type of the video slice is B and the value of the first certain information in the slice header for the video slice indicates the collocated picture used for the temporal motion vector prediction is derived from the reference list 0.
