# US 9,438,898 B2 · Reference picture lists modification

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,438,898 B2
- Document ID: US9438898B2
- Status: Granted
- Kind: B2
- Application number: 14/019,871
- Filed: 2013-09-06
- Published: 2014-03-13
- Granted: 2016-09-06
- Earliest claimed: 2012-09-07
- Assignees: Vid Scale, Inc.
- Applicants: Vid Scale, Inc.
- Inventors: Xiaoyu Xiu; Yong He; Yan Ye; Yuwen He
- Web page: https://patentgrep.com/patent/US9438898B2

## CPC

- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/124: Quantisation
- H04N 19/13: Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
- H04N 19/157: Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N 19/172: the region being a picture, frame or field
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/503: involving temporal prediction (adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109)
- H04N 19/58: Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one (H04N19/23 takes precedence)
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/61: in combination with predictive coding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems, methods, and instrumentalities are disclosed relating to modifications to reference picture lists used for multiple layer video coding. A bitstream that may include a reference picture list of a slice may be received. An indication to reposition a reference picture within the reference picture list from a first position to a second position may be received. An indication to insert a reference picture within the reference picture list at a position may be received. The reference picture may be repositioned and/or inserted in the reference picture list in response to receiving the indication. A reference picture previously associated with the position may be shifted in the reference picture list according to the indication to reposition and/or insert the reference picture, although an indication to reposition the reference picture previously associated with the position may not be received. The slice may be decoded using the reference picture list.

## Claims

### Claim 1

A method comprising:
receiving a video signal;
determining encoding statistics related to the video signal during a first encoding pass using one or more reference picture lists;
reordering, prior to a second encoding pass, pictures in the one or more reference picture lists based on the encoding statistics determined from the first encoding pass, wherein the encoding statistics comprise motion-compensated distortion information such that the pictures with smaller motion-compensated distortion are assigned lower indices in the one or more reference picture lists; and
encoding the video signal during the second encoding pass using the one or more reordered reference picture lists.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
encoding the video signal during the first encoding pass using the one or more reference picture lists;
comparing a video bitstream generated during the first encoding pass to a video bitstream generated during the second encoding pass; and
sending the video bitstream that is characterized by a lower Lagrangian rate-distortion (RD) cost.

### Claim 3 (depends on 1)

The method of claim 1, wherein the encoding statistics further comprise reference usage information, and wherein the pictures in the one or more reference picture lists are reordered such that the pictures with higher usage frequency are assigned lower indices.

### Claim 4 (depends on 3)

The method of claim 3, wherein the reference usage information is based on a number of smallest prediction units (SPUs) in an encoded picture or slice that refer to a reference picture.

### Claim 5 (depends on 1)

The method of claim 1, wherein the motion-compensated distortion information is determined based on one or more of sum of square error (SSE), sum of absolute difference (SAD), or sum of absolute transformed differences (SATD).

### Claim 6 (depends on 1)

The method of claim 1, wherein the motion-compensated distortion information is determined based on motion-compensated distortion of smallest prediction units (SPUs) and prediction blocks of the pictures in the one or more reference picture lists.

### Claim 7 (depends on 1)

The method of claim 1, wherein one or more of the first encoding pass and the second encoding pass comprise a complete encoding pass of the video signal.

### Claim 8 (depends on 1)

The method of claim 1, wherein the pictures in the one or more reference picture lists that are reordered comprise at least one of temporal reference pictures or inter-layer reference pictures.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
performing one or more encoding passes after the first encoding pass and before the second encoding pass.

### Claim 10

An encoder comprising:
a processor configured to:
receive a video signal;
determine encoding statistics related to the video signal during a first encoding pass using one or more reference picture lists;
reorder, prior to a second encoding pass, pictures in the one or more reference picture lists based on the encoding statistics determined from the first encoding pass, wherein the encoding statistics comprise motion-compensated distortion information such that the pictures with smaller motion-compensated distortion are assigned lower indices in the one or more reference picture lists; and
encode the video signal during the second encoding pass using the one or more reordered reference picture lists.

### Claim 11 (depends on 10)

The encoder of claim 10, wherein the processor is further configured to:
encode the video signal during the first encoding pass using the one or more reference picture lists;
compare a video bitstream generated during the first encoding pass to a video bitstream generated during the second encoding pass; and
send the video bitstream that is characterized by a lower Lagrangian rate-distortion (RD) cost.

### Claim 12 (depends on 10)

The encoder of claim 10, wherein the encoding statistics further comprise reference usage information, and wherein the pictures in the one or more reference picture lists are reordered such that the pictures with higher usage frequency are assigned lower indices.

### Claim 13 (depends on 12)

The encoder of claim 12, wherein the reference usage information is based on a number of smallest prediction units (SPUs) in an encoded picture or slice that refer to a reference picture.

### Claim 14 (depends on 10)

The encoder of claim 10, wherein the motion-compensated distortion information is determined based on one or more of sum of square error (SSE), sum of absolute difference (SAD), or sum of absolute transformed differences (SATD).

### Claim 15 (depends on 10)

The encoder of claim 10, wherein the motion-compensated distortion information is determined based on motion-compensated distortion of smallest prediction units (SPUs) and prediction blocks of the pictures in the one or more reference picture lists.

### Claim 16 (depends on 10)

The encoder of claim 10, wherein one or more of the first encoding pass and the second encoding pass comprise a complete encoding pass of the video signal.

### Claim 17 (depends on 10)

The encoder of claim 10, wherein the pictures in the one or more reference picture lists that are reordered comprise at least one of temporal reference pictures or inter-layer reference pictures.

### Claim 18 (depends on 10)

The encoder of claim 10, wherein the encoder is further configured to perform one or more encoding passes after the first encoding pass and before the second encoding pass.