# US 11,445,172 B2 · Reference picture set (RPS) signaling for scalable high efficiency video coding (HEVC) > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,445,172 B2 - Document ID: US11445172B2 - Status: Granted - Kind: B2 - Application number: 13/755,460 - Filed: 2013-01-31 - Published: 2013-08-15 - Granted: 2022-09-13 - Earliest claimed: 2012-01-31 - Assignees: Vid Scale, Inc. - Applicants: Vid Scale, Inc. - Inventors: Yong He; Yan Ye; George W. McClellan; Jie Dong - Web page: https://patentgrep.com/patent/US11445172B2 ## CPC - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/187: the unit being a scalable video layer - H04N 19/31: in the temporal domain - H04N 19/33: in the spatial domain - H04N 19/463: by compressing encoding parameters before transmission - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Embodiments contemplate coding video data by generating a video encoded bitstream that may include reference picture set (RPS) extensions for inter-layer reference pictures, and the extensions may include inter-layer delta Picture Order Counts (POCs). Embodiments may also include signaling that lower layer reference pictures may be available in a lower layer decoder picture buffer (DPB), and/or an aggregate DPB, that may be added to the RPS set of a higher layer. The bitstream may include a signal indicating whether the higher layer RPS may be specified by a lower layer RPS, and the lower layer RPS may be temporal, inter-layer prediction (ILP), or both. ## Claims ### Claim 1 A decoding device for video data coding, comprising: a memory comprising at least one decoded picture buffer (DPB) comprising a plurality of decoded pictures; a receiver, the receiver configured at least in part to: receive video data that comprises a current enhancement layer and a plurality of reference layers of the current enhancement layer, and receive an inter-layer reference picture number indicator associated with a current enhancement layer picture; and a processor, the processor configured at least in part to: construct, based on a picture order count (POC) number of the current enhancement layer picture, an inter-layer reference picture set (RPS) for the current enhancement layer picture that comprise a plurality of decoded pictures at a same time instance as the current enhancement layer picture from the plurality of reference layers of the current enhancement layer; determine, based on the inter-layer reference picture number indicator associated with the current enhancement layer picture that indicates a number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture, the number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture; identify, based on the determining, at least one inter-layer reference picture from the inter-layer RPS to be used for predicting of the current enhancement layer picture; combine the at least one identified inter-layer reference picture from the inter-layer RPS with one or more temporal enhancement layer reference pictures to form a reference picture list for the current enhancement layer picture; and reconstruct the current enhancement layer picture for display based on the reference picture list. ### Claim 2 (depends on 1) The device of claim 1, wherein the processor is further configured: identify a decoded picture having a same POC number from a reference layer of the current enhancement layer; and add the identified decoded picture to the inter-layer RPS. ### Claim 3 (depends on 1) The device of claim 1, wherein the plurality of inter-layer reference pictures are from reference layers lower than a layer of the current enhancement layer picture. ### Claim 4 A method for video data decoding, the method comprising: receiving a video data that comprises a current enhancement layer and a plurality of reference layers of the current enhancement layer; receiving an inter-layer reference picture number indicator associated with a current enhancement layer picture; constructing, based on a picture order count (POC) number of the current enhancement layer picture, an inter-layer reference picture set (RPS) for the current enhancement layer picture that comprise a plurality of decoded pictures at a same time instance as the current enhancement layer picture from the plurality of reference layers of the current enhancement layer; determining, based on the inter-layer reference picture number indicator associated with the current enhancement layer picture that indicates a number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture, the number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture; identifying, based on the determining, at least one inter-layer reference picture from the inter-layer RPS to be used for predicting of the current enhancement layer picture; combining the at least one identified inter-layer reference pictures from the inter-layer RPS with one or more temporal enhancement layer reference pictures to form a reference picture list for the current enhancement layer picture; and reconstructing the current enhancement layer picture for display based on the reference picture list. ### Claim 5 (depends on 4) The method of claim 4, further comprising: identifying a decoded picture having a same POC number from a reference layer of the current enhancement layer; and adding the identified decoded picture to the inter-layer RPS. ### Claim 6 (depends on 4) The method of claim 4, wherein the plurality of inter-layer reference pictures are from reference layers lower than a layer of the current enhancement layer. ### Claim 7 (depends on 1) The device of claim 1, wherein the inter-layer reference picture number indicator is received in a slice header associated with the current enhancement layer picture. ### Claim 8 (depends on 1) The device of claim 1, wherein the receiver is further configured to receive inter-layer dependency information associated with the current enhancement layer, and the inter-layer RPS is constructed based on the inter-layer dependency information associated with the current enhancement layer. ### Claim 9 (depends on 1) The device of claim 1, wherein the processor is further configured to: construct a temporal RPS for the current enhancement layer picture, the temporal RPS comprising a plurality of temporal enhancement layer reference pictures that are not at a same time as the current enhancement layer picture, wherein one or more temporal enhancement layer reference pictures from the temporal RPS is combined with the identified at least one inter-layer reference picture from the inter-layer RPS to form the reference picture list for the current enhancement layer picture. ### Claim 10 (depends on 1) The device of claim 1, wherein the inter-layer reference picture number indicator indicates a first value of one less than the number of inter-layer reference pictures from the inter-layer RPS to be used for decoding the current enhancement layer picture, and the number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture is determined by adding one to the first value. ### Claim 11 (depends on 4) The method of claim 4, wherein the inter-layer reference picture number indicator is received in a slice header associated with the current enhancement layer picture. ### Claim 12 (depends on 4) The method of claim 4, further comprising receiving inter-layer dependency information associated with the current enhancement layer, wherein the inter-layer RPS is constructed based on the inter-layer dependency information associated with the current enhancement layer. ### Claim 13 (depends on 4) The method of claim 4, further comprising: constructing a temporal RPS for the current enhancement layer picture, the temporal RPS comprising a plurality of temporal enhancement layer reference pictures that are not at a same time as the current enhancement layer picture, wherein one or more temporal enhancement layer reference pictures from the temporal RPS is combined with the identified at least one inter-layer reference picture from the inter-layer RPS to form the reference picture list for the current enhancement layer picture. ### Claim 14 (depends on 4) The method of claim 4, wherein the inter-layer reference picture number indicator indicates a first value of one less than the number of inter-layer reference pictures from the inter-layer RPS to be used for decoding the current enhancement layer picture, and the number of inter-layer reference pictures from the inter-layer RPS to be used for predicting of the current enhancement layer picture is determined by adding one to the first value.