# US 10,123,039 B2 · Constructing inter-layer reference picture lists > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,123,039 B2 - Document ID: US10123039B2 - Status: Granted - Kind: B2 - Application number: 14/782,992 - Filed: 2014-04-04 - Published: 2016-11-03 - Granted: 2018-11-06 - Earliest claimed: 2013-04-12 - Assignees: Telefonaktiebolaget LM Ericsson (publ) - Applicants: Telefonaktiebolaget L M Ericsson (publ) - Inventors: Thomas Rusert; Andrey Norkin - Web page: https://patentgrep.com/patent/US10123039B2 ## CPC - H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/172: the region being a picture, frame or field - H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) - H04N 19/31: in the temporal domain - H04N 19/33: in the spatial domain - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 19/58: Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one (H04N19/23 takes precedence) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method (200) of constructing at least one list of reference pictures for inter-layer prediction of a current picture is provided. The method comprises inserting (210) reference pictures into a first set of reference pictures or a second set of reference pictures, based on respective values of a scalability identifier associated with the reference pictures and a value of the scalability identifier associated with the current picture, and inserting (220) the first set of reference pictures and the second set of reference pictures into the at least one list of reference pictures. By taking indications for similarities between reference layers and the current layer into account, a more efficient multi-layer video compression is achieved. Further, a corresponding computer program, a corresponding computer program product, and a corresponding device are provided. ## Claims ### Claim 1 A method of constructing at least one list of reference pictures for inter-layer prediction of a current picture, the method comprising: inserting each of a plurality of reference pictures into a respective one of a first set of reference pictures and a second set of reference pictures, wherein said inserting comprises assigning the reference pictures to the first and second sets of reference pictures based on respective values of scalability identifiers associated with the reference pictures and a value of the scalability identifier associated with the current picture; and inserting the first set of reference pictures and the second set of reference pictures into the at least one list of reference pictures; wherein each of the scalability identifiers is a view identifier indicating a relative spatial camera capture position. ### Claim 2 (depends on 1) The method of claim 1, wherein the reference pictures are inserted into the first set of reference pictures or the second set of reference pictures based on a difference of their respective value of the scalability identifier and the value of the scalability identifier associated with the current picture. ### Claim 3 (depends on 2) The method of claim 2, wherein reference pictures having respective values of the scalability identifier which are smaller than the value of the scalability identifier associated with the current picture are inserted into the first set of reference pictures, and reference pictures having respective values of the scalability identifier which are greater than the value of the scalability identifier associated with the current picture are inserted into the second set of reference pictures. ### Claim 4 (depends on 1) The method of claim 1, further comprising ordering the reference pictures comprised in the first set of reference pictures and the second set of reference pictures according to their respective values of the scalability identifier. ### Claim 5 (depends on 4) The method of claim 4, wherein the reference pictures are ordered in decreasing value of the scalability identifier. ### Claim 6 (depends on 4) The method of claim 4, wherein the reference pictures are ordered in increasing value of the scalability identifier. ### Claim 7 (depends on 4) The method of claim 4, wherein the reference pictures are ordered in decreasing absolute difference of their respective values of the scalability identifier and the value of the scalability identifier associated with the current picture. ### Claim 8 (depends on 4) The method of claim 4, wherein the reference picture are ordered in increasing absolute difference of their respective values of the scalability identifier and the value of the scalability identifier associated with the current picture. ### Claim 9 (depends on 1) The method of claim 1, wherein two lists of reference pictures are constructed, the first set of reference pictures is inserted into the first list of reference pictures in front of the second set of reference pictures, and the second set of reference pictures is inserted into the second list of reference pictures in front of the first set of reference pictures. ### Claim 10 (depends on 9) The method of claim 9, wherein: the first set of reference pictures is inserted into the first list of reference pictures after a first set of short-term reference pictures; the first set of reference pictures is inserted at the end of the second list of reference pictures; the second set of reference pictures is inserted into the second list of reference pictures after the second set of short-term reference pictures and before the first set of short-term reference pictures; and the second set of reference pictures is inserted at the end of the first list of reference pictures. ### Claim 11 (depends on 1) The method of claim 1, wherein the reference pictures are inserted into the first set of reference pictures and the second set of reference pictures based on their respective values of at least two scalability identifiers, a first and a second scalability identifier, associated with the reference pictures and respective values of the scalability identifiers associated with the current picture. ### Claim 12 (depends on 1) The method of claim 1, wherein the method is implemented as part of a video encoding process. ### Claim 13 (depends on 1) The method of claim 1, wherein the method is implemented as part of a video decoding process. ### Claim 14 (depends on 1) A non-transitory computer-readable comprising, stored thereupon, computer-executable instructions configured to cause a device to perform the method of claim 1 when the computer-executable instructions are executed on a processing unit comprised in the device. ### Claim 15 A device for constructing at least one list of reference pictures for inter-layer prediction of a current picture, the device comprising a processing circuit configured to: insert each of a plurality of reference pictures into a respective one of a first set of reference pictures and a second set of reference pictures, such that said inserting comprises assigning the reference pictures to the first and second sets of reference pictures based on respective values of scalability identifiers associated with the reference pictures and a value of the scalability identifier associated with the current picture; and insert the first set of reference pictures and the second set of reference pictures into the at least one list of reference pictures; wherein each of the scalability identifiers is a view identifier indicating a relative spatial camera capture position. ### Claim 16 (depends on 15) The device of claim 15, the processing circuit being configured to insert the reference pictures into the first set of reference pictures or the second set of reference pictures based on a difference of their respective value of the scalability identifier and the value of the scalability identifier associated with the current picture. ### Claim 17 (depends on 16) The device of claim 16, the processing circuit being configured to insert reference pictures having respective values of the scalability identifier which are smaller than the value of the scalability identifier associated with the current picture are into the first set of reference pictures, and insert reference pictures having respective values of the scalability identifier which are greater than the value of the scalability identifier associated with the current picture are into the second set of reference pictures. ### Claim 18 (depends on 15) The device of claim 15, the processing circuit being further configured to order the reference pictures comprised in the first set of reference pictures and the second set of reference pictures according to their respective values of the scalability identifier. ### Claim 19 (depends on 18) The device of claim 18, the processing circuit being configured to order the reference pictures in decreasing value of the scalability identifier. ### Claim 20 (depends on 18) The device of claim 18, the processing circuit being configured to order the reference pictures in increasing value of the scalability identifier. ### Claim 21 (depends on 18) The device of claim 18, the processing circuit being configured to order the reference pictures in decreasing absolute difference of their respective values of the scalability identifier and the value of the scalability identifier associated with the current picture. ### Claim 22 (depends on 18) The device of claim 18, the processing circuit being configured to order the reference pictures in increasing absolute difference of their respective values of the scalability identifier and the value of the scalability identifier associated with the current picture. ### Claim 23 (depends on 15) The device of claim 15, the processing circuit being configured to construct two lists of reference pictures, insert the first set of reference pictures into the first list of reference pictures in front of the second set of reference pictures, and insert the second set of reference pictures into the second list of reference pictures in front of the first set of reference pictures. ### Claim 24 (depends on 15) The device of claim 15, the processing circuit being configured to insert the reference pictures into the first set of reference pictures or the second set of reference pictures based on their respective values of at least two scalability identifiers, a first and a second scalability identifier, associated with the reference pictures and respective values of the scalability identifiers associated with the current picture. ### Claim 25 (depends on 15) The device of claim 15, the device being a video encoder. ### Claim 26 (depends on 15) The device of claim 15, the device being a video decoder. ### Claim 27 (depends on 15) A mobile terminal comprising the device of claim 15.