Reference picture handling

A method for video coding, comprising:

• encoding received pictures into coded pictures, the coded pictures being divided into slices comprising an integer number of coding units;
• encoding a syntax structure for providing at least one of a reference picture list 0 for P and B slices and a reference picture list 1 for B slices, wherein the at least one of the reference picture list 0 and the reference picture list 1 contains idle reference pictures marked as used for reference that are to be unused for reference for a current slice but are still to be kept marked as used for reference;
• marking pictures which are not in any of the reference picture list 0 and the reference picture list 1 as unused for reference;
• if a picture is marked as unused for reference and has already been encoded, removing the picture from the memory or re-using the memory space used for the picture for another picture;
• encoding into a bitstream a first maximum reference index for the reference picture list 0 for decoding the current slice, wherein the idle reference pictures in the reference picture list 0 have a reference index greater than the first maximum reference index for the reference picture list 0;
• and
• encoding the current slice using one or more reference pictures from the reference picture list 0 or the reference picture list 1, but not from the idle reference pictures.