Use of multiple related timelines

A method of using multiple related timelines in representing a sequence of video images, the method comprising:

• generating a first timeline identifying a decode order associated with a sequence of video images and a second timeline identifying a display order associated with the sequence of video images, wherein the sequence of video images comprises one or more samples;
• determining a decode end time and a display end time associated with the sequence of video images;
• and
• extending a decode duration associated with a last sample identified in the first timeline such that the decode end time equals the display end time.

A system for using multiple related timelines in representing a sequence of video images, the system comprising processor electronics configured to:

• generate a first timeline identifying a decode order associated with a sequence of video images and a second timeline identifying a display order associated with the sequence of video images, wherein the sequence of video images is comprised of one or more samples;
• correlate the first timeline with the second timeline based on an offset that represents a period of time by which decoding precedes display;
• and
• play the sequence of video images in accordance with the correlated first timeline and second timeline.