De-juddering techniques for coded video

A computer readable medium storing program instructions that, when executed by a processing device, causes the processing device to:

• code a source video sequence as base layer coded video at a first frame rate;
• estimate frame rate conversion operations of a decoding terminal, and
• apply estimated frame rate conversion operations of the decoding terminal on decoded base layer data,
• identify a portion of the decoded base layer data having judder following the application of frame rate conversion operations of the decoding terminal, and
• for the identified portion, include a skip hint in coded video data to indicate that a decoder should omit frame rate conversion operations for the respective portion of video data;
• for the identified portion, code additional frames of the source video sequence corresponding to the identified portion as coded enhancement layer data, the coded enhancement layer data and the coded base layer data when decoded generating recovered video representing the identified portion at a higher frame rate than the coded based layer data when decoded by itself.

A video coder, comprising:

• a pre-processor selectively employing frame rate conversion on source video,
• a scalable video coder for coding a portion of source video at a first frame rate as base-layer coded video and a second portion of input video at a second frame rate as enhancement-layer coded video, and
• a controller with instructions, that when executed by the controller, cause:
• estimating frame rate conversion operations of a decoding terminal,
• applying estimated frame rate conversion operations of the decoding terminal on decoded base layer data,
• identifying a portion of the decoded base layer data having judder following the application of frame rate conversion operations of the decoding terminal,
• for the identified portion, including a skip hint in coded video data to indicate that a decoder should omit frame rate conversion operations for the respective portion of video data, and
• for the identified portion, coding additional frames of the source video sequence corresponding to the identified portion as coded enhancement layer data, the coded enhancement layer data and the coded base layer data when decoded generating recovered video representing the identified portion at a higher frame rate than the coded based layer data when decoded by itself.