Edge enhancement for temporal scaling with metadata
AssigneeDolby Laboratories Licensing Corporation
InventorsLimin Liu, James E. Crenshaw
Life of this patent
Estimating the term…
Abstract
Methods for post-processing of non-key frames of an image are described. According to the methods, reconstructed non-key frames are updated with information of neighboring key frames. Methods to evaluate whether to update or not update the non-key frames are also described.
Claims30
A method to post-process a non-key frame of a video sequence through a neighboring key frame of the video sequence, comprising:
- downsampling a reconstructed key frame to form a downsampled reconstructed key frame;
- upsampling the downsampled reconstructed key frame to form an upsampled reconstructed key frame;
- forming a difference between the reconstructed key frame and the upsampled reconstructed key frame;
- adding the difference to a reconstructed non-key frame to compensate the reconstructed non-key frame to form an edge enhanced non-key frame;
- and
- updating the edge enhanced non-key frame to form an updated non-key frame based on a difference between a downsampled edge enhanced non-key frame and a downsampled non-key frame,
- wherein the downsampled edge enhanced non-key frame is formed by downsampling the edge enhanced non-key frame and the reconstructed non-key frame is formed by upsampling the downsampled non-key frame.
A method to process a non-key frame of a video sequence through a key frame of the video sequence, comprising:
- downsampling a reconstructed key frame to form a downsampled reconstructed key frame;
- forming a difference between a downsampled non-key frame and the downsampled reconstructed key frame;
- upsampling the difference to form an upsampled difference;
- adding the upsampled difference to the reconstructed key frame to form an edge enhanced non-key frame;
- and
- updating the edge enhanced non-key frame to form an updated non-key frame based on a difference between a downsampled edge enhanced non-key frame and the downsampled non-key frame,
- wherein the downsampled edge enhanced non-key frame is formed by downsampling the edge enhanced non-key frame.
A method to process a non-key frame of a video sequence through a neighboring key frame of the video sequence, comprising:
- forming a difference between the non-key frame and a reconstructed key frame;
- downsampling the difference to form a downsampled difference;
- upsampling the downsampled difference to form an upsampled difference;
- adding the upsampled difference to the reconstructed key frame to generate an edge enhanced non-key frame;
- and
- updating the edge enhanced non-key frame to form an updated non-key frame based on a difference between a downsampled edge enhanced non-key frame and a downsampled non-key frame,
- wherein the downsampled edge enhanced non-key frame is formed by downsampling the edge enhanced non-key frame and the downsampled non-key frame is formed by downsampling the non-key frame.
A method to post-process a non-key frame of a video sequence through key frames of the video sequence, comprising:
- downsampling a plurality of reconstructed key frames to form downsampled reconstructed key frames;
- upsampling the downsampled reconstructed key frames to form upsampled reconstructed key frames;
- forming differences between the reconstructed key frames and the respective upsampled reconstructed key frames;
- adding a sum of the differences to a reconstructed non-key frame to compensate the reconstructed non-key frame to form an edge enhanced non-key frame;
- and
- updating the edge enhanced non-key frame to form an updated non-key frame based on a difference between a downsampled edge enhanced non-key frame and a downsampled non-key frame,
- wherein the downsampled edge enhanced non-key frame is formed by downsampling the edge enhanced non-key frame and the reconstructed non-key frame is formed by upsampling the downsampled non-key frame.
A method to post-process a non-key frame of a video sequence through key frames of the video sequence, comprising:
- downsampling reconstructed key frames to form downsampled reconstructed key frames;
- for each downsampled reconstructed key frame forming a difference between a downsampled non-key frame and the downsampled reconstructed key frame;
- upsampling each difference to form upsampled differences;
- adding each reconstructed key frame to a respective upsampled difference to form revised upsampled differences;
- adding the revised upsampled differences together to form an edge enhanced non-key frame;
- and
- updating the edge enhanced non-key frame to form an updated non-key frame based on a difference between a downsampled edge enhanced non-key frame and the downsampled non-key frame,
- wherein the downsampled edge enhanced non-key frame is formed by downsampling the edge enhanced non-key frame.
Dependencies are inferred from the claim text.