Video quality determination system and method
AssigneeCity University of Hong Kong
InventorsYun Zhang, Tak Wu Sam Kwong
Life of this patent
Estimating the term…
Abstract
A computer-implemented method and related system for determining a quality of a synthesized video file. The method includes processing a reference video file and a synthesized video file associated with the reference video file to compare the original video file and the synthesized video file. The method also includes determining an extent of flicker distortion of the synthesized video file based on the processing.
Claims24
A computer-implemented method for determining a quality of a synthesized video file, comprising:
- processing a reference video file and a synthesized video file associated with the reference video file to compare the reference video file and the synthesized video file, wherein processing comprises:
- segmenting the reference video file into a plurality of temporal layers;
- segmenting the synthesized video file into a plurality of temporal layers;
- processing the temporal layers of the reference video file and the temporal layers of the synthesized video file to identify flicker distortion in the synthesized video file, including processing the temporal layers of the reference video file to determine temporal gradient layers associated with the temporal layers of the reference video file, and processing the temporal layers of the synthesized video file to determine temporal gradient layers associated with the temporal layers of the synthesized video file;
- processing a reference depth video file associated with the reference video file to facilitate comparison of the reference video file and the synthesized video file, including
- processing the reference depth video file to detect edges of the reference depth video file to generate a depth edge video file, and segmenting the depth edge video file into a plurality of temporal depth layers;
- processing the temporal gradient layers of the reference video file based on the temporal depth layers to obtain weighted temporal gradient layers associated with the reference video file;
- processing the temporal gradient layers of the synthesized video file based on the temporal depth layers to obtain weighted temporal gradient layers associated with the synthesized video file;
- and
- determining an extent of flicker distortion of the synthesized video file based on the processing, wherein determining comprises:
- determining respective extents of flicker distortion for each temporal frame of the synthesized video file, and
- determining an overall extent of flicker distortion of the synthesized video file based on the respective extents of flicker distortion.
A system for determining a quality of a synthesized video file, comprising one or more processors arranged to:
- process a reference video file and a synthesized video file associated with the reference video file to compare the reference video file and the synthesized video file, wherein the process includes:
- segmenting the reference video file into a plurality of temporal layers;
- segmenting the synthesized video file into a plurality of temporal layers;
- processing the temporal layers of the reference video file and the temporal layers of the synthesized video file to identify flicker distortion in the synthesized video file, including processing the temporal layers of the reference video file to determine temporal gradient layers associated with the temporal layers of the reference video file, and processing the temporal layers of the synthesized video file to determine temporal gradient layers associated with the temporal layers of the synthesized video file;
- processing a reference depth video file associated with the reference video file for facilitating comparison of the reference video file and the synthesized video file, including processing the reference depth video file to detect edges of the reference depth video file to generate a depth edge video file, and segmenting the depth edge video file into a plurality of temporal depth layers;
- processing the temporal gradient layers of the reference video file based on the temporal depth layers to obtain weighted temporal gradient layers associated with the reference video file;
- processing the temporal gradient layers of the synthesized video file based on the temporal depth layers to obtain weighted temporal gradient layers associated with the synthesized video file;
- and
- determine an extent of flicker distortion of the synthesized video file based on the processing, wherein to determine includes:
- determining respective extents of flicker distortion for each temporal frame of the synthesized video file, and
- determining an overall extent of flicker distortion of the synthesized video file based on the respective extents of flicker distortion.
A non-transitory computer readable medium storing computer instructions that, when executed by one or more processors, causes the one or more processors to perform a method for determining a quality of a synthesized video file, the method comprising:
- processing a reference video file and a synthesized video file associated with the reference video file to compare the reference video file and the synthesized video file, the processing comprising:
- segmenting the reference video file into a plurality of temporal layers;
- segmenting the synthesized video file into a plurality of temporal layers;
- processing the temporal layers of the reference video file and the temporal layers of the synthesized video file to identify flicker distortion in the synthesized video file, including processing the temporal layers of the reference video file to determine temporal gradient layers associated with the temporal layers of the reference video file, and processing the temporal layers of the synthesized video file to determine temporal gradient layers associated with the temporal layers of the synthesized video file;
- processing a reference depth video file associated with the reference video file to facilitate comparison of the reference video file and the synthesized video file, including processing the reference depth video file to detect edges of the reference depth video file to generate a depth edge video file, and segmenting the depth edge video file into a plurality of temporal depth layers;
- processing the temporal gradient layers of the reference video file based on the temporal depth layers to obtain weighted temporal gradient layers associated with the reference video file;
- processing the temporal gradient layers of the synthesized video file based on the temporal depth layers to obtain weighted temporal gradient layers associated with the synthesized video file;
- and
- determining an extent of flicker distortion of the synthesized video file based on the processing, the determining comprising:
- determining respective extents of flicker distortion for each temporal frame of the synthesized video file, and
- determining an overall extent of flicker distortion of the synthesized video file based on the respective extents of flicker distortion.
Dependencies are inferred from the claim text.