Back to results
US 7,406,123 B2Granted
Visual complexity measure for playing videos adaptively
AssigneeMitsubishi Electric Research Laboratories, Inc.
InventorsKadir A. Peker, Ajay Divakaran
Life of this patent
Estimating the term…
Abstract
A method plays frames of a video adaptively according to a visual complexity of the video. First a spatial frequency of pixel within frames of the video is measured, as well as a temporal velocity of corresponding pixels between frames of the video. The spatial frequency is multiplied by the temporal velocity to obtain a measure of the visual complexity of the frames of the video. The frames of the video are then played at a speed that corresponds to the visual complexity.
Claims17
A method for playing frames of a video adaptively, comprising the steps of:
- measuring a spatial frequency of pixel within frames of the video, wherein the spatial frequency is measured from discrete cosine transform coefficients of the pixels in the frames, and wherein basis functions of the discrete cosine transformation are in a form
- cos
-
- (
- π
-
-
- k
- x
-
- (
- 2
-
- x
- +
- 1
- )
- 2
-
- N
- )
- ·
- cos
-
- (
- π
-
-
- k
- y
-
- (
- 2
-
- y
- +
- 1
- )
- 2
-
- N
- )
- =
- cos
-
- (
- 2
-
- π
-
-
- k
- x
- 2
-
- N
-
- x
- +
- 2
-
- π
-
-
- k
- 4
-
- N
- )
- ·
- cos
-
- (
- 2
-
- π
-
-
- k
- y
- 2
-
- N
-
- y
- +
- 2
-
- π
-
-
- k
- 4
-
- N
- )
- ,
- where kx is a frequency fx in an x direction and ky is a frequency fy in a y direction in the frame represented as
- cos
-
- (
- 2
-
- π
-
-
- f
- x
- N
-
- x
- +
- 2
-
- π
-
-
- f
- y
- N
-
- y
- )
- ,
- where N is 8 for DCT macro-blocks, and each DCT basis is a superimposition of two two dimensional sinusoids;
- measuring a temporal velocity of corresponding pixels between frames of the video, wherein the temporal velocity is measured from motion vectors of corresponding pixels between the frames;
- multiplying the spatial frequency by the temporal velocity to obtain a measure of visual complexity of the frames of the video;
- and
- playing the frames of the video at a frame rate that corresponds to the measure of visual complexity.
126 more elements
Dependencies are inferred from the claim text.