Back to results
US 8,786,785 B2Granted
Video signature
AssigneeMicrosoft Corporation
InventorsSeth Hendrickson, George Randell Dong, Saswata Mandal, Charles Lawrence Zitnick, III
Life of this patent
Estimating the term…
Abstract
Video signatures are generated when a small change in video information between consecutive frames N−1 and N is followed by a large change in video information between consecutive frames N and N+1. Information from frames N and/or N+1 is used to form a video signature.
Claims20
A method of finding a signature for a video, the method comprising:
- dividing a frame N of the video into a plurality of cells;
- calculating a video attribute of each cell of frame N;
- dividing a frame N+1 into the plurality of cells;
- calculating a video attribute of each cell of frame N+1;
- dividing a frame N−1 of the video into a plurality of cells;
- calculating a video attribute of each cell of frame N−1;
- calculating a difference metric between frame N and frame N+1 that includes, for each cell of the plurality of cells, a difference between the video attribute of frame N and the video attribute of frame N+1;
- calculating a difference metric between frame N and frame N−1 that includes, for each cell of the plurality of cells, a difference between the video attribute of frame N and the video attribute of frame N−1;
- and
- generating a video signature that includes information from one or both of frame N and frame N+1 responsive to the difference metric between frame N and frame N+1 exceeding a first threshold and a difference metric between frame N and frame N−1 not exceeding a second threshold.
7 more elements
A method for generating signatures of a video comprising:
- dividing a frame N of the video into a grid of M cells comprising an average luminance value for each cell of frame N;
- dividing a frame N+1 into the grid of M cells comprising an average luminance value for each cell of frame N+1;
- dividing a frame N−1 into the grid of M cells comprising an average luminance for each cell of frame N−1;
- calculating an M-dimensional vector for each of frame N, frame N+1, and frame N−1 that includes, for each different dimension, a luminance value of a different cell from that frame;
- calculating a Euclidean distance between the M-dimensional vector for frame N and the M-dimensional vector for frame N+1;
- calculating a Euclidean distance between the M-dimensional vector for frame N and the M-dimensional vector for frame N−1;
- and
- generating a video signature that includes the M-dimensional vector for frame N concatenated with the M-dimensional vector of frame N+1 responsive to the Euclidean distance between frame N and frame N+1 exceeding a first threshold and the Euclidean distance between frame N and frame N−1 not exceeding a second threshold.
5 more elements
A data-holding subsystem holding instructions executable by a logic subsystem to:
- iteratively test a series of three consecutive frames within a video for a shot change, each test comprising:
- dividing a frame N of the video into a grid comprising M cells;
- calculating an M-dimensional vector for frame N that includes, for each different dimension of the M-dimensional vector, an average luminance value of a different cell from frame N;
- dividing a frame N+1 of the video into a grid comprising M cells;
- calculating an M-dimensional vector for frame N+1 that includes, for each different dimension of the M-dimensional vector, an average luminance value of a different cell from frame N+1;
- dividing a frame N−1 of the video into a grid comprising M cells;
- calculating an M-dimensional vector for frame N−1 that includes, for each different dimension of the M-dimensional vector, an average luminance value of a different cell from frame N−1;
- calculating a Euclidean distance between the M-dimensional vector for frame N and the M-dimensional vector for frame N+1;
- if the Euclidean distance between frame N and frame N+1 exceeds a first threshold, calculating a Euclidean distance between the M-dimensional vector for frame N and the M-dimensional vector for frame N−1;
- generating a video signature that includes the M-dimensional vector for frame N concatenated with the M-dimensional vector of frame N+1 responsive to the Euclidean distance between frame N and frame N−1 not exceeding a second threshold, and iteratively test a next series of three consecutive frames within the video for a next shot change.
7 more elements
Dependencies are inferred from the claim text.