Efficient content based video retrieval
AssigneePicScout (Israel) Ltd.
InventorsEli Goz, Sagie Shamay, Aran Pauker, Lior Cohen, Uri Lavi
Life of this patent
Estimating the term…
Abstract
Various disclosed embodiments relate to video content analysis based in part upon the detection of shot transitions. In some embodiments, a process and computer system for detecting shot transitions in a video is used to separate a video sequence into a series of “shots” having multiple frames. These shots may then be used for additional processing, e.g., content detection within the video frames.
Claims21
A computer-implemented method for identifying a shot transition in an image sequence, comprising:
- determining a first ordering of a first multiple of blocks in a first frame of the image sequence based upon block values associated with the first multiple of blocks;
- determining a second ordering of a second multiple of blocks in a second frame of the image sequence based upon block values associated with the second multiple of blocks;
- determining a distance between the first frame and a second frame based upon a permutation of the first ordering of the first multiple of blocks so as to correspond to the second ordering of the second multiple of blocks;
- storing the distance in a time series of past frame comparisons, the past frame comparisons including distances between frames that precede the first and second frame;
- and
- determining the existence of a shot transition based upon distances in at least a portion of the time series of past frame comparisons.
A non-transitory computer-readable medium comprising instructions executable by at least one processor to cause one or more computer systems to:
- determine a first ordering of a first multiple of blocks in a first frame of the image sequence based upon block values associated with the first multiple of blocks;
- determine a second ordering of a second multiple of blocks in a second frame of the image sequence based upon block values associated with the second multiple of blocks;
- determine a distance between the first frame and a second frame based upon a permutation of the first ordering of the first multiple of blocks so as to correspond to the second ordering of the second multiple of blocks;
- store the distance in a time series of past frame comparisons, the past frame comparisons including distances between frames that precede the first and second frame;
- and
- determine the existence of a shot transition based upon distances in at least a portion of the time series of past frame comparisons.
A computer system comprising:
- at least one processor;
- a memory comprising instructions executable by the at least one processor to cause the computer system to:
- determine a first ordering of a first multiple of blocks in a first frame of the image sequence based upon block values associated with the first multiple of blocks;
- determine a second ordering of a second multiple of blocks in a second frame of the image sequence based upon block values associated with the second multiple of blocks;
- determine a distance between the first frame and a second frame based upon a permutation of the first ordering of the first multiple of blocks so as to correspond to the second ordering of the second multiple of blocks;
- store the distance in a time series of past frame comparisons, the past frame comparisons including distances between frames that precede the first and second frame;
- and
- determine the existence of a shot transition based upon distances in at least a portion of the time series of past frame comparisons.
Dependencies are inferred from the claim text.