Back to results
US 5,767,922 AGranted
Apparatus and process for detecting scene breaks in a sequence of video frames
AssigneeCornell Research Foundation, Inc.
InventorsRamin Zabih, Justin F. Miller, Kevin W. Mai
Life of this patent
Estimating the term…
Abstract
Apparatus and process for detecting scene breaks in a sequence of video frames providing a moving picture. Entering and exiting edge pixels in each of a plurality of successive video frames are counted, and an edge change fraction for each of the successive video frames is derived therefrom. Peaks which are detected in the edge change fractions are indicative of scene breaks.
Claims24
A process for detecting scene breaks in a sequence of images, comprising:
- a) providing a plurality of successive images from an image source;
- b) converting every image I from the plurality of successive images from an analog to a digital form;
- c) detecting the location of intensity edges in every image I and storing the information about the location of the intensity edges in a plurality of successive binary images;
- d) determining a proportion P.sub.out of exiting edge pixels in a binary image E from the plurality of successive binary images;
- e) determining the proportion P.sub.in of entering edge pixels in a binary image E.sup.1 from the plurality of successive binary images;
- f) obtaining a plurality of successive edge change fractions P by obtaining an edge change fraction P=max (P.sub.in, P.sub.out) for each binary image E from the plurality of successive binary images;
- and
- g) detecting at least one peak in the plurality of successive edge change fractions, the peak being indicative of a scene break.
5 more elements
A process for detecting scene breaks in a sequence of images, comprising:
- a) providing a plurality of successive images from an image source;
- b) converting every image I from the plurality of successive images from an analog to a digital form;
- c) detecting the location of intensity edges in every image I and storing the information about the location of the intensity edges in a plurality of successive binary images;
- d) determining a proportion P.sub.out of exiting edge pixels in a binary image E from the plurality of successive binary images by determining the fraction of edge pixels in E that are farther than a predetermined distance from the respectively closest pixels in a binary image E.sup.1 ;
- e) determining the proportion P.sub.in of entering edge pixels in the binary image E.sup.1 from the plurality of successive binary images by determining the fraction of edge pixels in E.sup.1 that are farther than a predetermined distance from the respectively closest pixels in E;
- f) obtaining a plurality of successive edge change fractions by obtaining an edge change fraction P=max (P.sub.in, P.sub.out) for each binary image E from the plurality of successive binary images;
- and
- g) detecting at least one peak in the plurality of successive edge change fractions, the peak being indicative of a scene break.
5 more elements
A process for detecting scene breaks in a sequence of images, comprising:
- a) providing a plurality of successive images from an image source;
- b) converting every image I from the plurality of successive images from an analog to a digital form;
- c) compensating for global motion to align consecutive images before obtaining edge change fractions, the compensating for global motion comprising:
- i) computing a primary motion and at least one secondary motion;
- and
- ii) segmenting an image into pixels undergoing primary motion and into pixels undergoing at least one secondary motion;
- d) detecting the location of intensity edges in every image I and storing the information about the location of the intensity edges in a plurality of successive binary images;
- e) determining a proportion P.sub.out of exiting edge pixels in a binary image E from the plurality of successive binary images by determining the fraction of edge pixels in E that are farther than a predetermined distance from the respectively closest pixels in a binary image E.sup.1 ;
- f) determining the proportion P.sub.in of entering edge pixels in the binary image E.sup.1 from the plurality of successive binary images by determining the fraction of edge pixels in E.sup.1 that are farther than a predetermined distance from the respectively closest pixels in E;
- g) obtaining a plurality of successive edge change fractions by obtaining an edge change fraction P=max (P.sub.in, P.sub.out) for each binary image E from the plurality of successive binary images;
- and
- h) detecting at least one peak in the plurality of successive edge change fractions, the peak being indicative of a scene break.
9 more elements
A system for detecting scene breaks in a sequence of images, comprising:
- a) means for receiving a plurality of successive images from an image source;
- b) a converter for converting every image I from the plurality of successive images from an analog to a digital form;
- c) means for identifying intensity edges in every image I and storing the information about the locations of the intensity edges in a plurality of successive binary images;
- d) means for determining a proportion P.sub.out of exiting edge pixels in a binary image E and a proportion P.sub.in of entering edge pixels in a binary image E.sup.1 ;
- e) means for obtaining a plurality of successive edge change fractions by obtaining an edge change fraction P=max (P.sub.in, P.sub.out) in each binary image E from the plurality of the successive binary images;
- and
- f) means for detecting at least one peak in the plurality of successive edge fractions, the peak being indicative of a scene break.
4 more elements
Dependencies are inferred from the claim text.