US 6,100,941 AGranted

Apparatus and method for locating a commercial disposed within a video data stream

AssigneeU.S. Philips Corporation

InventorsNevenka Dimitrova, Thomas Mc Gee, Jan Hermanus Elenbaas, Eugene Leyvi, Carolyn Ramsey, David Berkowitz

Life of this patent

Estimating the term…

Loading patent…

Abstract

A commercial detection apparatus includes a frame grab thread which acquires frames from an input data stream to be analyzed by a cut detector thread and a filter thread. A commercial detection thread determines whether a commercial has occurred from data created by the cut detector thread and the filter thread stored in a memory. A factor used by the commercial detection thread is whether a black frame has occurred. The input data stream is divided into a plurality of regions and then a maximum and minimum value for a section of these regions is determined and compared to one another. If the maximum and minimum values are close enough, and the maximum value is below a threshold, then the frame is deemed to be black. The commercial detection thread also looks at the average cut frame distance, cut rate, changes in the average cut frame distance, the absence of a logo, a commercial signature detection, brand name detection, a series of black frames preceding a high cut rate, similar frames located within a specified period of time before a frame being analyzed and character detection. During playback, the detected commercials are either skipped or substituted with alternate content.

Claims19

Dependent claims

A home information appliance for detecting at least a portion of a commercial within a video data stream divided into a plurality of frames comprising:

at least one of an average cut frame distance detector, a cut frame distance trend detector, a brand name detector, a cut rate and black frame detector, a frame similarity detector, a character detector, and a static image detector, wherein
said average cut frame distance detector performs the steps of
a. calculating a quotient which includes a numerator representing the number of frames between a first frame with a cut and a previous frame with a cut and a denominator representing the number of cuts between said previous and first frames,
b. comparing said quotient to a cut frame distance threshold, and
c. identifying the occurrence of a portion of a commercial based upon said step of comparing;
said average cut frame distance trend detector determines a change in the number of cuts in a plurality of frames and detects a portion of a commercial based on said change;
said brand name detector performs the steps of
a. processing said data stream through at least one of an audio processor, a video processor, and a closed captioning processor to produce text,
b. comparing said text to a bank of product and trade names, and
c. identifying a portion of a commercial based upon said step of comparing;
said cut rate and black frame detector identifies a portion of a commercial based on whether a series of black frames has occurred within a cut rate and black frame time period before an analyzed cut, said analyzed cut occurring within a sequence of cuts, said sequence occurring within a cut rate time period;
said frame similarity detector determines whether a present frame is similar to a previous frame and detects a portion of a commercial when a frame within a time period is similar to the present frame;
said character detector performs the steps of
a. finding letters within an analyzed frame of said frames,
b. creating a box around said letters,
c. determining dimensions of said box,
d. determining a location of said box within said analyzed frame,
e. analyzing said dimensions and said location of said analyzed frame with subsequent analyzed frames, and
f. detecting a portion of a commercial based upon said step of analyzing;
and
said static image detector detects a portion of a commercial when a number of static frames has occurred within a time period.

18 more elements

A method for identifying commercials within a video data stream divided into a plurality of frames through detection of at least one of average cut frame distance, average cut frame distance trend, brand name, black frame, cut and black frame, frame similarity, character detection, and static image, wherein:

average cut frame distance detection includes:
a. calculating a quotient which includes a numerator representing the number of frames between a first frame with a cut and a previous frame with a cut and a denominator representing the number of cuts between said previous and first frames,
b. comparing said quotient to a cut frame distance threshold, and
c. identifying the occurrence of a portion of a commercial based upon said step of comparing;
average cut frame distance trend detection is a determination of a change in the number of cuts in a plurality of frames, detection of a portion of a commercial being based on said change;
brand name detection includes the steps of
a. processing said data stream through at least one of an audio processor, a video processor, and a closed captioning processor to produce text,
b. comparing said text to a bank of product and trade names, and
c. identifying a portion of a commercial based upon said step of comparing;
black frame detection includes the steps of
a. dividing an analyzed frame of said frames into a plurality of regions;
b. calculating an average maximum luminance value for said regions;
c. calculating an average minimum luminance value for said regions;
d. comparing said average maximum luminance value and said average minimum luminance value with a black frame threshold, and
e. identifying the occurrence of beginning or an ending of a commercial based on said step of comparing;
cut and black frame detection identifies a portion of a commercial based on whether a series of black frames has occurred within a cut and black frame time period before an analyzed cut, said analyzed cut occurring within a sequence of cuts, said sequence occurring within a cut rate time period;
frame similarity detection is a determination of whether a present frame is similar to a previous frame, a portion of a commercial being when a frame within a time period is similar to the present frame;
character detection includes the steps of
a. finding letters within an analyzed frame of said frames,
b. creating a box around said letters,
c. determining dimensions of said box,
d. determining a location of said box within said analyzed frame,
e. analyzing said dimensions and said location of said analyzed frame with subsequent analyzed frames, and
f. detecting a portion of a commercial based upon said step of analyzing;
and
static image detection identifies a portion of a commercial when a number of static frames has occurred within a time period.

23 more elements

Dependencies are inferred from the claim text.