Apparatus and method for detecting highlights of media stream

A method for detecting highlights of a media stream, the method comprising:

• determining a video threshold value by referring to motion vectors in the media stream;
• determining at least one audio threshold value by referring to volume energy in the media stream;
• deciding a shot change to divide the media stream into several shots;
• and
• determining video highlights according to video parameters and the video threshold value, and determining audio highlights according to audio parameters and the audio threshold value, and then deciding the highlights of the media stream according to the video highlights and the audio highlights, wherein each of the video parameters is a sum of motion vectors;
• deciding a first frame as a video highlight when a video parameter corresponding to the first frame is greater than the video threshold value;
• deciding a second frame as an audio highlight when an audio parameter corresponding to the second frame is greater than the audio threshold value;
• and
• comparing the sum associated with a current frame with the video threshold value;
• if the sum is greater than the video threshold value, the current frame is selected as a video highlight;
• and if the sum is not greater than the video threshold value, the current frame is not selected as the video highlight.

An apparatus for detecting highlights of a media stream, the apparatus comprising:

• a video processing module for determining a video threshold value by referring to motion vectors in the media stream, wherein the video processing module comprises:
• a motion-vector calculator for calculating a sum of motion vectors in a frame of the media stream;
• a histogram calculator for calculating a histogram difference between two neighboring frames;
• a shot data processing unit, electrically connected to the shot change detector and the motion-vector calculator, for determining a first computation result according to a plurality of sums of motion vectors corresponding to a plurality of frames in a shot, and for calculating a second computation result according to histogram differences in the shot;
• and
• a video threshold value determining unit, electrically connected to the shot data processing unit, for determining the video threshold value according to the first computation result, computing a histogram reference value according to a plurality of histogram differences of the media stream, and determining the video threshold value only according to the first computation result in the shot when the second computation result is less than the histogram reference value;
• an audio processing module for determining at least one audio threshold value by referring to volume energy in the media stream;
• a shot change detector, electrically connected to the video processing module and the audio processing module, for deciding a shot change to inform the video processing module and the audio processing module;
• and
• a post processor, electrically connected to the video processing module and the audio processing module, for determining the video highlights according to video parameters and the video threshold value, and the audio highlights according to audio parameters and the audio threshold value, and then deciding the highlights of the media stream according to the video highlights and the audio highlights;
• wherein when a video parameter corresponding to a first frame is greater than the video threshold value, the post processor decides the first frame as a video highlight;
• and when an audio parameter corresponding to a second frame is greater than the audio threshold value, the post processor decides the second frame as an audio highlight.

An apparatus for detecting highlights of a media stream, the apparatus comprising:

• a video processing module for determining a video threshold value by referring to motion vectors in the media stream;
• an audio processing module for determining at least one audio threshold value by referring to volume energy in the media stream, wherein the audio processing module comprises:
• a zero-crossing rate calculator for detecting an audio zero-crossing rate in a frame;
• a shot data processing unit, electrically connected to the shot change detector and the zero-crossing rate calculator, for determining a computation result according to calculating audio zero-crossing rates of frames in a shot;
• and
• an audio threshold value determining unit, electrically connected to the shot data processing unit, for determining the audio threshold value according to the computation result;
• a shot change detector, electrically connected to the video processing module and the audio processing module, for deciding a shot change to inform the video processing module and the audio processing module;
• and
• a post processor, electrically connected to the video processing module and the audio processing module, for determining the video highlights according to video parameters and the video threshold value, and the audio highlights according to audio parameters and the audio threshold value, and then deciding the highlights of the media stream according to the video highlights and the audio highlights;
• wherein when a video parameter corresponding to a first frame is greater than the video threshold value, the post processor decides the first frame as a video highlight;
• and when an audio parameter corresponding to a second frame is greater than the audio threshold value, the post processor decides the second frame as an audio highlight.

An apparatus for detecting highlights of a media stream, the apparatus comprising:

• a video processing module for determining a video threshold value by referring to motion vectors in the media stream;
• an audio processing module for determining at least one audio threshold value by referring to volume energy in the media stream;
• a shot change detector, electrically connected to the video processing module and the audio processing module, for deciding a shot change to inform the video processing module and the audio processing module;
• and
• a post processor, electrically connected to the video processing module and the audio processing module, for determining the video highlights according to video parameters and the video threshold value, and the audio highlights according to audio parameters and the audio threshold value, and then deciding the highlights of the media stream according to the video highlights and the audio highlights;
• and, an audio parameter being an audio zero-crossing rate, the post processor comparing an audio zero-crossing rate of a current frame with the audio threshold value, deciding the current frame as an audio highlight if the audio zero-crossing rate is greater than the audio threshold value, and not deciding the current frame as the audio highlight if the audio zero-crossing rate is not greater than the audio threshold value;
• wherein when a video parameter corresponding to a first frame is greater than the video threshold value, the post processor decides the first frame as a video highlight;
• and when an audio parameter corresponding to a second frame is greater than the audio threshold value, the post processor decides the second frame as an audio highlight.

A method for detecting highlights of a media stream, the method comprising:

• determining a video threshold value by referring to motion vectors in the media stream, and the step of determining the video threshold value comprises:
• calculating a sum of motion vectors in a frame of the media stream;
• determining a first computation result according to a plurality of sums of motion vectors corresponding to a plurality of frames in a shot;
• calculating a histogram difference between two neighboring frames;
• determining a second computation result according to histogram differences in the shot;
• and
• computing a histogram reference value according to a plurality of histogram differences of the media stream;
• and
• determining the video threshold value only according to the first computation result in the shot when the second computation result is less than the histogram reference value;
• determining at least one audio threshold value by referring to volume energy in the media stream;
• deciding a shot change to divide the media stream into several shots;
• and
• determining video highlights according to video parameters and the video threshold value, and determining audio highlights according to audio parameters and the audio threshold value, and then deciding the highlights of the media stream according to the video highlights and the audio highlights;
• deciding a first frame as a video highlight when a video parameter corresponding to the first frame is greater than the video threshold value;
• and
• deciding a second frame as an audio highlight when an audio parameter corresponding to the second frame is greater than the audio threshold value.

A method for detecting highlights of a media stream, the method comprising:

• determining a video threshold value by referring to motion vectors in the media stream;
• determining at least one audio threshold value by referring to volume energy in the media stream, and the step of determining at least one audio threshold value comprises:
• detecting an audio zero-crossing rate in a frame;
• determining a first computation result according to calculating audio zero-crossing rates of frames in a shot;
• and
• determining the audio threshold value according to the first computation result;
• deciding a shot change to divide the media stream into several shots;
• and
• determining video highlights according to video parameters and the video threshold value, and determining audio highlights according to audio parameters and the audio threshold value, and then deciding the highlights of the media stream according to the video highlights and the audio highlights;
• deciding a first frame as a video highlight when a video parameter corresponding to the first frame is greater than the video threshold value;
• and
• deciding a second frame as an audio highlight when an audio parameter corresponding to the second frame is greater than the audio threshold value.

A method for detecting highlights of a media stream, the method comprising:

• determining a video threshold value by referring to motion vectors in the media stream;
• determining at least one audio threshold value by referring to volume energy in the media stream;
• deciding a shot change to divide the media stream into several shots;
• and
• determining video highlights according to video parameters and the video threshold value, and determining audio highlights according to audio parameters and the audio threshold value, and then deciding the highlights of the media stream according to the video highlights and the audio highlights;
• deciding a first frame as a video highlight when a video parameter corresponding to the first frame is greater than the video threshold value;
• deciding a second frame as an audio highlight when an audio parameter corresponding to the second frame is greater than the audio threshold value;
• and
• when an audio parameter is an audio zero-crossing rate, comparing the audio zero-crossing rate of a current frame with the audio threshold value;
• if the audio zero-crossing rate is greater than the audio threshold value, the current frame is selected as an audio highlight;
• and if the audio zero-crossing rate is not greater than the audio threshold value, the current frame is not selected as the audio highlight.