Back to results
US 7,742,111 B2Granted
Highlight detecting circuit and related method for audio feature-based highlight segment detection
AssigneeMAVs Lab. Inc.
InventorsYu Shiu, Chia-Hung Yeh, Hsuan-Huei Shih, Chung-Chieh Kuo
Life of this patent
Estimating the term…
Abstract
A highlight detecting circuit for detecting a highlight segment within a video signal includes a pitch-tracking module for estimating a plurality of pitch values for an audio signal; a pitch difference detecting module coupled to the pitch-tracking module for computing a plurality of pitch difference values according to the pitch values; and a highlight detecting module coupled to the pitch difference detecting module for determining a starting point and a stopping point of the highlight segment according to the pitch difference values.
Claims28
A highlight detecting circuit for detecting a highlight segment within a video signal, comprising:
- a pitch-tracking module for estimating a plurality of pitch values for an audio signal;
- a pitch difference detecting module coupled to the pitch-tracking module for computing a plurality of pitch difference values according to the pitch values;
- and
- a highlight detecting module coupled to the pitch difference detecting module for determining a starting point and a stopping point of the highlight segment according to the pitch difference values;
- wherein the video signal corresponds to an image part of a signal source and the audio signal corresponds to an audio part of the signal source;
- and, with respect to generation of a specific pitch difference value, the pitch difference detecting module determines the specific pitch difference value for a specific pitch value by summing a plurality of pitch values prior to the specific pitch value to generate a first sum value, summing a plurality of pitch values following the specific pitch value to generate a second sum value, and setting the specific pitch difference value by a difference between the first and second sum values.
3 more elements
A method for detecting a highlight segment within a video signal, comprising:
- estimating a plurality of pitch values for an audio signal;
- computing a plurality of pitch difference values according to the pitch values;
- and
- determining a starting point and a stopping point of the highlight segment according to the pitch difference values;
- wherein the video signal corresponds to an image part of a signal source, and the audio signal corresponds to an audio part of the signal source;
- and the step of computing the pitch difference values determines a specific pitch difference value for a specific pitch value by summing a plurality of pitch values prior to the specific pitch value to generate a first sum value, summing a plurality of pitch values following the specific pitch value to generate a second sum value, and setting the specific pitch difference value by a difference between the first and second sum values.
3 more elements
A highlight detecting circuit for detecting a highlight segment within a video signal, comprising:
- a pitch-tracking module for estimating a plurality of pitch values for an audio signal;
- a pitch difference detecting module coupled to the pitch-tracking module for computing a plurality of pitch difference values according to the pitch values;
- a highlight detecting module coupled to the pitch difference detecting module for determining a starting point and a stopping point of the highlight segment according to the pitch difference values;
- and
- a pitch smoother coupled between the pitch-tracking module and the pitch difference detecting module for averaging a plurality of pitch values in each window to generate a plurality of averaged pitch values, respectively;
- wherein the pitch smoother sets a predetermined value to an averaged pitch value of a specific window if a percentage of pitch values in the specific window being less than a first threshold value, reaches a second threshold value, and the pitch smoother averages pitch values in the specific window, which are not less than the first threshold value, to generate an averaged pitch value of the specific window if the percentage of pitch values in the specific window being less than the first threshold value does not reach the second threshold value;
- the pitch difference detecting module generates the pitch difference values according to the averaged pitch values;
- and the video signal corresponds to an image part of a signal source and the audio signal corresponds to an audio part of the signal source.
5 more elements
A highlight detecting circuit for detecting a highlight segment within a video signal, comprising:
- a pitch-tracking module for estimating a plurality of pitch values for an audio signal;
- a pitch difference detecting module coupled to the pitch-tracking module for computing a plurality of pitch difference values according to the pitch values;
- a highlight detecting module coupled to the pitch difference detecting module for determining a starting point and a stopping point of the highlight segment according to the pitch difference values;
- and
- a modulator coupled between the pitch difference detecting module and the highlight detecting module for generating a plurality of modulated pitch difference values, the modulator generates a specific modulated pitch difference value for a specific pitch value by multiplying a specific pitch difference value corresponding to the specific pitch value by the specific pitch value;
- wherein the video signal corresponds to an image part of a signal source and the audio signal corresponds to an audio part of the signal source;
- and the highlight detecting module determines the starting and stopping points according to the modulated pitch difference values.
4 more elements
A highlight detecting circuit for detecting a highlight segment within a video signal, comprising:
- a pitch-tracking module for estimating a plurality of pitch values for an audio signal;
- a pitch difference detecting module coupled to the pitch-tracking module for computing a plurality of pitch difference values according to the pitch values;
- and
- a highlight detecting module coupled to the pitch difference detecting module for determining a starting point and a stopping point of the highlight segment according to the pitch difference values;
- wherein the pitch-tracking module performs a Fourier transform upon the audio signal to generate a frequency-domain signal, and then performs a harmonic product spectrum (HPS) algorithm upon the frequency-domain signal to estimate the pitch values and further replaces a first pitch value estimated by the HPS operation with a second pitch value if a magnitude of the second pitch value is greater than a specific percentage of a magnitude of the first pitch value, and a pitch corresponding to the second pitch value is half a pitch corresponding to the first pitch value;
- and the video signal corresponds to an image part of a signal source and the audio signal corresponds to an audio part of the signal source.
3 more elements
A method for detecting a highlight segment within a video signal, comprising:
- estimating a plurality of pitch values for an audio signal;
- averaging a plurality of pitch values in each window to generate a plurality of averaged pitch values respectively, the step of averaging the pitch values comprising:
- setting a predetermined value to an averaged pitch value of a specific window, if a percentage of pitch values in the specific window being less than a first threshold value, reaches a second threshold value, and
- averaging a plurality of pitch values, which are not less than the first threshold value, to generate an averaged pitch value of the specific window if the percentage of pitch values in the specific window being less than the first threshold value, does not reach the second threshold value;
- computing a plurality of pitch difference values according to the averaged pitch values;
- and
- determining a starting point and a stopping point of the highlight segment according to the pitch difference values;
- wherein the video signal corresponds to an image part of a signal source, and the audio signal corresponds to an audio part of the signal source.
5 more elements
A method for detecting a highlight segment within a video signal, comprising:
- estimating a plurality of pitch values for an audio signal;
- computing a plurality of pitch difference values according to the pitch values;
- generating a plurality of modulated pitch difference values, a specific modulated pitch difference value for a specific pitch value is generated by multiplying a specific pitch difference value corresponding to the specific pitch value by the specific pitch value;
- and
- determining a starting point and a stopping point of the highlight segment according to the modulated pitch difference values;
- wherein the video signal corresponds to an image part of a signal source, and the audio signal corresponds to an audio part of the signal source.
3 more elements
A method for detecting a highlight segment within a video signal, comprising:
- estimating a plurality of pitch values for an audio signal, the step of estimating the pitch values comprising:
- performing a Fourier transform operation upon the audio signal to generate a frequency-domain signal;
- performing a harmonic product spectrum (HPS) algorithm upon the frequency-domain signal to estimate the pitch values;
- and
- replacing a first pitch value estimated by the HPS operation with a second pitch value if a magnitude of the second pitch value is greater than a specific percentage of a magnitude of the first pitch value, a pitch corresponding to the second pitch value being half a pitch corresponding to the first pitch value;
- computing a plurality of pitch difference values according to the pitch values;
- and
- determining a starting point and a stopping point of the highlight segment according to the pitch difference values;
- wherein the video signal corresponds to an image part of a signal source, and the audio signal corresponds to an audio part of the signal source.
6 more elements
Dependencies are inferred from the claim text.