Music summarization system and method
AssigneeHewlett-Packard Development Company, L.P.
InventorsBeth Teresa Logan, Stephen Mingyu Chu
Life of this patent
Estimating the term…
Abstract
The invention provides a method and apparatus for automatically generating a summary or key phrase for a song. The song, or a portion thereof, is digitized and converted into a sequence of feature vectors, such mel-frequency cepstral coefficients (MFCCs). The feature vectors are then processed in order decipher the song's structure. Those sections that correspond to different structural elements are then marked with corresponding labels. Once the song is labeled, various heuristics are applied to select a key phrase corresponding to the song's summary. For example, the system may identify the label that appears most frequently within the song, and then select the longest duration of that label as the summary.
Claims28
A method for producing a key phrase for a song having words and music and a plurality of elements organized into a song structure, the method comprising the steps of:
- dividing at least a portion of the song into a plurality of frames;
- generating a feature vector for each frame, each feature vector having a plurality of parameters whose values are characteristic of that portion of the song contained within the respective frame;
- processing the feature vectors of each frame so as to identify the song's structure;
- marking those feature vectors associated with different structural elements of the song with different labels;
- and
- applying one or more predetermined rules to the marked set of feature vectors in order to select a single occurrence of a chosen label as the key phrase of the song.
A method for producing a key phrase for a song having a plurality of elements organized into a song structure, the method comprising the steps of:
- dividing at least a portion of the song into a plurality of frames;
- generating a feature vector for each frame, each feature vector having a plurality of parameters whose values are characteristic of that portion of the song contained within the respective frame;
- processing the feature vectors of each frame so as to identify the song's structure;
- marking those feature vectors associated with different structural elements of the song with different labels;
- and
- applying one or more predetermined rules to the marked set of feature vectors in order to select a single occurrence of a chosen label as the key phrase of the song, wherein
- the key phrase is appended to the song,
- the chosen label corresponds to the most frequently occurring label, and
- the single occurrence corresponds to at least a portion of the longest duration of the chosen label.
A system for producing a key phrase for a song having words and music and a plurality of elements organized into a song structure, the system comprising:
- a signal processor configured to receive a signal that corresponds to at least a portion of the song, and for dividing the song signal into a plurality of frames;
- a feature vector extraction engine coupled to the signal processor, the extraction engine configured to generate a feature vector for each frame, each feature vector having a plurality of parameters whose values are characteristic of that portion of the song signal contained within respective frame;
- a labeling engine coupled to the feature vector extraction engine, the labeling engine configured to process the feature vectors so as to identify the song's structure, and to mark those feature vectors associated with different structural elements of the song with different labels;
- and
- a key phrase identifier logic coupled to the labeling engine, the identifier logic configured to apply one or more predetermined rules to the marked set of feature vectors in order to select a single occurrence of a chosen label as the key phrase of the song.
A computer readable medium containing program instructions for producing a key phrase for a song having words and music and a plurality of elements organized into a song structure, the executable program instructions comprising program instructions for:
- dividing at least a portion of the song into a plurality of frames;
- generating a feature vector for each frame, each feature vector having a plurality of parameters whose values are characteristic of that portion of the song contained within the respective frame;
- processing the feature vectors of each frame so as to identify the song's structure;
- marking those feature vectors associated with different structural elements of the song with different labels;
- and
- applying one or more predetermined rules to the marked set of feature vectors in order to select a single occurrence of a chosen label as the key phrase of the song.
A method for producing a key phrase for a musical piece having a plurality of elements organized into a structure, the method comprising the steps of:
- dividing at least a portion of the musical piece into a plurality of frames;
- generating a feature vector for each frame, each feature vector having a plurality of parameters whose values are characteristic of that portion of the musical piece contained within the respective frame;
- processing the feature vectors of each frame so as to identify the musical piece's structure;
- marking those feature vectors associated with different structural elements of the musical piece with different labels;
- and
- applying one or more predetermined rules to the marked set of feature vectors in order to select a single occurrence of a chosen label as the key phrase of the musical piece.
A system for producing a key phrase for a musical piece having a plurality of elements organized into a structure, the system comprising:
- a signal processor configured to receive a signal that corresponds to at least a portion of the musical piece, and for dividing the musical piece into a plurality of frames;
- a feature vector extraction engine coupled to the signal processor, the extraction engine configured to generate a feature vector for each frame, each feature vector having a plurality of parameters whose values are characteristic of that portion of the musical piece signal contained within respective frame;
- a labeling engine coupled to the feature vector extraction engine, the labeling engine configured to process the feature vectors so as to identify the musical piece's structure, and to mark those feature vectors associated with different structural elements of the musical piece with different labels;
- and
- a key phrase identifier logic coupled to the labeling engine, the identifier logic configured to apply one or more predetermined rules to the marked set of feature vectors in order to select a single occurrence of a chosen label as the key phrase of the musical piece.
Dependencies are inferred from the claim text.