US 12,223,962 B2 · Music-aware speaker diarization for transcripts and text-based video editing

Abstract

Embodiments of the present invention provide systems, methods, and computer storage media for music-aware speaker diarization. In an example embodiment, one or more audio classifiers detect speech and music independently of each other, which facilitates detecting regions in an audio track that contain music but do not contain speech. These music-only regions are compared to the transcript, and any transcription and speakers that overlap in time with the music-only regions are removed from the transcript. In some embodiments, rather than having the transcript display the text from this detected music, a visual representation of the audio waveform is included in the corresponding regions of the transcript.

Claims20

Dependent claims

One or more computer storage media storing computer-useable instructions that, when executed by one or more computing devices, cause the one or more computing devices to perform operations comprising:

detecting, using one or more audio classifiers, (i) speech regions of an audio track that contain detected speech and (ii) music regions of the audio track that contain detected music;
detecting music-only regions based at least on comparing times of the music regions to times of the speech regions;
identifying transcribed singing in a transcript of the audio track based on corresponding sentences overlapping with the music-only regions;
and
causing presentation of a visualization of the transcript that omits the transcribed singing from transcript text of the transcript.

2 more elements

Dependencies are inferred from the claim text.

Music-aware speaker diarization for transcripts and text-based video editing

Life of this patent

Music-aware speaker diarization for transcripts and text-based video editing

Life of this patent

Abstract

Claims20