Back to results
US 10,650,826 B2Granted
Diarization using acoustic labeling
AssigneeVerint Systems Ltd.
InventorsOmer Ziv, Ran Achituv, Ido Shapira, Jeremie Dreyfuss
Life of this patent
Estimating the term…
Abstract
Systems and method of diarization of audio files use an acoustic voiceprint model. A plurality of audio files are analyzed to arrive at an acoustic voiceprint model associated to an identified speaker. Metadata associate with an audio file is used to select an acoustic voiceprint model. The selected acoustic voiceprint model is applied in a diarization to identify audio data of the identified speaker.
Claims20
A non-transitory computer-readable medium having instructions stored thereon for facilitating diarization of audio files from a customer service interaction, wherein the instructions, when executed by a processing system, direct the processing system to:
- receive a plurality of audio files from a database server and speaker metadata associated with each of the plurality of audio files from the database server of the plurality of audio files;
- identify, with a processor, a subset of audio files from the plurality belonging to a specific speaker based upon the received speaker metadata, wherein each audio file is a recording of a customer service interaction and the specific speaker is a customer service agent and there is at least one other speaker in the audio file, wherein the at least one other speaker is not the identified specific speaker;
- select a subset of the audio files belonging to the specific speaker of the identified set of audio files with the processor, wherein each audio file of the subset is selected to maximize an acoustical difference in voice frequencies between the specific speaker and the at least one other speaker in the same audio file, wherein the audio file is a recording of a customer service interaction and the specific speaker is a customer service agent and the at least one other speaker is a customer, wherein the acoustical difference is a distance between clusters identified by blind diarization between the specific speaker and the at least one other speaker in the same audio file, wherein the at least one other speaker is a customer;
- compute an acoustic voiceprint for the specific speaker from the selected subset of audio files with the processor by diarizing the audio files into speaker segments, clustering similar speaker segments, classifying the clustered speaker segments as belonging to the customer service agent or the customer, and building the acoustic voiceprint using the clustered speaker segments belonging to the customer service agent, wherein the acoustic voiceprint will consist of all clustered speaker segments that are a match to the customer service agent;
- save the acoustic voiceprint to a voiceprint database server and associating it with the metadata of the known speaker;
- and
- with the processor, applying the saved acoustic voiceprint from the voiceprint database server to a new audio file from an audio source to identify the specific speaker in diarization of the new audio file by diarizing the new audio file into new speaker segments, comparing each new speaker segment to the acoustic voiceprint, and determining if the new speaker segment matches the acoustic voiceprint.
4 more elements
A system for diarization of audio files, the system comprising:
- an audio database server comprising a plurality of audio files, wherein each audio file is a recording of a customer service interaction including a known speaker and at least one other speaker;
- and
- a processor that selects a set of audio files, wherein the selected audio files are all from a specific known speaker, further wherein each selected audio file maximizes an acoustical difference in voice frequencies between the known speaker and the at least one other speaker in the same audio file, performs a blind diarization on the subset of audio files to segment the audio files into a plurality of segments of speech separated by non-speech, such that each segment has a high likelihood of containing speech sections from a single speaker, automatedly applies at least one metric to the segments of speech with a processor to label segments of speech likely to be associated with the known speaker and clustering the selected segments into an audio speaker segment, analyzes the selected audio speaker segment to create an acoustic voiceprint, wherein the acoustic voiceprint is built from all the selected speaker segments, applies the acoustic voiceprint to the audio files with the processor to label a portion of the audio file as having been spoken by the known speaker.
A non-transitory computer-readable medium having instructions stored thereon for facilitating diarization of audio files from a customer service interaction, wherein the instructions, when executed by a processing system, direct the processing system to:
- receive a plurality of audio files from a database server and speaker metadata associated with each of the plurality of audio files, wherein each audio file is a recording of a customer service interaction including a known speaker and at least one other speaker, wherein the known speaker is a specific customer service agent and the at least one other speaker is a customer;
- select a subset of the audio files, wherein each audio file of the subset is selected to maximize an acoustical difference in voice frequencies between the known speaker and the at least one other speaker in the same audio file;
- perform a blind diarization on the subset of audio files to segment the audio files into a plurality of segments of speech separated by non-speech, such that each segment has a high likelihood of containing speech sections from a single speaker;
- automatedly apply at least one metric to the segments of speech with a processor to label segments of speech likely to be associated with the known speaker and clustering the selected segments into an audio speaker segment;
- analyze the selected audio speaker segment to create an acoustic voiceprint, wherein the acoustic voiceprint is built from all the selected speaker segments;
- apply the acoustic voiceprint to the audio files with the processor to label a portion of the audio file as having been spoken by the known speaker;
- add the labeled portion of the audio file to the acoustic voiceprint;
- save the acoustic voiceprint to a voiceprint database server and associating it with the metadata of the known speaker;
- and
- with the processor, apply the saved acoustic voiceprint from the voiceprint database server to a new audio file from an audio source to perform diarization of the new audio file by blind diarizing the new audio file, comparing each of the new speech segments to the acoustic voiceprint, and labeling each speech segment as belonging to the known speaker associated with the acoustic voiceprint or belonging to an other speaker.
7 more elements
Dependencies are inferred from the claim text.