Online speaker diarization using local and global clustering

An apparatus comprising:

• at least one processing device configured to:
• obtain at least a portion of an audio stream containing speech activity, at least the portion of the audio stream comprising multiple segments;
• for each of the multiple segments, generate an embedding vector that represents the segment;
• within each of multiple local windows, cluster the embedding vectors into one or more clusters to perform speaker identification, wherein different clusters correspond to different speakers;
• initiate presentation of at least one first sequence of speaker identities based on the speaker identification performed for the local windows;
• within each of multiple global windows, cluster the embedding vectors into one or more clusters to perform speaker identification, wherein each global window includes two or more of the local windows;
• and
• initiate presentation of at least one second sequence of speaker identities based on the speaker identification performed for the global windows.

A non-transitory computer readable medium containing instructions that when executed cause at least one processor to:

• obtain at least a portion of an audio stream containing speech activity, at least the portion of the audio stream comprising multiple segments;
• for each of the multiple segments, generate an embedding vector that represents the segment;
• within each of multiple local windows, cluster the embedding vectors into one or more clusters to perform speaker identification, wherein different clusters correspond to different speakers;
• initiate presentation of at least one first sequence of speaker identities based on the speaker identification performed for the local windows;
• within each of multiple global windows, cluster the embedding vectors into one or more clusters to perform speaker identification, wherein each global window includes two or more of the local windows;
• and
• initiate presentation of at least one second sequence of speaker identities based on the speaker identification performed for the global windows.