Speaker identification, verification, and diarization using neural networks for conversational ai systems and applications
AssigneeNVIDIA Corporation
InventorsNithin Rao Koluguri, Taejin Park, Boris Ginsburg
Life of this patent
Estimating the term…
Loading patent…
AssigneeNVIDIA Corporation
InventorsNithin Rao Koluguri, Taejin Park, Boris Ginsburg
Estimating the term…
Disclosed are apparatuses, systems, and techniques that may use machine learning for implementing speaker recognition, verification, and/or diarization. The techniques include applying a neural network (NN) to a speech data to obtain a speaker embedding representative of an association between the speech data and a speaker that produced the speech. The speech data includes a plurality of frames and a plurality of channels representative of spectral content of the speech data. The NN has one or more blocks of neurons that include a first branch performing convolutions of the speech data across the plurality of channels and across the plurality of frames and a second branch performing convolutions of the speech data across the plurality of channels. Obtained speaker embeddings may be used for various tasks of speaker identification, verification, and/or diarization.
A method comprising:
A system comprising:
One or more processors comprising processing circuitry to associate speech with a speaker, wherein the speech is associated with the speaker based at least on a speaker embedding generated by processing the speech using a neural network having (i) a first branch of convolutions across two dimensions of a frequency-frame space of the speech and (ii) a second branch of convolutions across one dimension of the frequency-frame space of the speech.
Dependencies are inferred from the claim text.