Detecting active speakers using head detection
AssigneeCisco Technology, Inc.
InventorChristian Fjelleng Theien
Life of this patent
Estimating the term…
Abstract
Audio samples are obtained from a plurality of microphones in a conference room that includes a plurality of participants of an online communication session. A cross correlation is calculated between audio samples for each microphone pair of the plurality of microphones. For each participant, a distance between the participant and each microphone is estimated and, for each microphone pair, an expected delay between when microphones in a microphone pair receive audio from a participant is calculated based on the distance. For each participant, a score is computed based on the cross correlation for each microphone pair and the expected delay for each microphone pair and the participant that is speaking is identified based on the score computed for each participant.
Claims20
A computer-implemented method comprising:
- obtaining audio samples from a plurality of microphones in a conference room, the conference room including a plurality of participants of an online communication session;
- calculating a cross correlation between audio samples for each microphone pair of the plurality of microphones;
- detecting a position of each participant, of the plurality of participants, in the conference room based on a video stream of the conference room;
- for each participant, estimating a distance between the detected position of the participant and a position of each microphone;
- for each participant and for each microphone pair, calculating, based on the distance, an expected delay between a first time when audio of the participant reaches a first microphone of the microphone pair and a second time when the audio of the participant reaches a second microphone of the microphone pair;
- for each participant, computing a score based on the cross correlation for each microphone pair and the expected delay for each microphone pair;
- and
- identifying the participant, of the plurality of participants, that is speaking based on the score computed for each participant.
An apparatus comprising:
- a memory;
- a network interface configured to enable network communication;
- and
- a processor, wherein the processor is configured to perform operations comprising:
- obtaining audio samples from a plurality of microphones in a conference room, the conference room including a plurality of participants of an online communication session;
- calculating a cross correlation between audio samples for each microphone pair of the plurality of microphones;
- detecting a position of each participant, of the plurality of participants, in the conference room based on a video stream of the conference room;
- for each participant, estimating a distance between the position of the participant and a position of each microphone;
- for each participant and for each microphone pair, calculating, based on the distance, an expected delay between a first time when audio of the participant reaches a first microphone of the microphone pair and a second time when the audio of the participant reaches a second microphone of the microphone pair;
- for each participant, computing a score based on the cross correlation for each microphone pair and the expected delay for each microphone pair;
- and
- identifying the participant, of the plurality of participants, that is speaking based on the score computed for each participant.
One or more non-transitory computer readable storage media encoded with instructions that, when executed by a processor of a conference endpoint, cause the processor to execute a method comprising:
- obtaining audio samples from a plurality of microphones in a conference room, the conference room including a plurality of participants of an online communication session;
- calculating a cross correlation between audio samples for each microphone pair of the plurality of microphones;
- detecting a position of each participant, of the plurality of participants, in the conference room based on a video stream of the conference room;
- for each participant, estimating a distance between the detected position of the participant and a position of each microphone;
- for each participant and for each microphone pair, calculating, based on the distance, an expected delay between a first time when audio of the participant reaches a first microphone of the microphone pair and a second time when the audio of the participant reaches a second microphone of the microphone pair;
- for each participant, computing a score based on the cross correlation for each microphone pair and the expected delay for each microphone pair;
- and
- identifying the participant, of the plurality of participants, that is speaking based on the score computed for each participant.
Dependencies are inferred from the claim text.