Primary speaker identification from audio and video data

An information handling device, comprising:

• a visual sensor;
• one or more microphones;
• one or more processors;
• and
• a memory storing code executable by the one or more processors to:
• receive image data from the visual sensor;
• receive audio data from the one or more microphones;
• identify human speech in the audio data;
• identify a pattern of visual features in the image data associated with speaking;
• match the human speech in the audio data with the pattern of visual features in the image data associated with speaking;
• select a primary speaker from among matched human speech;
• assign control to the primary speaker;
• and
• perform one or more actions based on audio input of the primary speaker.

A program product, comprising:

• a computer readable storage medium storing instructions executable by one or more processors, the instructions comprising:
• computer readable program code configured to receive image data from a visual sensor of an information handling device;
• computer readable program code configured to receive audio data from one or more microphones of the information handling device;
• computer readable program code configured to identify, using one or more processors, human speech in the audio data;
• computer readable program code configured to identify, using the one or more processors, a pattern of visual features in the image data associated with speaking;
• computer readable program code configured to match, using the one or more processors, the human speech in the audio data with the pattern of visual features in the image data associated with speaking;
• computer readable program code configured to select, using the one or more processors, a primary speaker from among matched human speech;
• computer readable program code configured to assign control to the primary speaker;
• and
• computer readable program code configured to perform one or more actions based on audio input of the primary speaker.

An information handling device, comprising:

• a visual sensor;
• two or more microphones;
• one or more processors;
• and
• a memory storing code executable by the one or more processors to:
• receive image data from the visual sensor;
• receive audio data from the two or more microphones;
• identify human speech in the audio data;
• identify a pattern of visual features in the image data associated with speaking utilizing directional information in the audio data received to identify the pattern of visual features associated with speaking;
• match the human speech in the audio data with the pattern of visual features in the video data associated with speaking;
• identify matched human speech as a primary speaker;
• and
• perform one or more actions based on the primary speaker identified.