Audio analysis learning using video data

A computer program product embodied in a non-transitory computer readable medium for audio analysis, the computer program product comprising code which causes one or more processors to perform operations of:

• obtaining video data wherein the video data includes images of one or more people;
• obtaining audio data corresponding to the video data;
• identifying a face within the video data;
• associating a first voice, from the audio data, with the face within the video data;
• analyzing the face within the video data for cognitive content;
• learning an audio classifier based on the analyzing of the face within the video data;
• identifying and separating a second voice from the obtained audio data corresponding to the video data but not associated with the face associated with a first voice, wherein the second voice is included in the learning and wherein the second voice corresponds to a second person;
• and
• analyzing further audio data using the audio classifier.

A computer system for audio analysis comprising:

• a memory which stores instructions;
• one or more processors attached to the memory wherein the one or more processors, when executing the instructions which are stored, are configured to:
• obtain video data, on a first computing device, wherein the video data includes images of one or more people;
• obtain audio data, on a second computing device, corresponding to the video data;
• identify a face within the video data;
• associate a first voice, from the audio data, with the face within the video data;
• analyze the face within the video data for cognitive content;
• learn an audio classifier, on a third computing device, based on the analyzing of the face within the video data;
• identify and separate a second voice from the obtained audio data corresponding to the video data but not associated with the face associated with a first voice, wherein the second voice is included in learning and wherein the second voice corresponds to a second person;
• and
• analyze further audio data using the audio classifier.