Intelligent multi-camera switching with machine learning

A non-transitory processor readable memory containing programs that when executed cause a processor or processors to perform the following method of selecting a camera of a plurality of cameras, each with a different view of a group of individuals in an environment, to provide a video stream for provision to a far end, the method comprising:

• for each camera of the plurality of cameras:
• providing a video stream from the camera;
• utilizing sound source localization using a microphone array on the camera to determine direction information;
• identifying a speaker in the group of individuals using the sound source localization direction information and an image from the video stream;
• identify facial features of the speaker in the image from the video stream;
• and
• providing an output of the identified facial features;
• and
• selecting a camera from the plurality of cameras to provide a video stream for provision to the far end based on comparison of the identified facial features output for each camera.

A system for selecting a camera of a plurality of cameras, each with a different view of a group of individuals in an environment, to provide a video stream for provision to a far end, the system comprising:

• a plurality of cameras, each camera including:
• an imager;
• a microphone array;
• an output interface for providing data and a video stream;
• RAM;
• a processor coupled to the imager, the output interface, the microphone array and the RAM for executing programs;
• and
• memory coupled to the processor for storing programs executed by the processor, the memory storing programs executed by the processor to perform the operations of:
• providing a video stream from the camera;
• and
• utilizing sound source localization using the microphone array to determine direction information and providing direction information;
• and
• a codec coupled to the plurality of cameras, the codec including:
• an input interface for coupling to the plurality of cameras to receive data and video streams;
• a network interface for communicating with the far end;
• RAM;
• a processor coupled to the network interface, the input interface and the RAM for executing programs;
• and
• memory coupled to the processor for storing programs executed by the processor, the memory storing programs executed by the processor to perform the operation of:
• selecting a camera from the plurality of cameras to provide a video stream for provision to the far end based on comparison of identified facial features output for each camera,
• wherein either the memory of each camera of the plurality of cameras stores programs executed by the processor to perform the operations of or the memory of the codec stores programs executed by the processor to perform for each camera of the plurality of cameras the operations of:
• identifying a speaker in the group of individuals using the sound source localization direction information and an image from the video stream;
• identify facial features of the speaker in the image from the video stream;
• and
• providing an output of the identified facial features.