Systems and methods for correlating individuals across outputs of a multi-camera system and framing interactions between meeting participants

A multi-camera system, comprising:

• a plurality of cameras each configured to generate a video output stream representative of a meeting environment, wherein a first representation of a meeting participant is included in a first video output stream from a first camera included in the plurality of cameras, and wherein a second representation of a meeting participant is included in a second video output stream from a second camera included in the plurality of cameras;
• and
• a video processing unit configured to:
• automatically analyze the first video output stream and the second video output stream, based on at least one identity indicator including a first feature vector corresponding to the first representation and a second feature vector corresponding to the second representation, to determine whether the first representation of the meeting participant and the second representation of the meeting participant correspond to a common meeting participant by:
• determining a distance between the first feature vector and the second feature vector;
• and
• associating, based on the determined distance, the first vector with the second vector, wherein the determined distance is less than a predetermined threshold;
• evaluate the first representation and the second representation of the common meeting participant relative to one or more predetermined criteria, wherein the one or more predetermined criteria include a combination of:
• whether the common meeting participant is detected as speaking, a head pose of the common meeting participant, and a face visibility level associated with the common meeting participant;
• select, based on the evaluation, either the first video output stream or the second video output stream as a source of a framed representation of the common meeting participant to be output as a primary video stream;
• and
• generate, as an output of the multi-camera system, the primary video stream including the framed representation of the common meeting participant.

A multi-camera system, comprising:

• a plurality of cameras each configured to generate a video output stream representative of a meeting environment;
• and
• a video processing unit configured to:
• automatically analyze a plurality of video output streams received from the plurality of cameras and, based on the analysis, identify at least one video output stream among the plurality of video output streams that includes a representation of a first subject facing a second subject, wherein the first subject is an active speaker, a face of the first subject is visible in the identified video output stream, and at least a portion of a back of a shoulder of the second subject is visible in the identified video output stream;
• and
• generate a primary video stream based on the identified video output stream, wherein the primary video stream includes a framed composition including representations of at least the face of the first subject and the at least the portion of the back of the shoulder of the second subject.