Enhanced video conference management

A system comprising:

• one or more computers;
• and
• one or more computer-readable media storing instructions that are operable, when executed by one or more computing devices, to cause the one or more computing devices to perform operations comprising:
• during a communication session, obtaining, by the one or more computing devices, a participant score for each participant in a set of multiple participants in the communication session, wherein each of the participant scores is based on at least one of facial image analysis or facial video analysis performed using image data or video data captured for the corresponding participant during the communication session, wherein each of the participant scores is indicative of an emotional or cognitive state of the corresponding participant;
• determining, by the one or more computing devices, amounts of speaking time in which different participants have spoken during the communication session;
• selecting, by the one or more computing devices, an action to improve a level of engagement or emotion of the participants based on the participant scores and the amounts of speaking time, the selected action being selected from among set of multiple candidate actions;
• using, by the one or more computing devices, the participant scores to generate an aggregate representation of the emotional or cognitive states of the set of multiple participants;
• and
• providing, by the one or more computing devices, output data to devices of one or more of the participants during the communication session, the output data comprising the aggregate representation of the emotional or cognitive states of the set of multiple participants and a recommendation of the selected action to improve the level of engagement or emotion of the participants.

One or more non-transitory computer-readable media storing instructions that are operable, when executed by one or more computing devices, to cause the one or more computing devices to perform operations comprising:

• during a communication session, obtaining, by the one or more computing devices, a participant score for each participant in a set of multiple participants in the communication session, wherein each of the participant scores is based on at least one of facial image analysis or facial video analysis performed using image data or video data captured for the corresponding participant during the communication session, wherein each of the participant scores is indicative of an emotional or cognitive state of the corresponding participant;
• determining, by the one or more computing devices, amounts of speaking time in which different participants have spoken during the communication session;
• selecting, by the one or more computing devices, an action to improve a level of engagement or emotion of the participants based on the participant scores and the amounts of speaking time, the selected action being selected from among set of multiple candidate actions;
• using, by the one or more computing devices, the participant scores to generate an aggregate representation of the emotional or cognitive states of the set of multiple participants;
• and
• providing, by the one or more computing devices, output data to devices of one or more of the participants during the communication session, the output data comprising the aggregate representation of the emotional or cognitive states of the set of multiple participants and a recommendation of the selected action to improve the level of engagement or emotion of the participants.