Management and analysis of related concurent communication sessions

A system comprising:

• one or more computers;
• and
• one or more computer-readable media storing instructions that are operable, when executed, to perform operations comprising:
• identifying, by the one or more computers, multiple sub-sessions of a network-based communication session in which multiple remote endpoint devices each provide media streams over a communication network, wherein the sub-sessions occur concurrently and include different subsets of the endpoint devices, and wherein each sub-session involves sharing media streams among the subset of endpoint devices included in the sub-session;
• for each of the sub-sessions, identifying, by the one or more computers, the endpoint devices included in the sub-session;
• obtaining, by the one or more computers, user state data for each of the endpoint devices, the user state data for each endpoint device being generated based on analysis of face images of the user of the endpoint device captured by the endpoint device during the communication session;
• aggregating, by the one or more computers, the user state data to determine a sub-session state for each of the sub-sessions, wherein the sub-session state for each sub-session is determined based on the user state data for the subset of endpoint devices identified as being included in the sub-session;
• and
• during the communication session, communicating, by the one or more computers, over the communication network with a remote device associated with the communication session to cause a user interface of the remote device to indicate the sub-session states determined for one or more of the multiple sub-sessions.

A method performed by one or more computers, the method comprising:

• identifying, by the one or more computers, multiple sub-sessions of a network-based communication session in which multiple remote endpoint devices each provide media streams over a communication network, wherein the sub-sessions occur concurrently and include different subsets of the endpoint devices, and wherein each sub-session involves sharing media streams among the subset of endpoint devices included in the sub-session;
• for each of the sub-sessions, identifying, by the one or more computers, the endpoint devices included in the sub-session;
• obtaining, by the one or more computers, user state data for each of the endpoint devices, the user state data for each endpoint device being generated based on analysis of face images of the user of the endpoint device captured by the endpoint device during the communication session;
• aggregating, by the one or more computers, the user state data to determine a sub-session state for each of the sub-sessions, wherein the sub-session state for each sub-session is determined based on the user state data for the subset of endpoint devices identified as being included in the sub-session;
• based on the sub-session state determined for a particular sub-session, selecting, by the one or more computers, an action to adjust or interact with the particular sub-session;
• generating, by the one or more computers, user interface data configured to cause a user interface of a remote device to present an interactive control configured to initiate the selected action for the particular sub-session in response to interaction with the interactive control;
• and
• during the communication session, communicating, by the one or more computers, over the communication network with a remote device associated with the communication session to cause a user interface of the remote device to (i) indicate the sub-session states determined one or more of the multiple sub-sessions and (ii) present the interactive control configured to initiate the selected action for the particular sub-session that was determined based on the sub-session state determined for the particular sub-session.