# US 2022/0279142 A1 · Participation management system for videoconferencing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0279142 A1
- Document ID: US20220279142A1
- Status: Published application
- Kind: A1
- Application number: 17/750,146
- Filed: 2022-05-20
- Published: 2022-09-01
- Earliest claimed: 2020-09-10
- Assignees: Atlassian Pty Ltd.; Atlassian Inc.
- Applicants: Atlassian Pty Ltd.; Atlassian Inc.
- Inventors: Ali Dasdan; Stephen Deasy
- Web page: https://patentgrep.com/patent/US20220279142A1

## CPC

- H04N 5/445: for displaying additional information (H04N5/50 takes precedence)
- H04N 7/152: {Multipoint control units therefor}
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- G06V 40/174: {Facial expression recognition}
- G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit
- H04N 7/15: Conference systems
- H04N 21/00: Selective content distribution, e.g. interactive television or video on demand [VOD] (real-time bi-directional transmission of motion video data H04N7/14 {; broadcast or conference over packet switching networks H04L12/18})
- G10L 25/63: for estimating an emotional state
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method may include receiving a videoconference stream from a client device of a plurality of client devices participating in a videoconference, the videoconference stream comprising video content of a user of the client device and audio content of the user of the client device. The method may also include generating, during the videoconference and based at least in part on at least one of the video content and the audio content, a participation metric for the user of the client device, displaying, to the user and during the videoconference, first information based on the participation metric, updating the participation metric during the videoconference to produce an updated participation metric, and displaying, to the user and during the videoconference, second information based on the updated participation metric.

## Claims

### Claim 1

A method, comprising:
receiving a videoconference stream from a client device of a plurality of client devices participating in a videoconference, the videoconference stream comprising:
video content of a user of the client device; and
audio content of the user of the client device;
generating, during the videoconference and based at least in part on at least one of the video content and the audio content, a participation metric for the user of the client device;
displaying, to the user and during the videoconference, first information based on the participation metric;
updating the participation metric during the videoconference to produce an updated participation metric; and
displaying, to the user and during the videoconference, second information based on the updated participation metric.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the user is a first user;
the client device is a first client device;
the participation metric is a first participation metric;
the videoconference stream is a first videoconference stream;
the method further comprises:
receiving a second videoconference stream, the second videoconference stream comprising:
video content of a second user of the second client device; and
audio content of the second user of the second client device; and
generating, during the videoconference and based at least in part on at least one of the second video content and the second audio content, a second participation metric for the second user of the second client device.

### Claim 3 (depends on 2)

The method of claim 2, wherein:
the method further comprises displaying, to a third user and during the videoconference, the first participation metric and the second participation metric; and
the third user is a host of the videoconference.

### Claim 4 (depends on 3)

The method of claim 3, further comprising displaying, to the third user and during the videoconference a listing of videoconference participants in ranked order based on respective participation metrics of the respective videoconference participants.

### Claim 5 (depends on 1)

The method of claim 1, wherein:
generating the participation metric comprises analyzing the audio content to determine an amount of time that the user is speaking; and
the participation metric is based at least in part on the amount of time that the user is speaking.

### Claim 6 (depends on 1)

The method of claim 1, wherein:
generating the participation metric comprises analyzing the video content to determine a facial expression of the user; and
the participation metric is based at least in part on the facial expression of the user.

### Claim 7 (depends on 5)

The method of claim 5, wherein:
generating the participation metric further comprises determining a duration that the facial expression of the user corresponds to a facial expression indicative of inattentiveness; and
the participation metric is further based on the duration that the facial expression of the user corresponds to the facial expression indicative of inattentiveness.

### Claim 8

A method, comprising:
receiving, from a plurality of respective client devices participating in a videoconference, a plurality of respective videoconference streams, the respective video streams associated with respective users;
generating, during the videoconference and based at least in part on information in the respective videoconference streams, respective participation metrics for the respective users;
determining a user of the respective users that has a lowest participation metric; and
displaying, to a host of the videoconference, the video stream of the user that has the lowest participation metric; and
in response to determining the user that has the lowest participation metric, displaying, to the host of the videoconference, a graphical indicator associated with the video stream of the user that has the lowest participation metric.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
displaying, to the host of the videoconference, the video streams associated with each of the respective users; and
the video stream of the user having the lowest participation metric is the largest video stream of the displayed video streams.

### Claim 10 (depends on 8)

The method of claim 8, further comprising displaying, to the host of the videoconference, the video streams associated with each of the respective users, wherein the video streams are displayed in ranked order based on the respective participation metrics of the respective users.

### Claim 11 (depends on 8)

The method of claim 8, wherein the participation metrics are based at least in part on respective historical participation metrics of the respective users.

### Claim 12 (depends on 11)

The method of claim 11, wherein the participation metrics are based at least in part on participation factors of the users determined during the videoconference.

### Claim 13 (depends on 12)

The method of claim 12, further comprising, after the videoconference, updating a database to include the participation factors determined during the videoconference.

### Claim 14

A method, comprising:
receiving a videoconference stream from a client device of a plurality of client devices participating in a videoconference, the videoconference stream comprising:
video content of a user of the client device; and
audio content of the user of the client device;
receiving a participation metric goal for the user of the client device;
generating, during the videoconference and based at least in part on at least one of the video content and the audio content, a participation metric for the user of the client device;
determining a progress towards the participation metric goal based on the participation metric; and
displaying, to the user and during the videoconference, the progress towards the participation metric goal.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
updating the participation metric during the videoconference to produce an updated participation metric;
updating the progress towards the participation metric goal based on the updated participation metric to produce an updated progress towards the participation metric goal; and
displaying, to the user and during the videoconference, the updated progress towards the participation metric goal.

### Claim 16 (depends on 14)

The method of claim 14, wherein the participation metric goal is based at least in part on an average participation metric of a number of other users.

### Claim 17 (depends on 14)

The method of claim 14, wherein:
generating the participation metric comprises analyzing the audio content to determine an amount of time that the user is speaking;
the participation metric is based at least in part on the amount of time that the user is speaking; and
the participation metric goal is based at least in part on a target amount of speaking time.

### Claim 18 (depends on 17)

The method of claim 17, wherein:
generating the participation metric comprises analyzing the video content to determine an amount of time that the user is not attentive to the videoconference;
the participation metric is further based at least in part on the amount of time that the user is not attentive to the videoconference; and
the participation metric goal is further based at least in part on a target amount of time that the user is not attentive to the videoconference.

### Claim 19 (depends on 18)

The method of claim 18, wherein the operation of analyzing the video content to determine the amount of time that the user is not attentive to the videoconference comprises determining an amount of time the user's eyes are directed away from the videoconference.

### Claim 20 (depends on 14)

The method of claim 14, wherein the participation metric goal is based at least in part on an attribute of the user.
