# US 12,015,874 B2 · System and methods to determine readiness in video collaboration

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,015,874 B2
- Document ID: US12015874B2
- Status: Granted
- Kind: B2
- Application number: 17/987,519
- Filed: 2022-11-15
- Published: 2023-10-12
- Granted: 2024-06-18
- Earliest claimed: 2020-11-24
- Assignees: Rovi Guides, Inc.
- Applicants: Rovi Guides, Inc.
- Inventors: Ankur Anil Aher; Charishma Chundi
- Web page: https://patentgrep.com/patent/US12015874B2

## CPC

- H04N 7/15: Conference systems
- H04N 7/152: {Multipoint control units therefor}
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G10L 25/51: for comparison or discrimination
- G10L 17/00: Speaker identification or verification techniques
- G10L 25/48: specially adapted for particular use
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A system or method of prioritizing participants in a virtual meeting via a network by scoring each participant on several criteria and weighting the criteria to determine a readiness score. The system of accesses, for each of a plurality of participants, network data, video data, audio data, processing data, and participation data. The system determines, for each of the plurality of participants, a signal strength score based on the corresponding network data, a background score based on the corresponding video data and audio data, a microphone proximity score based on the corresponding video data, a processing score for each of the plurality of participants based on the corresponding processing data, and an engagement score based on the corresponding video data and participation data. The system calculates the readiness score, for each participant, based at least on the corresponding signal strength score, background score, engagement score, and processing score, ranks the participants, and provides the ranked participants.

## Claims

### Claim 1

A method comprising:
receiving at a device video data and audio data for each of a plurality of participants via a network;
determining, by control circuitry, for each of the plurality of participants, a video background score based on motion in the respective video data;
determining, by the control circuitry, an audio background score based on noise in the respective audio data;
determining, by the control circuitry, a readiness score, for each of the plurality of participants, based on the respective video background score and the respective audio background score;
ranking the plurality of participants based on the corresponding readiness score; and
providing the ranked plurality of participants.

### Claim 2 (depends on 1)

The method of claim 1, wherein the video background score based on the motion in the respective video data is determined by:
retrieving a set of image frames from the video data;
identifying a subset of image frames in the set of image frames, wherein the subset of image frames corresponding to the motion in the respective video data;
determining, by the control circuitry, a distraction level for each image frame in the subset of image frames; and
determining, by the control circuitry, a video background score based on the distraction levels of the subset of image frames.

### Claim 3 (depends on 2)

The method of claim 2, wherein the subset of image frames is identified by determining, by the control circuitry, a visual difference between the image frame in the subset of image frames to a reference frame.

### Claim 4 (depends on 1)

The method of claim 1, wherein the audio background score based on the noise in the respective audio data is determined by:
retrieving an audio wave form from the audio data;
identifying, by the control circuitry, a subset of noises in the audio wave form; and
determining, by the control circuitry, a distraction level for each noise in the subset of noises; and
determining, by the control circuitry, an audio background score based on the distraction levels of the subset of noises.

### Claim 5 (depends on 4)

The method of claim 4, wherein the subset of noises is identified, by the control circuitry, by filtering the audio wave through a Fast Fourier Transform algorithm.

### Claim 6 (depends on 4)

The method of claim 4, wherein the subset of noises is identified, by the control circuitry, by filtering the audio wave based on a noise amplitude threshold.

### Claim 7 (depends on 1)

The method of claim 1, wherein the video background score is determined, by the control circuitry, based on: a duration level of the motion in the video data, and a visibility level of the video data.

### Claim 8 (depends on 1)

The method of claim 1, wherein the audio background score is determined, by the control circuitry, based on a duration level of the noise in the audio data and a volume level of the audio data.

### Claim 9 (depends on 1)

The method of claim 1, wherein the readiness score is determined by:
determining, by the control circuitry, an average background score between the video background score and the audio background score; and
determining, by the control circuitry, a readiness score by decreasing a base readiness score by the average background score.

### Claim 10 (depends on 9)

The method of claim 9, wherein the readiness score is further determined, by the control circuitry, by at least one selected from the following: signal strength, processing data, and participation data.

### Claim 11

A system comprising:
input/output circuitry configured to:
receive video data and audio data for each of a plurality of participants; and
processing circuitry configured to:
determine each of the plurality of participants, a video background score based on motion in the respective video data;
determine an audio background score based on noise in the respective audio data;
determine a readiness score, for each of the plurality of participants, based on the respective video background score and the respective audio background score;
rank the plurality of participants based on the corresponding readiness score; and
cause to be provided the ranked plurality of participants.

### Claim 12 (depends on 11)

The system of claim 11, wherein the processing circuitry is further configured to determine the video background score based on the motion in the respective video data by:
retrieving a set of image frames from the video data;
identifying a subset of image frames in the set of image frames, wherein the subset of image frames corresponding to the motion in the respective video data;
determining a distraction level for each image frame in the subset of image frames; and
determining a video background score based on the distraction levels of the subset of image frames.

### Claim 13 (depends on 12)

The system of claim 12, wherein the processing circuitry is further configured to identify the subset of image frames by determining a visual difference between the image frame in the subset of image frames to a reference frame.

### Claim 14 (depends on 11)

The system of claim 11, wherein the processing circuitry is further configured to determine the audio background score based on the noise in the respective audio data by:
retrieving an audio wave form from the audio data;
identifying a subset of noises in the audio wave form;
determining a distraction level for each noise in the subset of noises; and
determining an audio background score based on the distraction levels of the subset of noises.

### Claim 15 (depends on 14)

The system of claim 14, wherein the processing circuitry is further configured to identify the subset of noises by filtering the audio wave through a Fast Fourier Transform algorithm.

### Claim 16 (depends on 14)

The system of claim 14, wherein the processing circuitry is further configured to identify the subset of noises by filtering the audio wave based on a noise amplitude threshold.

### Claim 17 (depends on 11)

The system of claim 11, wherein the processing circuitry is further configured to determine the video background score based on: a duration level of the motion in the video data, and a visibility level of the video data.

### Claim 18 (depends on 11)

The system of claim 11, wherein the processing circuitry is further configured to determine the audio background score based on a duration level of the noise in the audio data and a volume level of the audio data.

### Claim 19 (depends on 11)

The system of claim 11, wherein the processing circuitry is further configured to determine the readiness score by:
determining an average background score between the video background score and the audio background score; and
determining a readiness score by decreasing a base readiness score by the average background score.

### Claim 20 (depends on 19)

The system of claim 19, wherein the processing circuitry is further configured to determine the readiness score based on at least one selected from the following: signal strength, processing data, and participation data.
