# US 12,764,252 B2 · Measuring and using interactivity in video conferencing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,764,252 B2 - Document ID: US12764252B2 - Status: Granted - Kind: B2 - Application number: 18/652,988 - Filed: 2024-05-02 - Published: 2025-11-06 - Granted: 2026-10-13 - Earliest claimed: 2024-05-02 - Assignees: AT&T Intellectual Property I, L.P.; Georgia Tech Research Corporation - Applicants: AT&T Intellectual Property I, L.P.; Georgia Tech Research Corporation - Inventors: Theodore Karagioules; Emir Halepovic; Mostafa Ammar; Ellen Zegura; Jia He - Web page: https://patentgrep.com/patent/US12764252B2 ## CPC - H04N 7/15: Conference systems - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Measuring and using interactivity in video conferencing can include identifying two or more client devices to be added to the video conference and establishing the video conference with the two client devices. Medica content can be generated, exchanged, and received via a video conferencing service, and quality of experience metric data associated with the video conference can be obtained. The quality of experience metric data can define interactivity associated with the video conference based on observable behavior associated with the video conference. Based on the quality of experience metric data, a projected quality of experience can be compared to a defined quality of experience measure, and if the projected quality of experience does not satisfy the defined quality of experience measure, a change to improve the projected quality of experience can be determined and a command can be generated and sent to cause a recipient to make the change. ## Claims ### Claim 1 A system comprising a processor and a memory that stores computer-executable instructions that, when executed by the processor, cause the processor to perform operations comprising: detecting a request to initiate a video conference; identifying two client devices that are to be added to the video conference; triggering a signaling server to establish the video conference with the two client devices, wherein the two client devices generate, exchange, and receive media content with one another via a video conferencing service; obtaining, at a computer, quality of experience metric data associated with the video conference, wherein the quality of experience metric data defines an interactivity associated with the video conference and is based on observable behavior associated with the video conference, wherein the quality of experience metric data is generated at the computer by analyzing an audio and video stream associated with the video conference by detecting repeated phrases, overlapping speech, and a silence time ratio using machine learning that is trained on simulated video conferences; determining, based on the quality of experience metric data, if a projected quality of experience associated with the video conference satisfies a defined quality of experience measure; and if a determination is made that the projected quality of experience associated with the video conference does not satisfy the defined quality of experience measure, determining a change to be made to the video conference to improve the projected quality of experience, generating a command that, when executed, causes a recipient to make the change, and sending the command to the recipient. ### Claim 2 (depends on 1) The system of claim 1, wherein the quality of experience metric data comprises data representing a turnaround time, an overlap time ratio, an overlap rate, a useful conversation time ratio, a repeat rate, and turn-taking freedom associated with the video conference. ### Claim 3 (depends on 2) The system of claim 2, wherein a first portion of the quality of experience metric data is generated by the computer by analyzing the audio and video stream associated with the video conference, and wherein a second portion of the quality of experience metric data is provided to the computer by the two client devices. ### Claim 4 (depends on 3) The system of claim 3, wherein the two client devices generate the quality of experience metric data based on analyzing the media content received by the two client devices. ### Claim 5 (depends on 1) The system of claim 1, wherein the quality of experience metric data is provided to the computer by the two client devices, and wherein the two client devices generate the quality of experience metric data based on analyzing the media content received by the two client devices. ### Claim 6 (depends on 1) The system of claim 1, wherein the command causes one client device of the two client devices to introduce delay into audio and video associated with the video conference at the one client device. ### Claim 7 (depends on 1) The system of claim 1, wherein the command causes the two client devices to reconnect to the video conference using a different communication path. ### Claim 8 A method comprising: detecting, at a computer comprising a processor, a request to initiate a video conference; identifying, by the processor, two client devices that are to be added to the video conference; triggering, by the processor, a signaling server to establish the video conference with the two client devices, wherein the two client devices generate, exchange, and receive media content with one another via a video conferencing service; obtaining, by the processor, quality of experience metric data associated with the video conference, wherein the quality of experience metric data defines an interactivity associated with the video conference and is based on observable behavior associated with the video conference, wherein the quality of experience metric data is generated at the computer by analyzing an audio and video stream associated with the video conference by detecting repeated phrases, overlapping speech, and a silence time ratio using machine learning that is trained on simulated video conferences; determining, by the processor and based on the quality of experience metric data, if a projected quality of experience associated with the video conference satisfies a defined quality of experience measure; and if a determination is made that the projected quality of experience associated with the video conference does not satisfy the defined quality of experience measure, determining, by the processor, a change to be made to the video conference to improve the projected quality of experience, generating, by the processor, a command that, when executed, causes a recipient to make the change, and sending, by the processor, the command to the recipient. ### Claim 9 (depends on 8) The method of claim 8, wherein the quality of experience metric data comprises data representing a turnaround time, an overlap time ratio, an overlap rate, a useful conversation time ratio, a repeat rate, and turn-taking freedom associated with the video conference. ### Claim 10 (depends on 9) The method of claim 9, wherein a first portion of the quality of experience metric data is generated by the computer by analyzing the audio and video stream associated with the video conference, and wherein a second portion of the quality of experience metric data is provided to the computer by the two client devices. ### Claim 11 (depends on 10) The method of claim 10, wherein the two client devices generate the quality of experience metric data based on analyzing the media content received by the two client devices. ### Claim 12 (depends on 8) The method of claim 8, wherein the quality of experience metric data is provided to the computer by the two client devices, and wherein the two client devices generate the quality of experience metric data based on analyzing the media content received by the two client devices. ### Claim 13 (depends on 8) The method of claim 8, wherein the command causes one client device of the two client devices to introduce delay into audio and video associated with the video conference at the one client device. ### Claim 14 A computer storage medium having computer-executable instructions stored thereon that, when executed by a processor, cause the processor to perform operations comprising: detecting a request to initiate a video conference; identifying two client devices that are to be added to the video conference; triggering a signaling server to establish the video conference with the two client devices, wherein the two client devices generate, exchange, and receive media content with one another via a video conferencing service; obtaining, at a computer, quality of experience metric data associated with the video conference, wherein the quality of experience metric data defines an interactivity associated with the video conference and is based on observable behavior associated with the video conference, wherein the quality of experience metric data is generated at the computer by analyzing an audio and video stream associated with the video conference by detecting repeated phrases, overlapping speech, and a silence time ratio using machine learning that is trained on simulated video conferences; determining, based on the quality of experience metric data, if a projected quality of experience associated with the video conference satisfies a defined quality of experience measure; and if a determination is made that the projected quality of experience associated with the video conference does not satisfy the defined quality of experience measure, determining a change to be made to the video conference to improve the projected quality of experience, generating a command that, when executed, causes a recipient to make the change, and sending the command to the recipient. ### Claim 15 (depends on 14) The computer storage medium of claim 14, wherein the quality of experience metric data comprises data representing a turnaround time, an overlap time ratio, an overlap rate, a useful conversation time ratio, a repeat rate, and turn-taking freedom associated with the video conference. ### Claim 16 (depends on 15) The computer storage medium of claim 15, wherein a first portion of the quality of experience metric data is generated by the computer by analyzing the audio and video stream associated with the video conference, and wherein a second portion of the quality of experience metric data is provided to the computer by the two client devices. ### Claim 17 (depends on 16) The computer storage medium of claim 16, wherein the two client devices generate the quality of experience metric data based on analyzing the media content received by the two client devices. ### Claim 18 (depends on 14) The computer storage medium of claim 14, wherein the quality of experience metric data is provided to the computer by the two client devices, and wherein the two client devices generate the quality of experience metric data based on analyzing the media content received by the two client devices. ### Claim 19 (depends on 14) The computer storage medium of claim 14, wherein the command causes one client device of the two client devices to introduce delay into audio and video associated with the video conference at the one client device. ### Claim 20 (depends on 14) The computer storage medium of claim 14, wherein the command causes the two client devices to reconnect to the video conference using a different communication path.