# US 12,603,794 B2 · Computer vision driven actions based on user availability during video conferences > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,603,794 B2 - Document ID: US12603794B2 - Status: Granted - Kind: B2 - Application number: 18/377,178 - Filed: 2023-10-05 - Published: 2024-04-25 - Granted: 2026-04-14 - Earliest claimed: 2022-10-24 - Assignees: Cisco Technology, Inc. - Applicants: Cisco Technology, Inc. - Inventors: Keith Griffin; William Edward Reed; Dario Cazzani - Web page: https://patentgrep.com/patent/US12603794B2 ## CPC - H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves} - G06T 5/70: Denoising; Smoothing - G06V 40/23: {Recognition of whole body movements, e.g. for sport training} - H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)} - H04N 7/15: Conference systems - G06T 2207/30201: Face - G06V 40/161: {Detection; Localisation; Normalisation} - G06V 40/18: Eye characteristics, e.g. of the iris - G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract In one embodiment, a method is disclosed comprising: analyzing, by a process, real-time video of a user participating on a video conference; determining, by the process and based on analyzing, a level of engagement of the user to the video conference; detecting, by the process, that the level of engagement of the user to the video conference is below a given threshold of engagement for a minimum length of time, wherein the minimum length of time is configurable based on one or more engagement indicators; and enacting, by the process, one or more video conference privacy measures for the user within the video conference in response to the level of engagement being below the given threshold of engagement for the minimum length of time. ## Claims ### Claim 1 A method, comprising: analyzing, by a process, real-time video of a user participating on a video conference; determining, by the process and based on analyzing, a level of engagement of the user to the video conference; determining, by the process, a confidence level in an accuracy of the level of engagement based on one or more engagement indicators; detecting, by the process, that the level of engagement of the user to the video conference is below a given threshold of engagement for a minimum length of time, wherein the minimum length of time is automatically adjusted based on the confidence level in the level of engagement; and enacting, by the process, one or more video conference privacy measures for the user within the video conference in response to the level of engagement being below the given threshold of engagement for the minimum length of time. ### Claim 2 (depends on 1) The method as in claim 1, wherein enacting the one or more video conference privacy measures is further based on a confidence of the level of engagement. ### Claim 3 (depends on 2) The method as in claim 2, wherein the confidence of the level of engagement is based on the one or more engagement indicators. ### Claim 4 (depends on 1) The method as in claim 1, wherein the level of engagement is based on the one or more engagement indicators selected from a group consisting of: user body presence; user face presence; user eye gaze direction; user distance; user hand gesture; empty seat presence; user body movement; user speaking level; and background noise. ### Claim 5 (depends on 1) The method as in claim 1, wherein the one or more video conference privacy measures are selected from a group consisting of: blurring user video input to the video conference; stopping user video input to the video conference; replacing user video input to the video conference; and muting user audio input to the video conference. ### Claim 6 (depends on 1) The method as in claim 1, wherein the one or more video conference privacy measures are user-configured. ### Claim 7 (depends on 1) The method of claim 1, wherein the minimum length of time is reduced from an original minimum length of time based on detected movement of the user toward an edge of a video frame. ### Claim 8 (depends on 1) The method of claim 1, wherein the confidence level is determined based on a predictive accuracy of the one or more engagement indicators. ### Claim 9 (depends on 1) The method of claim 1, further comprising: ensuring that a person on camera at a device of the user is the user based on facial recognition. ### Claim 10 (depends on 9) The method of claim 9, wherein the level of engagement of the user is based on ensuring that the person is the user. ### Claim 11 (depends on 10) The method of claim 10, further comprising: preventing one or both of video output or audio output from the video conference in response to the person not being the user. ### Claim 12 A tangible, non-transitory, computer-readable medium having computer-executable instructions stored thereon that, when executed by a processor on a computer, cause the computer to perform a method comprising: analyzing real-time video of a user participating on a video conference; determining, based on analyzing, a level of engagement of the user to the video conference; determining a confidence level in an accuracy of the level of engagement based on one or more engagement indicators; detecting that the level of engagement of the user to the video conference is below a given threshold of engagement for a minimum length of time, wherein the minimum length of time is automatically adjusted based on the confidence level in the level of engagement; and enacting one or more video conference privacy measures for the user within the video conference in response to the level of engagement being below the given threshold of engagement for the minimum length of time. ### Claim 13 (depends on 12) The method as in claim 12, wherein enacting the one or more video conference privacy measures is further based on a confidence of the level of engagement. ### Claim 14 (depends on 13) The method as in claim 13, wherein the confidence of the level of engagement is based on the one or more engagement indicators. ### Claim 15 (depends on 12) The method as in claim 12, wherein the level of engagement is based on one or more engagement indicators selected from a group consisting of: user body presence; user face presence; user eye gaze direction; user distance; user hand gesture; empty seat presence; user body movement; user speaking level; and background noise. ### Claim 16 (depends on 12) The method as in claim 12, wherein the one or more video conference privacy measures are selected from a group consisting of: blurring user video input to the video conference; stopping user video input to the video conference; replacing user video input to the video conference; and muting user audio input to the video conference. ### Claim 17 (depends on 12) The method of claim 12, wherein the one or more video conference privacy measures are user-configured. ### Claim 18 (depends on 12) The method of claim 12, wherein the minimum length of time is reduced from an original minimum length of time based on detected movement of the user toward an edge of a video frame. ### Claim 19 (depends on 12) The method of claim 12, wherein the minimum length of time is automatically increased when the confidence level indicates a low predictive accuracy of the one or more engagement indicators and wherein the minimum length of time is automatically decreased when the confidence level indicates a high predictive accuracy of the one or more engagement. ### Claim 20 An apparatus, comprising: one or more network interfaces to communicate with a network; a processor coupled to the one or more network interfaces and configured to execute one or more processes; and a memory configured to store a process that is executable by the processor, the process, when executed, configured to: analyze real-time video of a user participating on a video conference; determine, based on analyzing, a level of engagement of the user to the video conference; determine a confidence level in an accuracy of the level of engagement based on one or more engagement indicators; detect that the level of engagement of the user to the video conference is below a given threshold of engagement for a minimum length of time, wherein the minimum length of time is automatically adjusted based on the confidence level in the level of engagement; and enact one or more video conference privacy measures for the user within the video conference in response to the level of engagement being below the given threshold of engagement for the minimum length of time.