# US 11,908,246 B2 · View layout configuration for increasing eye contact in video communications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,908,246 B2
- Document ID: US11908246B2
- Status: Granted
- Kind: B2
- Application number: 17/852,352
- Filed: 2022-06-28
- Published: 2022-12-15
- Granted: 2024-02-20
- Earliest claimed: 2021-06-09
- Assignees: Zoom Video Communications, Inc.
- Applicants: Zoom Video Communications, Inc.
- Inventors: Gregory Wright
- Web page: https://patentgrep.com/patent/US11908246B2

## CPC

- G06V 40/67: {by interactive indications to the user}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0485: Scrolling or panning
- G06F 3/0486: Drag-and-drop
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 20/00: Scenes; Scene-specific elements (control of digital cameras H04N23/60)
- G06V 40/166: {using acquisition arrangements}
- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- H04N 7/15: Conference systems
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for providing an active pane within a communication platform. The system displays video of a video conference with one or more participants. A view menu is configured to receive selection of a view layout. Selection of an active pane view may be received via the view menu. The system may display a draggable active pane. A drag input from the user is received to move the active pane to a new location on screen near a camera capturing video of the user in the video conference. The system displays the active pane on the screen at the new location near the camera.

## Claims

### Claim 1

A computer-implemented method for providing an active pane within a communication platform, comprising:
determining a location of a camera of a computer system;
determining screen coordinates for a screen location in proximity to the location of the camera of the computer system;
displaying the active pane at the screen coordinates of a display of the computer system; and
automatically switching and displaying in the active pane one of multiple video conference participants based on which of the multiple video conference participants is speaking.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein determining the location of the camera of the computer system comprises:
accessing system data to gather information about a device model of the computer system;
accessing a database storing information about built-in camera physical locations for a plurality of device models to retrieve a built-in camera physical location for the device model of the computer system; and
converting from the built-in camera physical location for the device model of the computer system to the screen coordinates.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein determining the location of the camera of the computer system comprises:
analyzing captured video of a video conference participant from the camera to detect one or more perspective lines;
determining a physical location of the camera capturing video of the video conference participant based on the one or more perspective lines; and
converting from the physical location of the camera to the screen coordinates.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising:
analyzing captured video of a first video conference participant from the camera to detect a face and a facing direction of the face;
determining whether the face is looking at the camera, and, when the face is not looking at the camera, determining an angle to rotate the face to look at the camera; and
generating a video stream for sending to another video participant, such that the face of the first video conference participant is rotated to look at the camera.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining a boundary about a first video conference participant in a set of video frames, wherein the boundary has an interior portion and an exterior portion;
generating, for display on one or more devices, a filtered video depicting the interior portion depicting imagery of the first video conference participant overlaid on a transparent or translucent background; and
displaying in the active pane the filtered video of the first video conference participant.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, further comprising:
displaying an opacity control setting for adjusting the opacity of the background on which the first video conference participant is overlaid; and
receiving an input opacity from the opacity control setting and adjusting the opacity of the background on which the first video conference participant is overlaid according to the input opacity.

### Claim 7 (depends on 5)

The computer-implemented method of claim 5, further comprising:
displaying shared content behind the active pane, the shared content comprising a view of content shared by one of the video conference participants; and
wherein the shared content is visible on the display through the transparent or translucent background on which the first video conference participant is overlaid.

### Claim 8

Non-transitory computer storage that stores executable program instructions that, when executed by one or more computing devices, configure the one or more computing devices to perform operations comprising:
determining a location of a camera of a computer system;
determining screen coordinates for a screen location in proximity to the location of the camera of the computer system;
displaying an active pane at the screen coordinates of a display of the computer system; and
automatically switching and displaying in the active pane one of multiple video conference participants based on which of the multiple video conference participants is speaking.

### Claim 9 (depends on 8)

The non-transitory computer storage of claim 8, wherein determining the location of the camera of the computer system comprises:
accessing system data to gather information about a device model of the computer system;
accessing a database storing information about built-in camera physical locations for a plurality of device models to retrieve a built-in camera physical location for the device model of the computer system; and
converting from the built-in camera physical location for the device model of the computer system to the screen coordinates.

### Claim 10 (depends on 8)

The non-transitory computer storage of claim 8, wherein determining the location of the camera of the computer system comprises:
analyzing captured video of a video conference participant from the camera to detect one or more perspective lines;
determining a physical location of the camera capturing video of the video conference participant based on the one or more perspective lines; and
converting from the physical location of the camera to the screen coordinates.

### Claim 11 (depends on 8)

The non-transitory computer storage of claim 8, further comprising:
analyzing captured video of a first video conference participant from the camera to detect a face and a facing direction of the face;
determining whether the face is looking at the camera, and, when the face is not looking at the camera, determining an angle to rotate the face to look at the camera; and
generating a video stream for sending to another video participant, such that the face of the first video conference participant is rotated to look at the camera.

### Claim 12 (depends on 8)

The non-transitory computer storage of claim 8, further comprising the operations of:
determining a boundary about a first video conference participant in a set of video frames, wherein the boundary has an interior portion and an exterior portion;
generating, for display on one or more devices, a filtered video depicting the interior portion depicting imagery of the first video conference participant overlaid on a transparent or translucent background; and
displaying in the active pane the filtered video of the first video conference participant.

### Claim 13 (depends on 12)

The non-transitory computer storage of claim 12, further comprising the operations of:
displaying an opacity control setting for adjusting the opacity of the background on which the first video conference participant is overlaid; and
receiving an input opacity from the opacity control setting and adjusting the opacity of the background on which the first video conference participant is overlaid according to the input opacity.

### Claim 14 (depends on 12)

The non-transitory computer storage of claim 12, further comprising the operations of:
displaying shared content behind the active pane, the shared content comprising a view of content shared by one of the video conference participants; and
wherein the shared content is visible on the display through the transparent or translucent background on which the first video conference participant is overlaid.

### Claim 15

A system comprising one or more processors configured to perform operations comprising:
determining a location of a camera of a computer system;
determining screen coordinates for a screen location in proximity to the location of the camera of the computer system;
displaying an active pane at the screen coordinates of a display of the computer system; and
automatically switching and displaying in the active pane one of multiple video conference participants based on which of the multiple video conference participants is speaking.

### Claim 16 (depends on 15)

The system of claim 15, wherein determining the location of the camera of the computer system comprises:
accessing system data to gather information about a device model of the computer system;
accessing a database storing information about built-in camera physical locations for a plurality of device models to retrieve a built-in camera physical location for the device model of the computer system; and
converting from the built-in camera physical location for the device model of the computer system to the screen coordinates.

### Claim 17 (depends on 15)

The system of claim 15, wherein determining the location of the camera of the computer system comprises:
analyzing captured video of a video conference participant from the camera to detect one or more perspective lines;
determining a physical location of the camera capturing video of the video conference participant based on the one or more perspective lines; and
converting from the physical location of the camera to the screen coordinates.

### Claim 18 (depends on 15)

The system of claim 15, further comprising:
analyzing captured video of a first video conference participant from the camera to detect a face and a facing direction of the face;
determining whether the face is looking at the camera, and, when the face is not looking at the camera, determining an angle to rotate the face to look at the camera; and
generating a video stream for sending to another video participant, such that the face of the first video conference participant is rotated to look at the camera.

### Claim 19 (depends on 15)

The system of claim 15, further comprising the operations of:
determining a boundary about a first video conference participant in a set of video frames, wherein the boundary has an interior portion and an exterior portion;
generating, for display on one or more devices, a filtered video depicting the interior portion depicting imagery of the first video conference participant overlaid on a transparent or translucent background; and
displaying in the active pane the filtered video of the first video conference participant.

### Claim 20 (depends on 19)

The system of claim 19, further comprising the operations of:
displaying an opacity control setting for adjusting the opacity of the background on which the first video conference participant is overlaid; and
receiving an input opacity from the opacity control setting and adjusting the opacity of the background on which the first video conference participant is overlaid according to the input opacity.
