# US 11,443,560 B1 · View layout configuration for increasing eye contact in video communications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,443,560 B1
- Document ID: US11443560B1
- Status: Granted
- Kind: B1
- Application number: 17/343,727
- Filed: 2021-06-09
- Granted: 2022-09-13
- Earliest claimed: 2021-06-09
- Applicants: Zoom Video Communications, Inc.
- Inventors: Gregory Wright
- Web page: https://patentgrep.com/patent/US11443560B1

## CPC

- G06V 40/67: {by interactive indications to the user}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0485: Scrolling or panning
- G06F 3/0486: Drag-and-drop
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 20/00: Scenes; Scene-specific elements (control of digital cameras H04N23/60)
- G06V 40/166: {using acquisition arrangements}
- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- H04N 7/15: Conference systems
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for providing an active pane within a communication platform. The system displays video of a video conference with one or more participants. A view menu is configured to receive selection of a view layout. Selection of an active pane view may be received via the view menu. The system may display a draggable active pane. A drag input from the user is received to move the active pane to a new location on screen near a camera capturing video of the user in the video conference. The system displays the active pane on the screen at the new location near the camera.

## Claims

### Claim 1

A communication system comprising one or more processors configured to perform the operations of:
displaying a view menu, the view menu configured to receive a selection of a view layout, wherein the view layouts include a speaker view, a gallery view, and an active pane view;
receiving, via the view menu, a selection of the active pane view;
in response to receiving the selection of the active pane view, displaying a draggable active pane, wherein the active pane automatically switches between displaying video conference participants based on which video conference participant is speaking and the dimensions of the active pane are smaller than full screen;
receiving a drag input from a user on the active pane and moving the active pane to a new location on the screen, the new location being near a camera capturing video of the user in the video conference; and
displaying the active pane on the screen at the new location near the camera.

### Claim 2 (depends on 1)

The system of claim 1, wherein the processors are further configured to perform the operations of:
accessing system data to gather information about a device model of the computer system;
accessing a database storing information about built-in camera physical locations for a plurality of device models to retrieve a built-in camera physical location for the device model of the computer system; and
converting from the built-in camera physical location for the device model of the computer system to screen coordinates to generate screen coordinates on the computer system near the built-in camera physical location; and
displaying the active pane at the screen coordinates on the computer system near the built-in camera physical location.

### Claim 3 (depends on 1)

The system of claim 1, wherein the processors are further configured to perform the operations of:
analyzing the captured video of the user in the video conference from the camera to detect one or more perspective lines;
determining a physical location of the camera capturing video of the user in the video conference based on the one or more perspective lines;
converting from the physical location of the camera to screen coordinates to generate screen coordinates on the computer system near the physical location of the camera; and
displaying the active pane at the screen coordinates on the computer system near the physical location of the camera.

### Claim 4 (depends on 1)

The system of claim 1, wherein the processors are further configured to perform the operations of:
analyzing the captured video of the user in the video conference from the camera to detect a face and a facing direction of the face;
determining whether the face is looking at the camera, and, when the face is not looking at the camera, determining an angle to rotate the face to look at the camera;
generating screen coordinates on the computer system that, when viewed by the user, rotate the face to look at the camera; and
displaying the active pane at the screen coordinates on the computer system that, when viewed by the user, rotate the face to look at the camera.

### Claim 5 (depends on 1)

The system of claim 1, wherein the processors are further configured to perform the operations of:
determining a boundary about a first video conference participant in a set of video frames, wherein the boundary has an interior portion and an exterior portion;
generating, for display on one or more devices, a filtered video depicting the interior portion depicting imagery of the first video conference participant overlaid on a transparent or translucent background; and
displaying in the active pane the filtered video of the first video conference participant.

### Claim 6 (depends on 5)

The system of claim 5, wherein the processors are further configured to perform the operations of:
displaying an opacity control setting for adjusting the opacity of the background on which the first video conference participant is overlaid; and
receiving an input opacity from the opacity control setting and adjusting the opacity of the background on which the first video conference participant is overlaid according to the input opacity.

### Claim 7 (depends on 5)

The system of claim 5, wherein the processors are further configured to perform the operations of:
displaying shared content behind the active pane, the shared content comprising a view of content shared by one of the video conference participants; and
wherein the shared content is visible on the screen through the transparent or translucent background on which the first video conference participant is overlaid.

### Claim 8

A computer-implemented method for providing an active pane within a communication platform, comprising:
displaying a view menu, the view menu configured to receive a selection of a view layout, wherein the view layouts include a speaker view, a gallery view, and an active pane view;
receiving, via the view menu, a selection of the active pane view;
in response to receiving the selection of the active pane view, displaying a draggable active pane, wherein the active pane automatically switches between displaying video conference participants based on which video conference participant is speaking and the dimensions of the active pane are smaller than full screen;
receiving a drag input from a user on the active pane and moving the active pane to a new location on the screen, the new location being near a camera capturing video of the user in the video conference; and
displaying the active pane on the screen at the new location near the camera.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
accessing system data to gather information about a device model of the computer system;
accessing a database storing information about built-in camera physical locations for a plurality of device models to retrieve a built-in camera physical location for the device model of the computer system;
converting from the built-in camera physical location for the device model of the computer system to screen coordinates to generate screen coordinates on the computer system near the built-in camera physical location; and
displaying the active pane at the screen coordinates on the computer system near the built-in camera physical location.

### Claim 10 (depends on 8)

The method of claim 8, further comprising:
analyzing the captured video of the user in the video conference from the camera to detect one or more perspective lines;
determining a physical location of the camera capturing video of the user in the video conference based on the one or more perspective lines;
converting from the physical location of the camera to screen coordinates to generate screen coordinates on the computer system near the physical location of the camera; and
displaying the active pane at the screen coordinates on the computer system near the physical location of the camera.

### Claim 11 (depends on 8)

The method of claim 8, further comprising:
analyzing the captured video of the user in the video conference from the camera to detect a face and a facing direction of the face;
determining whether the face is looking at the camera, and, when the face is not looking at the camera, determining an angle to rotate the face to look at the camera;
generating screen coordinates on the computer system that, when viewed by the user, rotate the face to look at the camera; and
displaying the active pane at the screen coordinates on the computer system that, when viewed by the user, rotate the face to look at the camera.

### Claim 12 (depends on 8)

The method of claim 8, further comprising:
determining a boundary about a first video conference participant in a set of video frames, wherein the boundary has an interior portion and an exterior portion;
generating, for display on one or more devices, a filtered video depicting the interior portion depicting imagery of the first video conference participant overlaid on a transparent or translucent background; and
displaying in the active pane the filtered video of the first video conference participant.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
displaying an opacity control setting for adjusting the opacity of the background on which the first video conference participant is overlaid; and
receiving an input opacity from the opacity control setting and adjusting the opacity of the background on which the first video conference participant is overlaid according to the input opacity.

### Claim 14 (depends on 12)

The method of claim 12, further comprising:
displaying shared content behind the active pane, the shared content comprising a view of content shared by one of the video conference participants;
wherein the shared content is visible on the screen through the transparent or translucent background on which the first video conference participant is overlaid.

### Claim 15

A non-transitory computer storage medium that stores executable program instructions that when executed by one or more computing devices, configures the one or more computing devices to perform operations comprising:
displaying a view menu, the view menu configured to receive a selection of a view layout, wherein the view layouts include a speaker view, a gallery view, and an active pane view;
receiving, via the view menu, a selection of the active pane view;
in response to receiving the selection of the active pane view, displaying a draggable active pane, wherein the active pane automatically switches between displaying video conference participants based on which video conference participant is speaking and the dimensions of the active pane are smaller than full screen;
receiving a user input from a user on the active pane and displaying a visual indicator at the location of the user input that the active pane is draggable;
receiving a drag input from a user on the active pane and moving the active pane to a new location on the screen, the new location being near a camera capturing video of the user in the video conference; and
displaying the active pane on the screen at the new location near the camera.

### Claim 16 (depends on 15)

The non-transitory computer storage medium of claim 15, the operations further comprising:
accessing system data to gather information about a device model of the computer system;
accessing a database storing information about built-in camera physical locations for a plurality of device models to retrieve a built-in camera physical location for the device model of the computer system;
converting from the built-in camera physical location for the device model of the computer system to screen coordinates to generate screen coordinates on the computer system near the built-in camera physical location; and
displaying the active pane at the screen coordinates on the computer system near the built-in camera physical location.

### Claim 17 (depends on 15)

The non-transitory computer storage medium of claim 15, the operations further comprising:
analyzing the captured video of the user in the video conference from the camera to detect one or more perspective lines;
determining a physical location of the camera capturing video of the user in the video conference based on the one or more perspective lines;
converting from the physical location of the camera to screen coordinates to generate screen coordinates on the computer system near the physical location of the camera; and
displaying the active pane at the screen coordinates on the computer system near the physical location of the camera.

### Claim 18 (depends on 15)

The non-transitory computer storage medium of claim 15, the operations further comprising:
analyzing the captured video of the user in the video conference from the camera to detect a face and a facing direction of the face;
determining whether the face is looking at the camera, and, when the face is not looking at the camera, determining an angle to rotate the face to look at the camera;
generating screen coordinates on the computer system that, when viewed by the user, rotate the face to look at the camera; and
displaying the active pane at the screen coordinates on the computer system that, when viewed by the user, rotate the face to look at the camera.

### Claim 19 (depends on 15)

The non-transitory computer storage medium of claim 15, the operations further comprising:
determining a boundary about a first video conference participant in a set of video frames, wherein the boundary has an interior portion and an exterior portion;
generating, for display on one or more devices, a filtered video depicting the interior portion depicting imagery of the first video conference participant overlaid on a transparent or translucent background;
displaying in the active pane the filtered video of the first video conference participant.

### Claim 20 (depends on 19)

The non-transitory computer storage medium of claim 19, the operations further comprising:
displaying an opacity control setting for adjusting the opacity of the background on which the first video conference participant is overlaid;
receiving an input opacity from the opacity control setting and adjusting the opacity of the background on which the first video conference participant is overlaid according to the input opacity.

### Claim 21 (depends on 19)

The non-transitory computer storage medium of claim 19, the operations further comprising:
displaying shared content behind the active pane, the shared content comprising a view of content shared by one of the video conference participants;
wherein the shared content is visible on the screen through the transparent or translucent background on which the first video conference participant is overlaid.