# US 10,771,738 B2 · Methods and systems for multi-pane video communications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,771,738 B2
- Document ID: US10771738B2
- Status: Granted
- Kind: B2
- Application number: 16/115,037
- Filed: 2018-08-28
- Published: 2018-12-20
- Granted: 2020-09-08
- Earliest claimed: 2016-04-14
- Assignees: Popio IP Holdings, LLC
- Applicants: Alexander Mackenzie & Pranger
- Inventors: Eugene Patrick Pranger; Timothy Eugene Pranger; Robert Eric Roy
- Web page: https://patentgrep.com/patent/US10771738B2

## CPC

- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/1446: {display composed of modules, e.g. video walls}
- G06Q 20/042: {characterized in that the payment protocol involves at least one cheque}
- G06Q 20/3223: {Realising banking transactions through M-devices}
- G06Q 40/02: Banking, e.g. interest calculation or account maintenance (credit or loans G06Q40/03)
- H04L 65/1069: Session establishment or de-establishment
- H04N 5/265: Mixing
- H04N 7/08: Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band {, e.g. by time division (H04N7/007 takes precedence)}
- H04N 23/63: by using electronic viewfinders
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Systems and methods are disclosed for establishing a video connection between a mobile device and a support terminal while enabling the support terminal to concurrently push display elements to the mobile device through a separate connection. In particular, in one or more embodiments, the disclosed systems and methods establish a first connection between the support terminal and the mobile device and conduct a video chat between the devices transmitted through the first connection. The disclosed systems and methods enable the support terminal to push a display element to the mobile device through a second connection. In response to receiving the display element, the disclosed systems and methods divide the display screen of the mobile device into at least a first pane and a second pane, providing the video chat for display on the first pane and the display element for display on the second pane.

## Claims

### Claim 1

A method comprising:
establishing a first connection between a mobile device and a support terminal;
conducting a video chat between the mobile device and the support terminal transmitted through the first connection;
providing the video chat on a display screen of the mobile device;
receiving a remote storage location of a display element pushed through a second connection by the support terminal while providing the video chat on the display screen of the mobile device;
providing, on the display screen of the mobile device, a selectable option to accept the display element in response to receiving the remote storage location of the display element and during the video chat;
in response to receiving a user interaction with the selectable option to accept the display element and during the video chat, retrieving the display element from the remote storage location; and
based on retrieving the display element from the remote storage location:
providing the video chat in a first pane displayed on the display screen of the mobile device; and
providing the display element in a second pane displayed on the display screen of the mobile device concurrently while providing the video chat in the first pane.

### Claim 2 (depends on 1)

The method of claim 1, wherein establishing the first connection comprises sending a request for a video chat connection through a series of servers.

### Claim 3 (depends on 2)

The method of claim 2, further comprising establishing a peer-to-peer connection, after the request for the video chat connection is received, and maintaining the first connection on the peer-to-peer connection.

### Claim 4 (depends on 1)

The method of claim 1, further comprising modifying the display element upon detecting a user interaction with the display element while providing the video chat on the display screen of the mobile device, wherein providing and modifying the display element occurs independent of the video chat provided in the first pane.

### Claim 5 (depends on 4)

The method of claim 4, wherein the user interaction comprises one or more of:
entering input into a fillable form provided in the second pane;
capturing an image of a check for deposit;
sending a text-based message to the support terminal;
signing a document provided in the second pane; or
accepting or rejecting terms provided by the support terminal.

### Claim 6 (depends on 5)

The method of claim 5, wherein capturing the image of the check for deposit comprises:
overlaying the video chat provided in the first pane with a viewfinder mode that displays a representation of image data captured by a camera of the mobile device; and
capturing a frontside image of the check and a backside image of the check.

### Claim 7 (depends on 5)

The method of claim 5, further comprising sending a modified display element to a database repository through a third connection.

### Claim 8 (depends on 1)

The method of claim 1, further comprising modifying a size of the first pane and a size of the second pane based on the display element received.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
receiving the remote storage location of the display element comprises receiving a link to a location of the display element within a remote database.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
receiving a subsequent display element; and
providing the subsequent display element in the second pane as an overlay over a previous display element.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
receiving a trigger pushed through the second connection by the support terminal; and
executing code stored on the mobile device, in response to receiving the trigger, to split the display screen into the first pane and the second pane.

### Claim 12 (depends on 1)

The method of claim 1, wherein the display element comprises one or more of:
a computer-readable code that when scanned by a computing device causes the computing device to perform a predetermined action;
an informational video;
an informational document;
a signature pad;
a fillable form;
terms accompanied by an option to accept or reject the terms;
an interface for capturing and sending images of a check; or
a text-based messaging interface.

### Claim 13

A method comprising:
establishing a first connection between a support terminal and a mobile device;
providing, for display on a display screen of the mobile device, a video chat between the support terminal and the mobile device transmitted through the first connection;
selecting a display element from the support terminal while providing the video chat for display on the display screen of the mobile device; and
pushing a remote storage location of the display element to the mobile device through a Websocket server for retrieval of the display element from the remote storage location and concurrent display of the display element with the video chat on the display screen of the mobile device in response to a user selection of a selectable option displayed at the mobile device to accept the display element.

### Claim 14 (depends on 13)

The method of claim 13, further comprising pushing a trigger to the mobile device through the Websocket server, wherein the trigger initiates an execution of code stored on the mobile device to activate a capability of the mobile device.

### Claim 15 (depends on 13)

The method of claim 13, further comprising pushing a default display element to the mobile device immediately after establishing the first connection.

### Claim 16 (depends on 13)

The method of claim 13, further comprising receiving a signal through the Websocket server that a modified display element is stored in a database repository.

### Claim 17 (depends on 16)

The method of claim 16, further comprising accessing the database repository and retrieving the modified display element.

### Claim 18

A mobile device comprising:
a display screen;
at least one processor; and
at least one non-transitory computer-readable storage medium storing instructions that, when executed by the at least one processor causes the mobile device to;
establish a first connection between the mobile device and a support terminal;
conduct a video chat between the mobile device and the support terminal transmitted through the first connection;
provide the video chat on the display screen;
receive a remote storage location of a display element pushed through a second connection by the support terminal while providing the video chat on the display screen;
provide, on the display screen, a selectable option to accept the display element in response to receiving the remote storage location of the display element and during the video chat;
in response to receiving a user interaction with the selectable option to accept the display element and during the video chat, retrieve the display element from the remote storage location; and
based on retrieving the display element from the remote storage location:
provide the video chat in a first pane displayed on the display screen; and
provide the display element in a second pane displayed on the display screen concurrently while providing the video chat in the first pane.

### Claim 19 (depends on 1)

The method of claim 1,
further comprising dividing the display screen of the mobile device into the first pane and the second pane in response to receiving the remote storage location of the display element and during the video chat,
wherein providing the selectable option to accept the display element comprises providing the selectable option to accept the display element within the second pane concurrently while providing the video chat in the first pane.

### Claim 20 (depends on 1)

The method of claim 1, further comprising:
receiving a remote storage location of a subsequent display element;
providing, on the display screen of the mobile device, a first selectable option to accept the subsequent display element and a second selectable option to reject the subsequent display element in response to receiving the remote storage location of the subsequent display element and during the video chat; and
in response to receiving a user interaction with the second selectable option to reject the subsequent display element, merging the first pane and the second pane into a single pane displayed on the display screen of the mobile device.
