# US 2022/0092143 A1 · Device Augmentation Of Real Time Communications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0092143 A1
- Document ID: US20220092143A1
- Status: Published application
- Kind: A1
- Application number: 17/544,185
- Filed: 2021-12-07
- Published: 2022-03-24
- Earliest claimed: 2019-01-07
- Assignees: Citrix Systems, Inc.
- Applicants: Citrix Systems, Inc.
- Inventors: Santhosh Kumar Bejjanki; Sergii Shkrabak; Thomas John Sampieri; Dmytro Bozhko
- Web page: https://patentgrep.com/patent/US20220092143A1

## CPC

- G06F 16/9554: {by using bar codes}
- H04L 12/1827: {Network arrangements for conference optimisation or adaptation}
- G06K 19/06028: {using bar codes}
- G06K 19/06112: {the marking being simulated using a light source, e.g. a barcode shown on a display or a laser beam with time-varying intensity profile}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 7/15: Conference systems
- H04L 12/1818: {Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties}
- H04N 2007/145: {Handheld terminals}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and systems for augmenting communications using input data from mobile devices are described herein. A computing device may establish a connection with a mobile device having one or more input devices. The computing device may display a barcode that, when scanned by a mobile device, causes the mobile device to access a web page. The web page may be configured to cause the mobile device to transmit, e.g., via a web browser executing on the mobile device and to the computing device, input data from the input devices. The input data may be used by the computing device to replicate a physical input device connected to the computing device. The computing device may transmit the input data to a different computing device.

## Claims

### Claim 1

A computer-implemented method comprising:
establishing, by a mobile device and with a computing device, a connection in which to provide a session between the computing device and another computing device; and
providing, via the connection, data in a fashion as so to replicate connection of a physical input device at the computing device.

### Claim 2 (depends on 1)

The method of claim 1, wherein establishing the connection comprises:
capturing, via the mobile device, content of a display; and
processing the content to determine a Uniform Resource Locator (URL) associated with the computing device.

### Claim 3 (depends on 1)

The method of claim 1, wherein establishing the connection comprises:
accessing, via the mobile device, a web page configured to permit transmission of the data from the mobile device to the computing device.

### Claim 4 (depends on 3)

The method of claim 3, wherein accessing the web page comprises:
capturing, via a camera of the mobile device, a barcode; and
processing the barcode to determine a URL corresponding to the web page.

### Claim 5 (depends on 1)

The method of claim 1, wherein the data comprises one or more of:
video data captured via a camera of the mobile device, or
audio data captured via a microphone of the mobile device.

### Claim 6 (depends on 1)

The method of claim 1, wherein the data comprises one or more of:
touch input data captured via a touchscreen of the mobile device, or
motion data captured via an accelerometer of the mobile device.

### Claim 7 (depends on 1)

The method of claim 1, wherein providing the data comprises providing the data via a WebRTC protocol.

### Claim 8

A mobile device comprising:
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the mobile device to:
establish, with a computing device, a connection in which to provide a session between the computing device and another computing device; and
provide, via the connection, data in a fashion as so to replicate connection of a physical input device at the computing device.

### Claim 9 (depends on 8)

The mobile device of claim 8, wherein the instructions, when executed by the one or more processors, cause the mobile device to establish the connection by causing the mobile device to:
capture, via the mobile device, content of a display; and
process the content to determine a Uniform Resource Locator (URL) associated with the computing device.

### Claim 10 (depends on 8)

The mobile device of claim 8, wherein the instructions, when executed by the one or more processors, cause the mobile device to establish the connection by causing the mobile device to:
access, via the mobile device, a web page configured to permit transmission of the data from the mobile device to the computing device.

### Claim 11 (depends on 10)

The mobile device of claim 10, wherein the instructions, when executed by the one or more processors, cause the mobile device to access the web page by causing the mobile device to:
capture, via a camera of the mobile device, a barcode; and
process the barcode to determine a URL corresponding to the web page.

### Claim 12 (depends on 8)

The mobile device of claim 8, wherein the data comprises one or more of:
video data captured via a camera of the mobile device, or
audio data captured via a microphone of the mobile device.

### Claim 13 (depends on 8)

The mobile device of claim 8, wherein the data comprises one or more of:
touch input data captured via a touchscreen of the mobile device, or
motion data captured via an accelerometer of the mobile device.

### Claim 14 (depends on 8)

The mobile device of claim 8, wherein the instructions, when executed by the one or more processors, cause the mobile device to provide the data by causing the mobile device to provide the data via a WebRTC protocol.

### Claim 15

A computer-implemented method comprising:
receiving, data from a plurality of mobile devices;
replicating, based on the received data, a physical input device connected to a computing device; and
providing communications between the computing device and one of the plurality with use of the replicated physical input device.

### Claim 16 (depends on 15)

The method of claim 15, wherein receiving the data comprises:
causing display of a barcode indicative of a web page; and
receiving, via the web page, the data.

### Claim 17 (depends on 16)

The method of claim 16, wherein the barcode comprises a Uniform Resource Locator (URL) of the web page.

### Claim 18 (depends on 15)

The method of claim 15, further comprising:
outputting, by the computing device, the received data via one or more other devices connected to the computing device.

### Claim 19 (depends on 15)

The method of claim 15, wherein receiving the data comprises:
receiving, via a web browser executing on one of the plurality, a portion of the data.

### Claim 20 (depends on 15)

The method of claim 15, wherein the physical input device comprises one or more of:
a camera,
a microphone, or
an accelerometer.
