# US 2020/0348899 A1 · Artificial intelligence (ai) enabled multi-screen visual cue relay systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0348899 A1
- Document ID: US20200348899A1
- Status: Published application
- Kind: A1
- Application number: 16/398,395
- Filed: 2019-04-30
- Published: 2020-11-05
- Earliest claimed: 2019-04-30
- Applicants: NEC Laboratories Europe GmbH
- Inventors: Ammar Shaker; Mischa Schmidt
- Web page: https://patentgrep.com/patent/US20200348899A1

## CPC

- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- H04N 21/4122: {additional display device, e.g. video projector (digital output for controlling a plurality of local displays G06F3/1423)}
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- H04N 21/485: End-user interface for client configuration
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods for simultaneously displaying an external visual cue received at a primary display device on one or more secondary display devices in a distributed presentation system. The method includes displaying original content on a primary display device, detecting an external visual cue on the displayed original content, determining one or more parameters of the external visual cue, the one or more parameters including at least a location of the external visual cue relative to, or on, the displayed original content, and communicating the one or more parameters to one or more secondary display devices that are displaying the original content, to enable the one or more secondary display devices to display a representation of the external visual cue simultaneously with displaying the original content.

## Claims

### Claim 1

A method for simultaneously displaying an external visual cue received at a primary display device on one or more secondary display devices in a distributed presentation system, the method comprising:
displaying original content on a primary display device;
detecting an external visual cue on the displayed original content using an external camera paired with the primary display device and configured to image the original content displayed on the primary display device;
determining one or more parameters of the external visual cue, the one or more parameters including at least a location of the external visual cue relative to the original content displayed on the primary display device; and
communicating the one or more parameters to one or more secondary display devices that are displaying the original content, to enable the one or more secondary display devices to display a representation of the external visual cue simultaneously with displaying the original content.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the one or more parameters further including one or more of a color of the external visual cue and a shape of the external visual cue.

### Claim 3 (depends on 1)

The method according to claim 1, wherein at least one of the one or more secondary display devices is located in a location remote from the primary display device

### Claim 4 (depends on 3)

The method according to claim 3, wherein the communicating includes communicating the one or more parameters to the at least one secondary device over the Internet or a wireless network.

### Claim 5 (depends on 1)

The method according to claim 1, further including communicating a cue identifier with the one or more parameters, wherein the cue identifier identifies the primary display device on which the external visual cue was detected.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the detecting includes detecting a first appearance of the external visual cue and detecting movements of the external visual cue on the displayed original content.

### Claim 7

(canceled)

### Claim 8 (depends on 1)

The method according to claim 1, wherein the detecting includes:
acquiring, from the external camera, an image of a display screen of the primary display device, wherein the external visual cue is overlaying the displayed original content on the display screen; and
comparing the acquired image with the original content to identify the external visual cue.

### Claim 9 (depends on 8)

The method according to claim 8, further including:
receiving one or more parameters of a second external visual cue from one of the one or more secondary display devices, the one or more parameters of the second external visual cue including at least a location of the second external visual cue relative to the displayed original content; and
displaying a representation of the second external visual cue over the original content displayed by the primary display device.

### Claim 10

A visual cue detection and characterization component in a distributed presentation system that includes a primary display device that displays original content from a content source, an external camera paired with the primary display device and configured to acquire an image of the original content displayed on the primary display device, and one or more secondary display devices, each of the one or more secondary display devices displaying the original content, wherein the visual cue detection and characterization component includes one or more processors and a transceiver, wherein the visual cue detection and characterization component is configured to:
receive, using the transceiver, the image of the original content from the external camera;
process, using the one or more processors, the image of the original content to detect an external visual cue on the original content displayed on the primary display device and determine one or more parameters of the external visual cue, the one or more parameters including at least a location of the external visual cue relative to the original content displayed on the primary display device; and
communicate, using the transceiver, the one or more parameters to the one or more secondary display devices that are displaying the original content, to enable the one or more secondary display devices to display a representation of the external visual cue simultaneously with displaying the original content.

### Claim 11 (depends on 10)

The detection and characterization component of claim 10,
wherein the one or more processors detect an external visual cue by comparing the image with the original content to identify the external visual cue, wherein the external visual cue is overlaying the original content displayed on the display screen.

### Claim 12 (depends on 10)

The detection and characterization component of claim 10, wherein the external visual cue is overlaying the original content displayed on the display screen.

### Claim 13

A non-transitory, computer-readable medium having instructions stored thereon which, after execution by one or more processors, provide for execution of a method comprising:
displaying original content on a primary display device;
detecting an external visual cue on the displayed original content using an external camera paired with the primary display device and configured to image the original content displayed on the primary display device;
determining one or more parameters of the external visual cue, the one or more parameters including at least a location of the external visual cue relative to the original content displayed on the primary display device; and
communicating the one or more parameters to one or more secondary display devices that are displaying the original content, to enable the one or more secondary display devices to display a representation of the external visual cue simultaneously with displaying the original content.

### Claim 14 (depends on 13)

The non-transitory, computer-readable medium according to claim 13, wherein the external visual cue is overlaying the displayed original content on the display screen.

### Claim 15 (depends on 13)

The non-transitory, computer-readable medium according to claim 13, wherein the detecting includes:
acquiring an image of a display screen of the primary display device, wherein the external visual cue is overlaying the displayed original content on the display screen; and
comparing the acquired image with the original content to identify the external visual cue.
