# US 2021/0240427 A1 · Selection of Remote Objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0240427 A1
- Document ID: US20210240427A1
- Status: Published application
- Kind: A1
- Application number: 17/165,466
- Filed: 2021-02-02
- Published: 2021-08-05
- Earliest claimed: 2020-02-03
- Assignees: Evolution Malta Limited
- Applicants: Evolution Malta Limited
- Inventors: Jevgeni Geimanen
- Web page: https://patentgrep.com/patent/US20210240427A1

## CPC

- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- A63F 13/355: Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
- A63F 13/537: using indicators, e.g. showing the condition of a game character on screen
- A63F 13/837: Shooting of targets
- G06F 3/04162: {for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 5/775: between a recording apparatus and a television receiver
- A63F 2300/538: for performing operations on behalf of the game client, e.g. rendering
- A63F 2300/6045: for mapping control signals received from the input arrangement into game commands
- A63F 2300/8076: Shooting
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method, system, and device for selecting an object on a remote display. The method comprises a user electronic device having a user display, and a user input device providing user input coordinates and events. The method comprises displaying a video stream of the remote display in a remote display window on the user display, detecting a user interface input coordinate, displaying a user selection affordance comprising a focus area overlaid over the video stream, obtaining a position of the focus area in relation to the video stream area, displaying a virtual rendering of the remote display corresponding to the area under the focus area, receiving a user selection event, determining the current location of the focus area in relation to the video stream; and if an object is located at the current location of the focus area, selecting the object displayed at the current location of the video stream.

## Claims

### Claim 1

A method for selecting objects displayed on a remote display, comprising:
at a user electronic device having one or more processors, at least one memory, user display, and at least one user input device providing user input coordinates and events:
displaying a video stream of the remote display in a remote display window on the user display;
detecting a user interface input coordinate and if the user input coordinate is located in the remote display window, displaying a user selection affordance comprising a focus area overlaid over the video stream;
obtaining a position of the focus area in relation to the video stream area;
displaying in the focus area a virtual rendering of the remote display corresponding to the area under the focus area;
receiving a user selection event from the user input device;
determining the current location of the focus area in relation to the video stream; and
if an object is located at the current location of the focus area, selecting the object displayed at the current location of the video stream.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the focus area is depicted as a virtual sniper scope.

### Claim 3 (depends on 1)

The method according to claim 1, wherein only part of the remote display is displayed in the remote display window of the electronic device.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the video stream of the remote display can be panned and/or zoomed in the remote display window in the electronic device.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the focus area display an enlarged portion of the remote display corresponding to the location of the focus area.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the electronic device is arranged to display a video stream that has been obtained by recording the remote display using an external video recording device.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the objects are non-stationary in the video stream.

### Claim 8 (depends on 1)

The method according to claim 1, further comprising a step of presenting a reward when an object has been selected.

### Claim 9 (depends on 8)

The method according to claim 8, wherein presenting the reward comprise changing the symbol of the object.

### Claim 10 (depends on 1)

The method according to claim 1, further comprising receiving information about all objects on the remote screen from the server device.

### Claim 11 (depends on 10)

The method according to claim 10, wherein the information about all objects comprise at least one of position, type of object, and reward associated with the object.

### Claim 12 (depends on 1)

The method according to claim 1, further comprising steps in the user electronic device of analysing the video stream, determining image data related to the current position of the focus area, and creating the virtual rendering of the remote display corresponding to the area under the focus area.

### Claim 13 (depends on 1)

An electronic device comprising a display, at least one user input device, one or more processors, at least one memory, and one or more programs, wherein the one or more programs are stored in the memory to be executed by the one or more processors, the one or more programs including instruction sets for performing the method according to claim 1.

### Claim 14 (depends on 1)

A computer readable storage medium storing one or more programs, the one or more programs comprising instruction sets for performing the method according to claim 1.

### Claim 15 (depends on 1)

A system for selecting objects at a remote display using a user electronic device, the system comprising
a remote display presenting objects to be selected, the remote display located at a remote location from the user electronic device;
a camera recording a video stream of the remote display;
a server obtaining the video stream and providing the video stream to user electronic devices; and
a user electronic device comprising one or more processors, at least one memory, a communication interface, a display, and at least one user input device; and
wherein the processor of the user electronic device is arranged to operate instructions sets stored in the memory for displaying the video stream and detecting user input events from the at least one user input device, and further arranged to operate the method according to claim 1.
