# US 2017/0319957 A1 · Method and device for interaction of a client terminal with an application executed by a piece of equipment, and terminal using same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0319957 A1
- Document ID: US20170319957A1
- Status: Published application
- Kind: A1
- Application number: 15/529,457
- Filed: 2015-11-24
- Published: 2017-11-09
- Earliest claimed: 2014-11-27
- Assignees: Orange
- Applicants: Orange
- Inventors: Maximilien Baumann; Sandrine Lacharme
- Web page: https://patentgrep.com/patent/US20170319957A1

## CPC

- A63F 13/355: Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
- A63F 13/52: involving aspects of the displayed game scene
- G06F 9/452: {Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131)}
- H04L 67/303: Terminal profiles
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)}
- H04N 21/8173: {End-user applications, e.g. Web browser, game}
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The invention concerns a method of interaction with an application executed by a piece of equipment separate from a client terminal implementing the method of interaction. In particular, the method of interaction is a method for interaction of a client terminal with an application executed remotely. The application executed remotely is, in particular, a video game broadcast using, for example, a WebRTC communication protocol. One piece of subject matter of the invention is a method of interaction with an application, executed by a piece of equipment, providing a video stream displayed by a client terminal separate from the piece of equipment, the method of interaction comprising a transmission of a piece of position information suitable as an interaction position input parameter of the application, the suitable position information being dependent: —on a client position of a positional interface relative to an image of the video stream, —and proportional to the ratio between a resolution of the piece of equipment and a suitable client resolution. Therefore, interaction errors during the remote execution of an application are avoided, while limiting the network load and calculation costs, and maintaining the real-time character.

## Claims

### Claim 1

A method for interaction with an application, executed by a piece of equipment, supplying a video stream displayed by a client terminal distinct from the equipment, the method of interaction comprising the transmission of appropriate position information as an interaction position input parameter for the application, the appropriate position information being dependent:
on a client position of a positional interface with respect to an image of the video stream,
and proportional to the ratio between a resolution of the equipment and an appropriate client resolution.

### Claim 2 (depends on 1)

The method of interaction as claimed in claim 1, characterized in that the method comprises an adaptation of the client position of the positional interface in proportion to the ratio between the resolution of the equipment and the appropriate client resolution.

### Claim 3 (depends on 1)

The method of interaction as claimed in claim 1, characterized in that the method of interaction comprises an acquisition of the appropriate client resolution, the appropriate client resolution being used by the client terminal as display video marker.

### Claim 4 (depends on 1)

The method of interaction as claimed in claim 1, characterized in that the appropriate client resolution is a function of an equipment resolution, the equipment resolution being a resolution of a piece of equipment executing the application and supplying a resulting video stream, of a size of a display window of the video stream and of a precision parameter, the appropriate client resolution having the same relationship as the equipment resolution to the size of the display window in which the video stream is displayed by a terminal.

### Claim 5 (depends on 1)

The method of interaction as claimed in claim 1, characterized in that each dimension of the appropriate position is equal to a corresponding dimension of the client position multiplied by the corresponding dimension of the equipment resolution multiplied by 1, from which the equipment resolution divided by the appropriate client resolution has been subtracted.

### Claim 6 (depends on 1)

The method of interaction as claimed in claim 1, characterized in that the appropriate position information is a function of the position of a client display window relative to a screen of a client terminal displaying the client display window.

### Claim 7 (depends on 6)

The method of interaction as claimed in claim 6, characterized in that each dimension of the appropriate position is shifted positively as a function of a corresponding dimension the position of the client display window multiplied by a corresponding dimension of the client position multiplied by the corresponding dimension of the equipment resolution divided by the appropriate client resolution.

### Claim 8 (depends on 1)

The method of interaction as claimed in claim 1, characterized in that the image supplied by the execution of the application is supplied within a video stream broadcast in a real-time Web communication session.

### Claim 9 (depends on 1)

The method of interaction as claimed in claim 1, characterized in that the method of interaction is implemented locally, when the application is executed remotely.

### Claim 10

A program comprising program code instructions for the execution of steps of a method of interaction when said program is executed by a processor, the method for interaction with an application, executed by a piece of equipment, supplying a video stream displayed by a client terminal distinct from the equipment, the method of interaction comprising the transmission of appropriate position information as an interaction position input parameter for the application, the appropriate position information being dependent:
on a client position of a positional interface with respect to an image of the video stream,
and proportional to the ratio between a resolution of the equipment and an appropriate client resolution.

### Claim 11

A device for interaction of a client terminal with a piece of equipment executing an application and supplying a video stream displayed by the client terminal distinct from the equipment, the interaction device comprising a transmitter, to the equipment, of appropriate position information as interaction position input parameter for the application, the appropriate position information being dependent:
on a client position of a positional interface with respect to an image of the video stream,
and proportional to the ratio between a resolution of the equipment and an appropriate client resolution.

### Claim 12

A client terminal comprising:
a screen designed to display, in a display window, a video stream supplied by a piece of equipment executing an application, and supplying a video stream displayed by the client terminal distinct from the equipment,
a user interface allowing a positional interface to be moved over the screen relative to an image of the video stream,
a device for interaction of the client terminal with the equipment, comprising a transmitter, to the equipment, of appropriate position information as interaction position input parameter for the application, the appropriate position information being dependent:
on a client position of a positional interface with respect to an image of the video stream,
and proportional to the ratio between a resolution of the equipment and an appropriate client resolution.
