# US 2020/0401362 A1 · Screen sharing for display in vr

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401362 A1
- Document ID: US20200401362A1
- Status: Published application
- Kind: A1
- Application number: 16/624,255
- Filed: 2018-06-29
- Published: 2020-12-24
- Earliest claimed: 2017-06-29
- Assignees: Koninklijke KPN N.V.; Nederlandse Organisatie voor toegepast-natuurwetenschappelijk onderzoek TNO
- Applicants: Koninklijke KPN N.V.; Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek TNO
- Inventors: Martin Prins; Emmanuel Thomas; Hans Maarten Stokking; Hendrikus Nathaniël Hindriks
- Web page: https://patentgrep.com/patent/US20200401362A1

## CPC

- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G09G 5/005: {Adapting incoming signals to the display format of the display terminal}
- G06T 3/4092: Image resolution transcoding, e.g. by using client-server architectures
- G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen
- G09G 2320/08: Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal
- G09G 2340/04: Changes in size, position or resolution of an image
- G09G 2370/042: for monitor identification
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and methods for screen sharing are provided. The screen sharing may comprise providing image data from a sender system to a receiver system. The receiver system may be a Virtual Reality [VR] system configured to render the image data in a virtual environment by projecting the image data onto a virtual canvas. At the sender system, visual content may be identified which is to be shared with the receiver system. The rendering or display of the virtual environment by the receiver may impose legibility constraints on the visual content. Accordingly, an adjusted version of the visual content may be generated which provides improved legibility when viewed in the virtual environment. The image data representing the adjusted version of the visual content may then be provided to the receiver system. Accordingly, the legibility of the visual content shared by the sender system may be improved when rendered, displayed and subsequently viewed by a user in the virtual environment

## Claims

### Claim 1

A method of providing image data from a sender system to a receiver system for screen sharing, wherein the receiver system is a Virtual Reality [VR] system configured to render the image data in a virtual environment by projecting the image data onto a virtual canvas, the method comprising, at the sender system:
identifying visual content to be shared with the receiver system;
generating an adjusted version of the visual content which provides improved legibility when viewed in the virtual environment by adjusting a presentation of the visual content based on receiver metadata which is indicative of legibility constraints imposed by the rendering or display of the virtual environment; and
providing image data representing the adjusted version of the visual content to the receiver system.

### Claim 2 (depends on 1)

The method according to claim 1, further comprising:
based on the legibility constraints indicated by the receiver metadata, generating render metadata which indicates at least in part how the image data is to be rendered in the virtual environment; and
providing the render metadata to the receiver system.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the render metadata indicates at least one of:
a size of the virtual canvas in the virtual environment; and
a distance and/or orientation of the virtual canvas with respect to a viewpoint of a viewer in the virtual environment.

### Claim 4 (depends on 1)

The method according to claim 1, further comprising obtaining the receiver metadata from the receiver system, wherein the receiver metadata indicates one or more characteristics of the rendering or display of the virtual environment by the receiver system.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the one or more characteristics comprise at least one of:
a type of display on which the virtual environment is displayed;
a resolution of the display;
a field of view of the display;
a type of lens used by the display;
a color space used by the display;
a size of the virtual canvas in the virtual environment; and
a distance and/or orientation of the virtual canvas with respect to a viewpoint of a viewer in the virtual environment.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the adjusting of the presentation of the visual content comprises at least one of:
adjusting a font size of text in the visual content;
adjusting a zoom level in the presentation of the visual content;
adjusting a color scheme in the presentation of the visual content;
adjusting a contrast of at least part of the visual content; and
re-formatting the visual content for a display having a different pixels-per-inch setting and/or size than the display for which the visual content was formatted.

### Claim 7 (depends on 1)

The method according to claim 1, wherein generating the adjusted version of the visual content comprises:
adjusting a current presentation of the visual content which is currently displayed by the sender system on a display; or
generating the adjusted version of the visual content separately from the current presentation of the visual content.

### Claim 8

A method of rendering image data provided by a sender system to a receiver system for screen sharing, wherein the receiver system is a Virtual Reality [VR] system, the method comprising, at the VR system:
obtaining, from the sender system:
image data representing visual content to be shared by the sender system with the receiver system, and
render metadata which indicates at least in part how the image data is to be rendered in a virtual environment and which is generated based on legibility constraints imposed by the rendering or display of the virtual environment; and
rendering the image data in the virtual environment based on the render metadata, wherein said rendering comprises projecting the image data onto a virtual canvas in the virtual environment.

### Claim 9 (depends on 8)

The method according to claim 8, further comprising providing receiver metadata to the sender system, wherein the receiver metadata is indicative of the legibility constraints imposed by the rendering or display of the virtual environment.

### Claim 10 (depends on 1)

A non-transitory computer-readable medium comprising a computer program, the computer program comprising instructions for causing a processor system to perform the method according to claim 1.

### Claim 11

A non-transitory computer-readable medium comprising:
receiver metadata which is indicative of legibility constraints imposed by a rendering or display of a virtual environment on the legibility of image data which is rendered in the virtual environment, wherein the receiver metadata optionally indicates one or more characteristics of the rendering or display of the virtual environment; or
render metadata which indicates at least in part how the image data is to be rendered in the virtual environment.

### Claim 12

A sender system configured for providing image data to a receiver system for screen sharing, wherein the receiver system is a Virtual Reality [VR] system configured to render the image data in a virtual environment by projecting the image data onto a virtual canvas, wherein the sender system comprises:
a network interface to a network;
a processor configured to:
identify visual content to be shared with the receiver system;
generate an adjusted version of the visual content which provides improved legibility when viewed in the virtual environment by adjusting a presentation of the visual content based on receiver metadata which is indicative of legibility constraints imposed by the rendering or display of the virtual environment; and
using the network interface, provide image data representing the adjusted version of the visual content via the network to the receiver system.

### Claim 13 (depends on 12)

The sender system according to claim 12, wherein the processor is further configured to:
based on the legibility constraints indicated by the receiver metadata, generate render metadata which indicates at least in part how the image data is to be rendered in the virtual environment; and
using the network interface, provide the render metadata via the network to the receiver system.

### Claim 14

A receiver system configured for rendering image data provided by a sender system to the receiver system for screen sharing, wherein the receiver system is a Virtual Reality [VR] system, wherein the VR system comprises:
a network interface to a network for obtaining, from the sender system:
image data representing visual content to be shared by the sender system with the receiver system, and
render metadata which indicates at least in part how the image data is to be rendered in a virtual environment and which is generated based on legibility constraints imposed by the rendering or display of the virtual environment; and
a processor configured to render the image data in the virtual environment based on the render metadata, wherein said rendering comprises projecting the image data onto a virtual canvas in the virtual environment.

### Claim 15 (depends on 14)

The receiver system according to claim 14, wherein the processor is configured to provide receiver metadata to the sender system using the network interface, wherein the receiver metadata is indicative of the legibility constraints imposed by the rendering or display of the virtual environment.