# US 11,443,492 B2 · Sharing virtual content in a mixed reality scene > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,443,492 B2 - Document ID: US11443492B2 - Status: Granted - Kind: B2 - Application number: 17/253,543 - Filed: 2019-06-13 - Published: 2021-09-02 - Granted: 2022-09-13 - Earliest claimed: 2018-06-19 - Assignees: InterDigital CE Patent Holdings, SAS - Applicants: InterDigital CE Patent Holdings - Inventors: Matthieu Fradet; Caroline Baillard; Anthony Laurent - Web page: https://patentgrep.com/patent/US11443492B2 ## CPC - G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G09G 3/003: {to produce spatial visual effects} - G09G 5/026: {Control of mixing and/or overlay of colours in general (G09G5/022 and G09G5/024 take precedence)} - G09G 5/14: Display of multiple viewports - H04L 67/131: Protocols for games, networked simulations or virtual reality - G09G 2340/0464: Positioning - G09G 2340/12: Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels - G09G 2354/00: Aspects of interface with display user - G09G 2370/04: Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller - G09G 2370/042: for monitor identification - G09G 2370/16: Use of wireless transmission of display information - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract A method of sharing and a method of presenting virtual content in a mixed reality scene rendered on at least two user devices having different viewing position and/or orientation onto the mixed reality scene and corresponding apparatus are described. At a first user device, a user is enabled to select a virtual content to be shared and a second user device with whom the virtual content is to be shared. Information related to the virtual content to be shared is provided, wherein the provided information comprises the 3D position of the virtual content to be shared. The information is received by the second user device and the shared virtual content is rendered with regard to the viewing position and/or orientation of the second user device onto the mixed reality scene. ## Claims ### Claim 1 A method of controlling access to virtual content in a mixed reality scene rendered on at least two user devices, the method comprising: enabling, at a first mixed reality (MR) device, a user of the first MR device to select a virtual content object displayed by a display of the first MR device; enabling, at the first MR device, the user of the first MR device to select a second MR device visible in the display of the first MR device, wherein the selected virtual content object was at least one of not previously displayed by the second MR device and not previously accessible to the second MR device; and responsive to at least one of: the user selecting the virtual content object, and the user selecting the second MR device, performing at least one of: displaying the virtual content object on the second MR device; and making the virtual content object accessible to the second MR device. ### Claim 2 (depends on 1) The method according to claim 1, wherein said enabling comprises receiving a user input for selecting the content to be shared in the rendered mixed reality scene. ### Claim 3 (depends on 2) The method according to claim 2, wherein the mixed reality scene rendered on the first MR device comprises the second MR device and/or a user of the second MR device and/or a graphical symbol representing the second MR device or user of the second user device and wherein said enabling comprises detecting a user input for selecting the rendered second MR device, user of the second MR device or graphical symbol in the rendered mixed reality scene. ### Claim 4 (depends on 3) The method according to claim 3, wherein the mixed reality scene is rendered on a touchscreen of the first MR device and the detected user input is a gesture performed by a user on the touchscreen. ### Claim 5 (depends on 4) The method according to claim 4, wherein the performed gesture comprises: selecting the content to be shared by touching the touchscreen at the location of the displayed content to be shared; dragging the selected content to the location of the rendered second MR device, user of the second MR device or graphical symbol; and sharing the selected content by dropping it onto the rendered second MR device, user of the second MR device or graphical symbol. ### Claim 6 (depends on 3) The method according to claim 3, wherein the second MR device and/or user of the second MR device is represented by a 3D shape. ### Claim 7 (depends on 1) The method according to claim 1, further comprising: receiving from the first MR device information related to a virtual content in the mixed reality scene which is selected by the first MR device with the second MR device; and rendering the selected virtual content with regard to a viewing position and/or orientation of the second MR device onto the mixed reality scene. ### Claim 8 (depends on 7) The method according to claim 7, further comprising: receiving a notification that the first MR device wants to share virtual content; and detecting a user input accepting or declining sharing of the virtual content. ### Claim 9 (depends on 1) The method according to claim 1, wherein the first and second MR devices exchange information via a server. ### Claim 10 (depends on 9) The method according to claim 9, wherein the first MR device, when being turned on, requests from the server at least one of the following data: a scene configuration of the mixed reality scene; position data for the current location of other MR devices; or a list of sharable virtual content. ### Claim 11 (depends on 1) The method according to claim 1, further comprising: rendering the selected virtual content on the first MR device using a viewing position and/or orientation of the first MR device and 3D position of the selected virtual content. ### Claim 12 (depends on 1) The method according to claim 1, wherein enabling the user to select the virtual content comprises enabling the user to select the virtual content object within the mixed reality scene using a touchscreen of the first MR device. ### Claim 13 (depends on 1) The method according to claim 1, wherein enabling the user to select the virtual content comprises enabling the user to select the virtual content object within the mixed reality scene using gaze detection by the first MR device. ### Claim 14 (depends on 1) The method according to claim 1, wherein enabling the user to select the virtual content and enabling the user to select the second MR device concurrently comprise enabling the user to use a drag and drop gesture. ### Claim 15 (depends on 1) The method according to claim 1, wherein enabling the user to select the second MR device comprises enabling the user to select the second MR device within the mixed reality scene using a touchscreen of the first MR device. ### Claim 16 (depends on 1) The method according to claim 1, wherein enabling the user to select the second MR device comprises enabling the user to select the second MR device within the mixed reality scene using gaze detection by the first MR device. ### Claim 17 (depends on 1) The method according to claim 1, wherein enabling the user to select the second MR device comprises enabling the user to select an icon displayed in proximity to the second MR device within the mixed reality scene displayed on the first MR device. ### Claim 18 An apparatus comprising: a processor; and a non-transitory computer-readable medium storing instructions operative, when executed by the processor, to cause the apparatus to: enable, at a first mixed reality (MR) device, a user of the first MR device to select a virtual content object displayed by a display of the first MR device; enable, at the first MR device, the user of the first MR device to select a second MR device visible in the display of the first MR device, wherein the selected virtual content object was at least one of not previously displayed by the second MR device and not previously accessible to the second MR device; and responsive to at least one of: the user selecting the virtual content object, and the user selecting the second MR device, perform at least one of: display the virtual content object on the second MR device; and make the virtual content object accessible to the second MR device. ### Claim 19 (depends on 18) The apparatus according to claim 18, further comprising: a touchscreen configured to display the rendered mixed reality scene including the content to be shared and for detecting a user input being a gesture performed by a user on the touchscreen. ### Claim 20 A method comprising: receiving from a first MR device information related to a virtual content in the mixed reality scene which is selected by the first MR device, wherein the received information comprises a 3D position of the selected virtual content; and rendering, onto the mixed reality scene, the selected virtual content with regard to the 3D position of the selected virtual content and a viewing position and/or orientation of a second MR device.