# US 12,762,803 B2 · Spatial multi streaming of XR content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,762,803 B2 - Document ID: US12762803B2 - Status: Granted - Kind: B2 - Application number: 18/375,345 - Filed: 2023-09-29 - Published: 2025-04-03 - Granted: 2026-10-13 - Earliest claimed: 2023-09-29 - Assignees: Adeia Guides Inc. - Applicants: Adeia Guides Inc. - Inventors: Petter Wannerberg; Christopher Phillips - Web page: https://patentgrep.com/patent/US12762803B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04L 67/131: Protocols for games, networked simulations or virtual reality - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract The disclosure relates to method and system for supervising a plurality of users of XR devices. A problem arises in that a supervisor hoping to assist a user in operating in an XR environment cannot easily obtain a representation of the XR environment which a particular user amongst the plurality of users is currently perceiving. The disclosure addresses this problem by having each XR device and a supervisory device independently determine the position of an XR device. Each XR device provides replica stream data in association with its position, and the user of the supervisory device selects an XR device by selecting its position. By tallying the position in the supervisor's selection of an XR device with the position associated with each replica stream, the replica stream of the XR device selected by the supervisor can be provided to the supervisory device. ## Claims ### Claim 1 A method for operating a supervisory device comprising: determining a respective position for each of a plurality of XR devices with respect to the supervisory device; determining, based on the respective position for each of the plurality of XR devices, a spatial arrangement of the plurality of XR devices, wherein the spatial arrangement indicates a physical location of each of the plurality of XR devices; generating for display, on a display screen of the supervisory device: a plurality of XR device representations, wherein each of the plurality of XR device representations is based on a respective physical location of a respective XR device of the plurality of XR devices and each of the plurality of XR device representations are arranged on the display screen according to the spatial arrangement; and a plurality of XR device streams, wherein each of the plurality of XR device streams comprises a respective stream of a respective XR device in a first size and each of the plurality of XR device streams is arranged adjacent to a respective XR device representation of the plurality of XR device representations; determining a selection of a selected XR device representation of the plurality of XR device representations on the display screen, wherein the selection indicates that a stream corresponding to the selected XR device representation is to be replicated in a second size; retrieving, based on the selection of the selected XR device representation, a replica stream corresponding to the selected XR device representation based on the stream corresponding to the selected XR device representation; and generating the replica stream corresponding to the selected XR device representation for display in the second size. ### Claim 2 (depends on 1) The method of claim 1, wherein retrieving the replica stream comprises: retrieving connection information data indicating a resource from which the replica stream is available; and retrieving the replica stream from the resource indicated in the connection information data. ### Claim 3 (depends on 2) The method of claim 2, wherein the resource is a local server, and the local server, the supervisory device and the plurality of XR devices are on the same Local Area Network. ### Claim 4 (depends on 2) The method of claim 2, wherein the supervisory device and the plurality of XR devices are on the same Local Area Network. ### Claim 5 (depends on 2) The method of claim 2, wherein the resource corresponds to the selected XR device representation and wherein the supervisory device and the XR device corresponding to the selected XR device representation are in direct device-to-device communication with one another. ### Claim 6 (depends on 1) The method of claim 1, wherein determining the respective position for each of the plurality of XR devices further comprises: determining position data of the supervisory device; and locating each of the plurality of XR devices with respect to the supervisory device based on the position data of the supervisory device. ### Claim 7 (depends on 1) The method of claim 1, further comprising operating the supervisory device to additionally generate for display in association with a respective XR device representation of the selected XR device, the replica stream corresponding to the selected XR device representation. ### Claim 8 (depends on 1) The method of claim 1, further comprising: generating for display, for each of the plurality of XR devices, an overlay representing a respective XR device superimposed on a respective stream of the respective XR device. ### Claim 9 (depends on 8) The method of claim 8, wherein determining the selected XR device representation comprises receiving a selection of the overlay representing the replica stream corresponding to the XR device representation. ### Claim 10 (depends on 1) The method of claim 1, wherein each of the plurality of XR device representations comprises a respective selectable icon. ### Claim 11 A system comprising: control circuitry for operating a supervisory device, the control circuitry configured to: determine a respective position for each of a plurality of XR devices with respect to the supervisory device; determine, based on the respective position for each of the plurality of XR devices, a spatial arrangement of the plurality of XR devices, wherein the spatial arrangement indicates a physical location of each of the plurality of XR devices; generate for display, on a display screen of the supervisory device: a plurality of XR device representations, wherein each of the plurality of XR device representations is based on a respective physical location of a respective XR device of the plurality of XR devices and each of the plurality of XR device representations are arranged on the display screen according to the spatial arrangement; and a plurality of XR device streams, wherein each of the plurality of XR device streams comprises a respective stream of a respective XR device in a first size and each of the plurality of XR device streams is arranged adjacent to a respective XR device representation of the plurality of XR device representations; determine a selection of a selected XR device representation of the plurality of XR device representations on the display screen, wherein the selection indicates that a stream corresponding to the selected XR device representation is to be replicated in a second size; retrieve, based on the selection of the selected XR device representation, a replica stream corresponding to the selected XR device representation based on the stream corresponding to the selected XR device representation; and generate the replica stream corresponding to the selected XR device representation for display in the second size. ### Claim 12 (depends on 11) The system of claim 11, wherein, when retrieving the replica stream, the control circuitry is configured to: retrieve connection information data indicating a resource from which the replica stream is available; and retrieve the replica stream from the resource indicated in the connection information data. ### Claim 13 (depends on 12) The system of claim 12, wherein the resource is a local server, and the local server, a supervisory device and the plurality of XR devices are on the same Local Area Network. ### Claim 14 (depends on 11) The system of claim 11, wherein, when determining the respective position for each of the plurality of XR devices, the control circuitry is further configured to: determine position data of a supervisory device; and locate each of the plurality of XR devices with respect to the supervisory device based on the position data of the supervisory device. ### Claim 15 (depends on 11) The system of claim 11, wherein the control circuitry is further configured to operate the supervisory device to additionally generate for display in association with a respective XR device representation of the selected XR device, the replica stream corresponding to the selected XR device representation. ### Claim 16 (depends on 11) The system of claim 11, wherein the control circuitry is further configured to: generate for display, for each of the plurality of XR devices, an overlay representing a respective XR device superimposed on a respective stream of the respective XR device. ### Claim 17 (depends on 16) The system of claim 16, wherein the control circuitry, when determining the selected XR device representation, is further configured to receive a selection of the overlay representing the replica stream corresponding to the XR device representation. ### Claim 18 (depends on 11) The system of claim 11, wherein each of the plurality of XR device representations comprises a respective selectable icon.