# US 2019/0378335 A1 · Viewer position coordination in simulated reality > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0378335 A1 - Document ID: US20190378335A1 - Status: Published application - Kind: A1 - Application number: 16/436,506 - Filed: 2019-06-10 - Published: 2019-12-12 - Earliest claimed: 2018-06-12 - Applicants: Kreatar, LLC - Inventors: Lyron L. BENTOVIM; Liron LERMAN - Web page: https://patentgrep.com/patent/US20190378335A1 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G09G 3/002: {to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay} - G06F 3/147: using display panels - G06Q 10/101: Collaborative creation, e.g. joint development of products or services - G06T 15/20: Perspective computation - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06T 2219/024: Multi-user, collaborative environment - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract Systems and methods for representing data in a simulated reality (SR) are described. An example method includes accessing, via a computing device of a coordinated SR system, an asset suitable to display in a SR, and receiving first/second real environment user location data for first/second users, respectively, using the coordinated SR system. The method further includes determining, based on the first/second real environment user location data, first/second relative positions within the SR between the asset and a first representation associated with the first user and a second representation associated with the second user, respectively. The method further includes displaying, on a first display device of the coordinated simulated reality system, the asset and the second representation as part of the simulated reality based on the first relative position and the second relative position, and displaying, on a second display device of the coordinated simulated reality system, the asset and the first representation as part of the simulated reality based on the first relative position and the second relative position. ## Claims ### Claim 1 A coordinated simulated reality system, comprising: first and second display devices associated with first and second users, respectively; a non-transitory memory containing computer-readable instructions operable to create a simulated reality; and a processor configured to execute the instructions to: access an asset suitable to display in the simulated reality; receive first and second real environment user location data for the first and second users, respectively; determine a first relative position between the asset and a first representation of the first user in the simulated reality and a second relative position between the asset and a second representation of the second user in the simulated reality first and second real environment user location data; cause first respective renderings of the asset and the second representation to be provided in a first display on the first display device as part of the simulated reality based on the first and second relative positions; and cause second respective renderings of the asset and the first representation to be to be provided in a second display on the second display device as part of the simulated reality based on the first and second relative positions. ### Claim 2 (depends on 1) The coordinated simulated reality system of claim 1, wherein the simulated reality includes an augmented reality platform for the first user, and wherein the processor is further configured to execute the instructions to: receive information from a real environment input device; and cause a real environment to be rendered in the first and second displays on the first and second display devices along with the asset based on the information received from the real environment input device. ### Claim 3 (depends on 1) The coordinated simulated reality system of claim 1, further comprising a real environment anchor, wherein the real environment user location data is based, at least in part, on information from the real environment anchors. ### Claim 4 (depends on 3) The coordinated simulated reality system of claim 3, wherein the first user is associated with the real environment anchor. ### Claim 5 (depends on 4) The coordinated simulated reality system of claim 4, wherein the second user is associated with a second real environment anchor. ### Claim 6 (depends on 1) The coordinated simulated reality system of claim 1, wherein the processor is further configured to execute the instructions to: assign a first location to the first user within the simulated reality and a second location to the second user within the simulated reality; and cause the first representation to be rendered at a location in the second display based on the first and second locations and cause the second representation to be rendered at a location in the first display based on the first and second locations. ### Claim 7 (depends on 1) The coordinated simulated reality system of claim 1, wherein the processor is further configured to execute the instructions to: determine a first location of the first user within the simulated reality based on the first real world environment data and a second location of the second user within the simulated reality based on the second real world environment data; and cause the first representation to be rendered at a location in the second display based on the first and second locations and the second representation to be rendered at a location in the first display based on the first and second locations. ### Claim 8 (depends on 1) The coordinated simulated reality system of claim 1, wherein the processor is further configured to execute the instructions to cause respective renderings of the asset on a surface within the first and second displays. ### Claim 9 (depends on 1) The coordinated simulated reality system of claim 1, wherein the processor is further configured to execute the instructions to: track a spatial relationship the first and second users; and cause a location of the second user to be updated in the first display and a location of the first user to be updated in the second display based on a change in the spatial relationship the first and second users. ### Claim 10 (depends on 1) The coordinated simulated reality system of claim 1, wherein the asset is viewed from a first perspective on the first display by the first user and is viewed from a second perspective that is different than the first perspective on the second display by the second user. ### Claim 11 (depends on 1) The coordinated simulated reality system of claim 1, further comprising an input device configured to receive information in response to input from the first user, wherein the processor is further configured to execute the instructions to implement a change to the simulated reality based on information received from the input device, wherein the change to the simulated reality includes a modification of the asset, an interaction with the second user, or a modification of a viewpoint of one the first or second users in the simulated reality. ### Claim 12 A method, comprising: accessing, via a computing device of a coordinated simulated reality system, an asset suitable to display in a simulated reality; receiving first and second real environment user location data for first and second users, respectively, using the coordinated simulated reality system; determining, based on the first and second real environment user location data, a first relative position within the simulated reality between the asset and a first representation associated with the first user and a second relative position within the simulated reality between the asset and a second representation associated with the second user; displaying, on a first display device of the coordinated simulated reality system, the asset and the second representation as part of the simulated reality based on the first relative position and the second relative position; and displaying, on a second display device of the coordinated simulated reality system, the asset and the first representation as part of the simulated reality based on the first relative position and the second relative position. ### Claim 13 (depends on 12) The method of claim 12, further comprising: receiving information from a real environment input device; and rendering a real environment in the display on the display device along with the asset based on the information received the real environment input device. ### Claim 14 (depends on 12) The method of claim 12, further comprising receiving the first and second real environment user location data based on information from a real environment anchor. ### Claim 15 (depends on 12) The method of claim 12, further comprising: assigning a first location to the first user within the simulated reality and a second location to the second user within the simulated reality based on user input, wherein the second representation is displayed at a location in the first display device based on the second location and the first representation is displayed at a location in the second display device based on the first location and the second location. ### Claim 16 (depends on 12) The method of claim 12, further comprising: determining a first location of the first user within the simulated reality based on the first real world environment data and a second location of the second user within the simulated reality based on the second real world environment data, wherein the second representation is displayed at a location in the first display device based on the second location and the first representation is displayed at a location in the second display device based on the first location and the second location. ### Claim 17 (depends on 13) The method of claim 13, further comprising displaying, on a second display device of the coordinated simulated reality system, the asset, the first representation, and the second representation as part of the simulated reality based on the first relative position, the second relative position, and the third relative position. ### Claim 18 (depends on 17) The method of claim 17, wherein at least one of the asset, the first representation, or the second representation is displayed on the second display device from a different perspective than displayed on the display device. ### Claim 19 (depends on 12) The method of claim 12, further comprising: tracking a spatial relationship between the first and second users; and updating display of the first representation or the second representation on the display device based on a change of the spatial relationship between the first and second users. ### Claim 20 (depends on 12) The method of claim 12, further comprising updating display of at least one of the asset, the first representation, or the second representation based on a received user input requesting a change to the simulated reality.