# US 2020/0404218 A1 · Merged reality live event management system and method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0404218 A1 - Document ID: US20200404218A1 - Status: Published application - Kind: A1 - Application number: 16/903,239 - Filed: 2020-06-16 - Published: 2020-12-24 - Earliest claimed: 2019-06-18 - Assignees: TMRW Foundation IP & Holding S. À R.L. - Applicants: TMRW Foundation IP & Holding S. À R.L. - Inventors: Cevat Yerli - Web page: https://patentgrep.com/patent/US20200404218A1 ## CPC - G06F 9/46: Multiprogramming arrangements - H04N 7/157: {defining a virtual conference space and using avatars or agents (computer conference optimisation or adaptation H04L12/1827)} - G06F 9/453: {Help systems} - G06F 16/2379: {Updates performed during online database operations; commit processing} - G06F 16/9535: Search customisation based on user profiles and personalisation - G06N 20/00: Machine learning - G06Q 30/0623: {by investigating goods or services} - G06Q 30/0643: {graphically representing goods, e.g. 3D product representation} - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06T 15/205: {Image-based rendering} - G06T 17/005: {Tree description, e.g. octree, quadtree} - G06T 17/10: Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04L 65/61: for supporting one-way streaming services, e.g. Internet radio - H04L 65/611: for multicast or broadcast (systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06) - H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) - H04L 67/131: Protocols for games, networked simulations or virtual reality - G06Q 20/123: {Shopping for digital content} - G06T 2219/024: Multi-user, collaborative environment - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract An accurate and flexible merged reality system and method configured to enable remotely viewing and participating in real or virtual events. In the merged reality system, at least one portion of the real or a virtual world may be respectively replicated or streamed into corresponding sub-universes comprised within the virtual world system, wherein some of the sub-universes comprise events that guests may view and interact with from one or more associated guest physical locations. Other virtual elements, such as purely virtual objects or graphical representations of applications and games, can also be included in the virtual world system. The virtual objects comprise logic, virtual data and models that provide self-computing capabilities and autonomous behavior. The system enables guests to virtually visit, interact and make transactions within the event through the virtual world system. ## Claims ### Claim 1 A merged reality system comprising: at least one server of a cloud server computer system comprising at least one processor and memory storing: a virtual world system comprising a plurality of sub-universes, each sub-universe representing at least one portion of the real world or of a virtual world, wherein at least one sub-universe hosts a real or virtual event; and an event management system connected to the virtual world system and configured to manage event sharing rules on a per sub-universe basis; and wherein the event management system is configured to associate one or more user devices and one or more guest physical locations with the real or virtual event, to detect, through a network, the one or more user devices accessing at least one guest physical location associated with the real or virtual event, and to share, in response to the detecting, with the one or more user devices and the at least one guest physical location, based on the event sharing rules, the sub-universe that hosts the real or virtual event. ### Claim 2 (depends on 1) The system of claim 1, wherein the virtual world system comprises virtual objects that include at least one of a virtual replica of a real-world element, a purely virtual object, an application, or a combination thereof. ### Claim 3 (depends on 1) The system of claim 1, wherein the event management system further manages event sharing through user instances configured to process event access per guest. ### Claim 4 (depends on 1) The system of claim 1, wherein the event management system further comprises event sharing settings to configure sharing locations, times, and applications available at each sub-universe. ### Claim 5 (depends on 1) The system of claim 1, wherein the plurality of sub-universes further comprise streams representing a goal-specific simulation configured to obtain data from corresponding virtual replicas. ### Claim 6 (depends on 1) The system of claim 1, wherein the virtual world system includes a plurality of virtual objects, wherein the virtual objects include virtual data and models, and wherein the models comprise one or more of a 3D model, a dynamic model, a geometric model, or a machine learning model, or combinations thereof, and wherein the models consider a level of detail required by a specific scenario computation. ### Claim 7 (depends on 1) The system of claim 1, wherein the real or virtual event is a real event hosted in a real event venue, and wherein the real event venue comprises one or more connected devices including one or more RGBD cameras, depth cameras, LIDAR cameras, CCTV cameras, or Internet of Things devices, or combinations thereof, and wherein the connected devices are configured to scan and generate 3D images of the at least one portion of the real world, detect state changes in one or more objects or users, or combinations thereof. ### Claim 8 (depends on 1) The system of claim 1, wherein the at least one sub-universe hosting the real or virtual event is viewed by the one or more guests in augmented or virtual reality. ### Claim 9 (depends on 8) The system of claim 8, wherein in augmented reality one or more virtual objects of the real or virtual event are projected on a surface of the at least one guest physical location. ### Claim 10 (depends on 1) The system of claim 1, wherein the one or more guests access the event through the virtual world system upon receiving an invitation from a host device to access the event. ### Claim 11 (depends on 1) The system of claim 1, wherein the at least one guest physical location has an associated digital identifier stored in the at least one server, the digital identifier being retrieved by the one or more user devices from the at least one server in order to access the associated guest physical location through the virtual world system. ### Claim 12 (depends on 11) The system of claim 11, wherein the digital identifier is retrieved by the one or more user devices upon receiving an invitation sent by the event management system to access the event. ### Claim 13 (depends on 1) The system of claim 1, wherein each of the one or more user devices has a personal identifier that enables the at least one server to identify a guest. ### Claim 14 A method performed by at least one server computer comprising at least one processor and memory, the method comprising: providing a virtual world system comprising a plurality of sub-universes, each sub-universe representing at least one portion of the real world or of a virtual world, wherein at least one sub-universe hosts a real or virtual event; providing an event management system connected to the virtual world system and configured to manage event sharing rules on a per sub-universe basis; associating a user device and a guest physical location with the real or virtual event; detecting the user device accessing the guest physical location; and sharing to the user device and the guest physical location, based on the event sharing rules, the sub-universe hosting the event. ### Claim 15 (depends on 14) The method of claim 14, further comprising configuring sharing locations, times and applications available at each sub-universe through the event management system. ### Claim 16 (depends on 14) The method of claim 14, further comprising providing, through the event management system, an invitation to the user device to access the event from the guest physical location. ### Claim 17 (depends on 14) The method of claim 14, further comprising providing in the at least one server a digital identifier associated with the guest physical location, the digital identifier being retrieved by the user device from the at least one server in order to access the guest physical location through the virtual world system. ### Claim 18 (depends on 18) The method of claim 18, further comprising sending, through the event management system, a digital identifier upon the user device receiving the invitation. ### Claim 19 A computer readable medium having stored thereon instructions configured to cause at least one server computer comprising a processor and memory to perform steps comprising: providing a virtual world system comprising a plurality of sub-universes, each sub-universe representing at least one portion of the real world or of a virtual world, wherein at least one sub-universe hosts and is associated with a real or virtual event; providing an event management system connecting to the virtual world system and being configured to manage event sharing rules on a per sub-universe basis; associating a user device and a guest physical location with the real or virtual event; detecting the user device accessing the guest physical location; and sharing to the user device and the guest physical location, based on the event sharing rules, the sub-universe hosting the event. ### Claim 20 (depends on 19) The computer readable medium of claim 19, further comprising providing in the at least one server a digital identifier associated with the guest physical location, the digital identifier being retrieved by the user device from the at least one server in order to access the guest physical location through the virtual world system.