# US 12,225,242 B2 · System and method enabling live broadcasting sessions in virtual environments > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,225,242 B2 - Document ID: US12225242B2 - Status: Granted - Kind: B2 - Application number: 18/059,314 - Filed: 2022-11-28 - Published: 2024-05-30 - Granted: 2025-02-11 - Earliest claimed: 2022-11-28 - Assignees: Tmrw Foundation IP S.àR.L. - Applicants: TMRW Foundation IP S. À R.L. - Inventors: Cevat Yerli - Web page: https://patentgrep.com/patent/US12225242B2 ## CPC - H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) - H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras} - H04L 65/611: for multicast or broadcast (systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06) - H04L 65/80: Responding to QoS - H04N 7/157: {defining a virtual conference space and using avatars or agents (computer conference optimisation or adaptation H04L12/1827)} - H04N 21/2187: Live feed - H04N 21/25808: {Management of client data (terminal profiles in network data switching protocols H04L67/303)} - H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} - H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection - H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics} - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method for providing live broadcasting sessions in virtual environments includes creating a virtual environment based on virtual environment creation instructions; connecting the virtual environment to an event that is broadcast through the virtual environment; setting up a live broadcasting session from the virtual environment comprising the event broadcast; sending an invitation to at least one invitee client device, wherein the invitation comprises 3D coordinates of the virtual environment specified for at least one invitee; opening up a communication channel enabling access to the at least one invitee to the virtual environment, wherein the invitee client device accesses the virtual environment through a user graphical representation that is positioned at the specified 3D coordinate of the virtual environment; and streaming the live broadcasting session to the at least one invitee client device. Corresponding systems and computer-readable media are also provided. ## Claims ### Claim 1 A system providing live broadcasting sessions in virtual environments, comprising: at least one server computer comprising at least one processor and memory storing instructions implementing a virtual environment streaming application configured to, when the instructions are executed by the at least one processor, cause the at least one server computer to: create a virtual environment based on virtual environment creation instructions from a host client device connected to the at least one server computer via a network; connect the virtual environment to an event that is broadcast through the virtual environment, the event being a live real-world event; set up a live broadcasting session from the virtual environment comprising a broadcast of the event; send an invitation to at least one invitee client device, wherein the invitation comprises 3D coordinates of the virtual environment specified for at least one invitee; upon the at least one invitee accepting the invitation, open up a communication channel enabling access to the at least one invitee to the virtual environment, wherein the invitee client device accesses the virtual environment through a user graphical representation that is positioned at the specified 3D coordinates of the virtual environment; and stream the live broadcasting session to the at least one invitee client device; wherein the virtual environment streaming application selects between a selective forwarding unit (SFU) architecture to forward individual live streams from transmitting client devices to receiving client devices, and a multipoint control unit (MCU) architecture to forward a combined live stream of the live streams from the transmitting client devices to the receiving client devices, wherein the selecting is based on a threshold number of live streams from the transmitting client devices. ### Claim 2 (depends on 1) The system of claim 1, wherein the virtual environment streaming application enables invitees to interact with each other by exchanging real-time audio and video. ### Claim 3 (depends on 1) The system of claim 1, wherein the virtual environment streaming application enables a selection of an exclusive number of invitee user graphical representations to be visible to at least one host of the live broadcasting session, wherein at least one of the selected invitees is enabled to interact with the at least one host of the live broadcasting session. ### Claim 4 (depends on 3) The system of claim 3, wherein the virtual environment streaming platform enables said interactions with the at least one host to become part of a public video stream that is shared with other client devices. ### Claim 5 (depends on 3) The system of claim 3, wherein the virtual environment streaming application further displays a symbolic graphical representation of invitees not comprised within the selection of the exclusive number of invitees. ### Claim 6 (depends on 3) The system of claim 3, wherein the virtual environment streaming application further enables displaying graphical representations of reactions of invitees. ### Claim 7 (depends on 3) The system of claim 3, wherein the virtual environment streaming application enables the audience to explore the virtual environment by moving in the virtual environment. ### Claim 8 (depends on 7) The system of claim 7, wherein the presentation of movement by at least some of the audience members is disabled for the view of the at least one host. ### Claim 9 (depends on 1) The system of claim 1, wherein the field of view of users including hosts and invitees is calculated from the specified 3D coordinate of the virtual environment where the corresponding user graphical representation is positioned. ### Claim 10 A method executed by at least one processor implementing instructions in memory of at least one server computer, comprising: creating a virtual environment based on virtual environment creation instructions from a host client device connected to the at least one server computer via a network; connecting the virtual environment to an event that is broadcast through the virtual environment, the event being a live real-world event; setting up a live broadcasting session that is broadcast from the virtual environment comprising a broadcast of the event; sending an invitation to at least one invitee client device, wherein the invitation comprises 3D coordinates of the virtual environment specified for at least one invitee; upon the at least one invitee accepting the invitation, opening up a communication channel enabling access to the at least one invitee to the virtual environment, wherein the invitee client device accesses the virtual environment through a user graphical representation that is positioned at the specified 3D coordinates of the virtual environment; streaming the live broadcasting session to the at least one invitee client device; and selecting between a selective forwarding unit (SFU) architecture to forward individual live streams from transmitting client devices to receiving client devices, and a multipoint control unit (MCU) architecture to forward a combined live stream of the live streams from the transmitting client devices to the receiving client devices, wherein the selecting is based on a threshold number of live streams from the transmitting client devices. ### Claim 11 (depends on 10) The method of claim 10 further comprising enabling invitees to interact with each other by exchanging real-time audio and video. ### Claim 12 (depends on 10) The method of claim 10 further comprising selecting an exclusive number of invitee user graphical representations to be visible to at least one host of the live broadcasting session, wherein at least one of the selected invitees is enabled to interact with the at least one host of the live broadcasting session. ### Claim 13 (depends on 12) The method of claim 12 further comprising enabling said interactions with the at least one host to become part of a public video stream that is shared with other client devices. ### Claim 14 (depends on 12) The method of claim 12 further comprising displaying a symbolic graphical representation of invitees not comprised within the selection of the exclusive number of invitees. ### Claim 15 (depends on 12) The method of claim 12 further comprising displaying graphical representations of reactions of invitees. ### Claim 16 (depends on 10) The method of claim 10, wherein creating the virtual environment comprises: retrieving user preference data; and using the user preference data to customize the virtual environment. ### Claim 17 (depends on 10) The method of claim 10, wherein the field of view of the invitee is calculated from the specified 3D coordinate of the virtual environment. ### Claim 18 A non-transitory computer readable medium comprising instructions stored in memory which, when executed by at least one processor, cause at least one server computer to perform steps comprising: creating a virtual environment based on virtual environment creation instructions from a host client device connected to the at least one server computer via a network; connecting the virtual environment to an event that is broadcast through the virtual environment, the event being a live real-world event; setting up a live broadcasting session that is broadcast from the virtual environment comprising a broadcast of the event; sending an invitation to at least one invitee client device, wherein the invitation comprises 3D coordinates of the virtual environment specified for at least one invitee; upon the at least one invitee accepting the invitation, opening up a communication channel enabling access to the at least one invitee to the virtual environment, wherein the invitee client device accesses the virtual environment through a user graphical representation that is positioned at the specified 3D coordinates of the virtual environment; streaming the live broadcasting session to the at least one invitee client device, wherein a field of view of the invitee is calculated from the specified 3D coordinates of the virtual environment; and selecting between a selective forwarding unit (SFU) architecture to forward individual live streams from transmitting client devices to receiving client devices, and a multipoint control unit (MCU) architecture to forward a combined live stream of the live streams from the transmitting client devices to the receiving client devices, wherein the selecting is based on a threshold number of live streams from the transmitting client devices. ### Claim 19 (depends on 18) The non-transitory computer readable medium of claim 18, wherein the steps further comprise enabling invitees to interact with each other by exchanging real-time audio and video. ### Claim 20 (depends on 18) The non-transitory computer readable medium of claim 18, wherein the steps further comprise selecting an exclusive number of invitee user graphical representations to be visible to at least one host of the live broadcasting session, wherein at least one of the selected invitees is enabled to interact with the at least one host of the live broadcasting session.