# US 12,015,658 B1 · Apparatus and method for transmitting spatial audio using multicast > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,015,658 B1 - Document ID: US12015658B1 - Status: Granted - Kind: B1 - Application number: 18/362,310 - Filed: 2023-07-31 - Granted: 2024-06-18 - Earliest claimed: 2023-03-15 - Assignees: Clicked Inc. - Applicants: Clicked, Inc - Inventors: Ha Ram Lee; Tae Wook Kim - Web page: https://patentgrep.com/patent/US12015658B1 ## CPC - H04L 65/611: for multicast or broadcast (systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06) - H04S 7/304: {For headphones} - H04S 2420/11: Application of ambisonics in stereophonic audio systems - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04S: STEREOPHONIC SYSTEMS ## Abstract Disclosed are an apparatus and method for transmitting a spatial audio by using multicast that are capable of efficiently transmitting spatial audio data of multiplayer content by using multicast. The spatial audio transmitting apparatus includes a plurality of servers communicatively connected to a plurality of client terminals executing multiplayer real-time content to be separated by a multicast group. A server included in the respective multicast group transmits the first player information to the other servers included in the multicast group in a multicast method so as to be shared when receiving first player information from a client terminal executing the multiplayer real-time content, and mixes spatial audio based on the first player information and the second player information and transmits the mixed spatial audio to the client terminal in a unicast method when receiving second player information from another server included in the multicast group. ## Claims ### Claim 1 A spatial audio transmitting apparatus, the apparatus comprising: a plurality of servers communicatively connected to a plurality of client terminals executing multiplayer real-time content to be separated by a multicast group, wherein a server included in the respective multicast group is configured to: when receiving first player information from a first client terminal executing the multiplayer real-time content, transmit the first player information to the other servers included in the multicast group in a multicast method so as to be shared; wherein, when receiving the first player information, the server receives the first player information located in a 3-dimensional (3D) virtual space from the first client terminal executing the multiplayer real-time content; wherein the first player information includes position information, orientation information, and voice information of the first player; and wherein, when receiving the first player information, the server receives the first player information located in the 3D virtual space from the first client terminal in the unicast method; and when receiving second player information from another server included in the multicast group, mix spatial audio based on the first player information and the second player information and transmit the mixed spatial audio to the client terminal in a unicast method. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein, when the plurality of servers are separated by the multicast group, servers communicatively connected to each other through the same network are grouped into one multicast group. ### Claim 3 (depends on 1) The apparatus of claim 1, wherein the server is configured to: when mixing and transmitting the spatial audio, separate encoded voice information of a first player, and position and orientation information of the first player from the first player information when the first player information is received; separate encoded voice information of a second player and position and orientation information of the second player from the second player information when the second player information is received; generate raw audio data by decoding the encoded voice information of the first player and the encoded voice information of the second player; generate stereo audio data by mixing the raw audio data and the spatial audio based on the position and orientation information the first player and the position and orientation information the second player; and transmit compressed audio by encoding the stereo audio data. ### Claim 4 (depends on 3) The apparatus of claim 3, wherein the server is configured to: generate raw picture data by processing real-time rendering based on the position and orientation information the first player and the position and orientation information the second player; and transmit compressed video by encoding the raw picture data. ### Claim 5 (depends on 1) The apparatus of claim 1, wherein the server includes: a unicast receiver configured to receive the first player information from the client terminal in the unicast method; a multicast receiver configured to receive the second player information from the another server in the multicast method; an audio decoder configured to output raw audio data by decoding encoded voice information of a first player separated from the first player information and encoded voice information of a second player separated from the second player information; a spatial audio engine configured to output stereo audio data by mixing the spatial audio based on position and orientation information of the first player separated from the first player information, position and orientation information of the second player separated from the second player information, and the raw audio data; an audio encoder configured to output compressed audio by encoding the stereo audio data; a multicast transmitter configured to transmit the first player information to another server in the multicast method; and a unicast transmitter configured to transmit the compressed audio to the client terminal in the unicast method. ### Claim 6 (depends on 5) The apparatus of claim 5, wherein the server includes: a real time renderer configured to output raw picture data by performing real-time rendering based on the position and orientation information of the first player separated from the first player information and the position and orientation information of the second player separated from the second player information; and a video encoder configured to transmit compressed video by encoding the raw picture data. ### Claim 7 A spatial audio transmitting method of an apparatus including a plurality of servers communicatively connected to a plurality of client terminals to be separated by a multicast group, the method comprising: receiving, by a server included in the respective multicast group, first player information from a first client terminal; wherein, when receiving the first player information, the server receives the first player information located in a 3-dimensional (3D) virtual space from the first client terminal executing the multiplayer real-time content; wherein the first player information includes position information, orientation information, and voice information of the first player; and wherein, when receiving the first player information, the server receives the first player information located in the 3D virtual space from the first client terminal in the unicast method; transmitting by the server the first player information to the other servers included in the multicast group in a multicast method so as to be shared; receiving by the server second player information from another server included in the multicast group; mixing by the server spatial audio based on the first player information and the second player information; and transmitting by the server the mixed spatial audio to the client terminal in a unicast method.