# US 2019/0314728 A1 · System and Method for Managing Audio and Video Channels for Video Game Players and Spectators > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0314728 A1 - Document ID: US20190314728A1 - Status: Published application - Kind: A1 - Application number: 16/455,563 - Filed: 2019-06-27 - Published: 2019-10-17 - Earliest claimed: 2002-12-10 - Assignees: Sony Interactive Entertainment America LLC - Applicants: Sony Interactive Entertainment America LLC - Inventors: David R. Sullivan; Robert McCool; Stephen G. Perlman - Web page: https://patentgrep.com/patent/US20190314728A1 ## CPC - A63F 13/86: Watching games played by other players - A63F 13/335: using Internet - A63F 13/35: Details of game servers - A63F 13/352: involving special game server arrangements, e.g. regional servers connected to a national server or a plurality of servers managing partitions of the game world - A63F 13/355: Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client - A63F 13/358: Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients - A63F 13/424: involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition - A63F 13/537: using indicators, e.g. showing the condition of a game character on screen - A63F 13/795: for finding other players; for building a team; for providing a buddy list - A63F 13/87: Communicating with other players during game play, e.g. by e-mail or chat - A63F 2300/407: Data transfer via internet - A63F 2300/513: server hierarchy, e.g. local, regional, national or dedicated for different tasks, e.g. authenticating, billing - A63F 2300/534: for network load management, e.g. bandwidth optimization, latency reduction - A63F 2300/538: for performing operations on behalf of the game client, e.g. rendering - A63F 2300/572: Communication between players during game play of non game information, e.g. e-mail, chat, file transfer, streaming of audio and streaming of video - A63F 2300/577: for watching a game played by other players - A63F 2300/6072: of an input signal, e.g. pitch and rhythm extraction, voice recognition - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR ## Abstract A computer-implemented system and method are described for managing audio chat for an online video game or application. For example, a system according to one embodiment comprises: an online video game or application execution engine to execute an online video game or application in response to input from one or more users of the video game or application and to responsively generate audio and video of the video game or application; and a chat subsystem to establish audio chat sessions with the one or more users and one or more spectators to the video game or application, the chat subsystem establishing a plurality of audio chat channels including a spectator channel over which the spectators participate in audio chat and a user channel over which the users participate in audio chat. ## Claims ### Claim 1 A system, comprising: a video game execution engine on a hosting service configured to, execute a streaming video game, in response to selection of the streaming video game for game play received from one or more players over a network; responsively generate audio and video data of the streaming video game, the audio and video data being generated based on input received from the one or more players interacting with the streaming video game, wherein the input for the streaming video game is received from remote client devices associated with the one or more players; transmit the generated audio and video data of the streaming video game to the remote client devices of the one or more players; a chat subsystem of the hosting service configured to establish chat sessions with the one or more players playing the streaming video game and between an artificial intelligence system and a specific one of the players playing the streaming video game, the chat subsystem configured to, establish a plurality of chat channels including, a first chat channel over which the players participate in chat, wherein the player channel is associated with specific one of the players and a client device of the specific one of the players, and a second chat channel over which the specific one of the players and the artificial intelligence system participate in chat, wherein the second player channel is associated with the specific one of the players and a client device of the specific one of the players, the artificial intelligence system providing game play hints to assist the specific one of the players to interact with the streaming video game. ### Claim 2 (depends on 1) The system of claim 1, wherein the chat subsystem further includes, a third chat channel over which spectators participate in chat, wherein the third chat channel is associated with a particular spectator and a client device of the particular spectator, wherein the video game execution engine is configured to transmit the generated audio and video data of the streaming video game to remote client devices of the spectators. ### Claim 3 (depends on 1) The system of claim 1, further includes providing an option to the artificial intelligence system to control the streaming video game of the specific one of the players, during game play. ### Claim 4 (depends on 3) The system of claim 3, wherein control of the streaming video game is by providing input to drive game play of the streaming video game. ### Claim 5 (depends on 1) The system of claim 1, wherein the second chat channel is an audio chat channel or a video chat channel, and wherein the first chat channel is an audio chat channel or a video chat channel. ### Claim 6 (depends on 2) The system of claim 2, wherein the chat subsystem is further configured to extract an audio portion of select ones of the chat, process the audio portion and forward the audio portion to select ones of the players or select ones of the spectators, wherein the select ones of the chat are from the first chat channel or the third chat channel. ### Claim 7 (depends on 6) The system of claim 6, wherein the chat subsystem includes filters, wherein the filters are used to disguise a specific voice detected in the audio portion of the first chat channel or the third chat channel. ### Claim 8 (depends on 6) The system of claim 6, wherein the chat subsystem includes a voice-to-text conversion logic to convert the audio portion of the chat to text and wherein the voice-to-text conversion logic includes a translation logic that is configured to translate audio portion of the chat to text in another language than a language in which the audio portion of the chat is spoken. ### Claim 9 (depends on 1) The system of claim 1, wherein the chat associated with each of the first chat channel and the second chat channel includes a video of a computer-generated character of the respective player, the video capturing animation of the computer-generated character in whole or in part based on audio spoken by the respective player. ### Claim 10 (depends on 1) The system of claim 1, wherein the chat subsystem is configured to forward a chat stream of the chat to the specific one of the players on a different client device than the client device used by the specific one of the players for playing the video game. ### Claim 11 A method, comprising: executing a streaming video game using a video game execution engine of a hosting service, in response to input received from one or more players of the streaming video game, the executing includes responsively generating audio and video data of the streaming video game based on the input received from the one or more players interacting with the streaming video game using remote client devices, and forwarding the audio and video data of the streaming video game to respective ones of the remote client devices of the one or more players for rendering; and establishing, using a chat subsystem at the hosting service, chat sessions with the one or more players and between an artificial intelligence system and a specific player, wherein establishing comprises setting up a plurality of chat channels, wherein the plurality of chat channels includes a first chat channel over which the one or more players participate in chat, and a second chat channel over which the specific player and the artificial intelligence system participate in chat, wherein the artificial intelligence system provides game play hints to assist the specific player to interact with the streaming video game. ### Claim 12 (depends on 11) The method of claim 11, wherein managing the plurality of chat channels further includes providing options to allow the one or more players of the streaming video game to join and participate in the chat carried over the first chat channel. ### Claim 13 (depends on 11) The method of claim 11, wherein establishing the chat sessions further includes establishing a third chat channel over which one or more spectators of the streaming video game participate in chat. ### Claim 14 (depends on 13) The method of claim 13, wherein managing the plurality of chat channels further includes providing an option to the artificial intelligence system to control the streaming video game of the specific player, during game play. ### Claim 15 (depends on 13) The method of claim 13, wherein managing the plurality of chat channels further includes, extracting audio portion of select ones of the chat in the first chat channel or the third chat channel, processing the audio portion and forwarding the audio portion to select ones of the players or the select ones of the spectators. ### Claim 16 (depends on 11) The method of claim 11, wherein managing the plurality of chat channels further includes merging a chat of a selective player with game play data of the streaming video game, wherein the chat of the selective player may be an audio chat or a video chat.