# US 11,439,918 B2 · Player to spectator handoff and other spectator controls

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,439,918 B2
- Document ID: US11439918B2
- Status: Granted
- Kind: B2
- Application number: 17/015,845
- Filed: 2020-09-09
- Published: 2020-12-31
- Granted: 2022-09-13
- Earliest claimed: 2018-02-28
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment LLC
- Inventors: Steven Trombetta; Christopher Thielbar; James Fairbairn
- Web page: https://patentgrep.com/patent/US11439918B2

## CPC

- A63F 13/86: Watching games played by other players
- A63F 13/35: Details of game servers
- A63F 13/355: Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
- A63F 13/358: Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
- A63F 13/48: Starting a game, e.g. activating a game device or waiting for other players to join a multiplayer session
- A63F 13/54: involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
- A63F 13/79: involving player-related data, e.g. identities, accounts, preferences or play histories
- A63F 13/847: Cooperative playing, e.g. requiring coordinated actions from several players to achieve a common goal
- A63F 13/798: for assessing skills or for ranking players, e.g. for generating a hall of fame
- A63F 2300/535: for monitoring, e.g. of user parameters, terminal parameters, application parameters, network parameters
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

A video game has at least one player client with control over an aspect of a shared virtual environment. The video game also has at least one spectator client with limited to no control over the shared virtual environment. For example, the spectator client's control may be limited to the game server generating audience cheers or boos in response to spectator input during gameplay. In response to detection of a trigger event by a game server, the player and spectator may switch roles. The client switching from spectator to player experiences an increase in network transfer quality from the game server to help provide smooth gameplay. The client switching from player to spectator faces a decrease in network transfer properties to compensate.

## Claims

### Claim 1

A method for curating streamed views of virtual environments, the method comprising:
generating a shared virtual environment accessible by a plurality of spectator devices over a communication network, each of the plurality of devices controlling a streamed view within the shared virtual environment in accordance with a plurality of view modification options;
receiving input from a requesting spectator device over the communication network, the input selecting a view curator of a plurality of view curators for the shared virtual environment;
handing off control over a streamed view associated with the requesting spectator device to the selected view curator, wherein the selected view curator controls switching between the plurality of view modification options for devices that have handed off control to the selected view curator;
receiving one or more control inputs from the selected view curator, each control input selecting a different view modification option from the plurality of view modification options;
modifying the streamed view associated with the requesting spectator device in accordance with the control inputs from the selected view curator; and
providing the modified streamed view to the requesting spectator device over the communication network.

### Claim 2 (depends on 1)

The method of claim 1, wherein the received input from the requesting spectator device further selects partial or total control to be handed off to the view curator, and wherein control over the streamed view is handed off in accordance with the selection of partial or total control.

### Claim 3 (depends on 2)

The method of claim 2, further comprising receiving one or more control inputs from the requesting spectator device that has selected partial control to be handed off to the view curator, wherein modifying the streamed view is further based on the control inputs received from the requesting spectator device.

### Claim 4 (depends on 1)

The method of claim 1, wherein the selected view curator is at least one of a player participating in the shared virtual environment, a spectator associated with the requesting spectator device, another spectator, a commentator, and an artificial intelligence system.

### Claim 5 (depends on 1)

The method of claim 1, wherein the control inputs specify modifications to at least one of a viewing angle, zoom, rotation, speed of the streamed view, replay of a portion of the streamed view, and incorporating external content.

### Claim 6 (depends on 5)

The method of claim 5 wherein the external content includes at least one of audio, video, and textual commentary, and wherein modifying the streamed view includes providing a separate stream of the commentary to the requesting spectator device for incorporation into the streamed view.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
receiving feedback inputs from one or more of the spectator devices;
identifying one or more different types of the received feedback inputs;
identifying when an amount of one of the feedback types corresponds to a predetermined threshold; and
generating an effect within the shared virtual environment based on the corresponding threshold.

### Claim 8 (depends on 7)

The method of claim 7, wherein the different types of the received feedback inputs include positive or negative feedback, wherein the generated effects include an audio effect played for a predetermined time period, a type of the audio effect corresponding to the type of received feedback inputs.

### Claim 9 (depends on 7)

The method of claim 7, wherein the different types of the received feedback inputs include indications of negative behavior specific to a player in the shared virtual environment, and wherein the effect includes replacing the player.

### Claim 10

A system for curating streamed views of virtual environments, the system comprising:
a game management server that tracks data regarding a shared virtual environment accessible by a plurality of spectator devices over a communication network, each of the plurality of devices controlling a streamed view within the shared virtual environment in accordance with a plurality of view modification options;
a communication interface that communicates over the communication network, wherein the communication interface:
receives input from a requesting spectator device over the communication network, the input selecting a view curator of a plurality of view curators for the shared virtual environment, wherein the selected view curator is given control over a streamed view associated with the requesting spectator device;
hands off control over a streamed view associated with the requesting spectator device to the selected view curator, wherein the selected view curator controls switching between the plurality of view modification options for devices that have handed off control to the selected view curator; and
receives one or more control inputs from the selected view curator, each control input selecting a different view modification option from the plurality of view modification options; and
a processor that executes instructions stored in memory, wherein the processor executes the instructions to:
modify the streamed view associated with the requesting spectator device in accordance with the control inputs from the selected view curator; and
provide the modified streamed view to the requesting spectator device over the communication network.

### Claim 11 (depends on 10)

The system of claim 10, wherein the received input from the requesting spectator device further selects partial or total control to be handed off to the view curator, and wherein control over the streamed view is handed off in accordance with the selection of partial or total control.

### Claim 12 (depends on 11)

The system of claim 11, wherein the communication interface further receives one or more control inputs from the requesting spectator device that has selected partial control to be handed off to the view curator, wherein the processor modifies the streamed view further based on the control inputs received from the requesting spectator device.

### Claim 13 (depends on 10)

The system of claim 10, wherein the selected view curator is at least one of a player participating in the shared virtual environment, a spectator associated with the requesting spectator device, another spectator, a commentator, and an artificial intelligence system.

### Claim 14 (depends on 10)

The system of claim 10, wherein the control inputs specify modifications to at least one of a viewing angle, zoom, rotation, speed of the streamed view, replay of a portion of the streamed view, and incorporating external content.

### Claim 15 (depends on 14)

The system of claim 14, wherein the external content includes at least one of audio, video, and textual commentary, and wherein the processor modifies the streamed view by providing a separate stream of the commentary to the requesting spectator device for incorporation into the streamed view.

### Claim 16 (depends on 10)

The system of claim 10, wherein the communication interface further receives feedback inputs from one or more of the spectator devices; and wherein the processor executes further instructions to:
identify one or more different types of the received feedback inputs;
identify when an amount of one of the feedback types corresponds to a predetermined threshold; and
generate an effect within the shared virtual environment based on the corresponding threshold.

### Claim 17 (depends on 16)

The system of claim 16, wherein the different types of the received feedback inputs include positive or negative feedback, wherein the generated effects include an audio effect played for a predetermined time period, a type of the audio effect corresponding to the type of received feedback inputs.

### Claim 18 (depends on 16)

The system of claim 16, wherein the different types of the received feedback inputs include indications of negative behavior specific to a player in the shared virtual environment, and wherein the effect includes replacing the player.

### Claim 19

A non-transitory computer-readable storage medium having embodied thereon a program executable by a processor to perform a method for curating streamed views of virtual environments, the method comprising:
generating a shared virtual environment accessible by a plurality of spectator devices over a communication network, each of the plurality of devices controlling a streamed view within the shared virtual environment in accordance with a plurality of view modification options;
receiving input from a requesting spectator device over the communication network, the input selecting a view curator of a plurality of view curators for the shared virtual environment;
handing off control over a streamed view associated with the requesting spectator device to the selected view curator, wherein the selected view curator controls switching between the plurality of view modification options for devices that have handed off control to the selected view curator;
receiving one or more control inputs from the selected view curator, each control input selecting a different view modification option from the plurality of view modification options;
modifying the streamed view associated with the requesting spectator device in accordance with the control inputs from the selected view curator; and
providing the modified streamed view to the requesting spectator device over the communication network.