# US 11,077,370 B2 · Methods for providing access to recordings of game play and generation of custom camera views of the game play

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,077,370 B2
- Document ID: US11077370B2
- Status: Granted
- Kind: B2
- Application number: 17/002,561
- Filed: 2020-08-25
- Published: 2020-12-17
- Granted: 2021-08-03
- Earliest claimed: 2007-12-05
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment LLC
- Inventors: Stephen G. Perlman; Roger van der Laan
- Web page: https://patentgrep.com/patent/US11077370B2

## CPC

- A63F 13/35: Details of game servers
- A63F 13/497: Partially or entirely replaying previous game actions
- A63F 13/525: Changing parameters of virtual cameras
- A63F 13/5255: according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
- A63F 13/86: Watching games played by other players
- H04N 9/79: Processing of colour television signals in connection with recording
- H04N 9/87: Regeneration of colour television signals (H04N9/80 takes precedence)
- H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference
- H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence)
- H04N 19/154: Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147)
- H04N 19/17: the unit being an image region, e.g. an object
- H04N 19/179: the unit being a scene or a shot
- H04N 19/61: in combination with predictive coding
- H04N 21/2143: {located in a single building, e.g. hotel, hospital or museum (arrangements specially adapted for plural spots in a confined site in broadcast systems H04H20/63; adaptations for transmission by electric cable for domestic distribution in television systems H04N7/106)}
- H04N 21/21815: {comprising local storage units}
- H04N 21/231: Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N 21/4147: PVR [Personal Video Recorder] (H04N5/76 takes precedence {; arrangements for broadcast with accumulation-type receivers H04H20/40})
- H04N 21/435: Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
- H04N 21/47202: {for requesting content on demand, e.g. video on demand}
- H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)}
- H04N 21/4781: {Games}
- H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)}
- H04N 21/64322: {IP}
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- H04N 21/8173: {End-user applications, e.g. Web browser, game}
- A63F 13/335: using Internet
- A63F 2300/402: Communication between platforms, i.e. physical link to protocol
- A63F 2300/552: for downloading to client devices, e.g. using OS version, hardware or software profile of the client device
- H04N 7/106: {for domestic distribution}
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A computer-implemented method is provided. The method includes executing a game application on one or more servers of a data center. The game application is for a game and the game is played by a first user of a first client device remote to the data center. The one or more servers interfaced with one or more encoders for compressing interactive video from the game application responsive to input from the first client device and streaming of the interactive video in a compressed format to the first client device for decompression and rendering to a display of the first client device. The method includes storing, at the data center, a recording of at least part of the game played by the first user using the first client device. The method includes storing, at the data center, state data for at least part of the game played by the first user using the first client device. The method includes generating a replay of the recording responsive to input from a second user device. The replay is generated with a different camera view from a camera view in the recording. The replay is executed using as input the state data.

## Claims

### Claim 1

A computer-implemented method comprising:
executing a game application on one or more servers of a data center, wherein the game application is for a game and the game is played by a first user of a first client device remote to the data center, the one or more servers working with an encoder for compressing and streaming interactive video to the first client device and using input from the first client device to control interactivity when playing the game, the streaming of the interactive video is transmitted over the Internet to the first client device;
storing a recording of at least part of the game played by the first user using the first client device;
storing application state data for at least part of the game played by the first user using the first client device; and
generating video, responsive to input from a second user, of one or more additional views of the recording using the application state data associated with the game played by the first user as input for re-executing the game application;
wherein said generated video provides a different camera view than is provided by the recording.

### Claim 2 (depends on 1)

The method of claim 1, wherein the generated video is compressed and transmitted to a second client device of the second user.

### Claim 3 (depends on 1)

The method of claim 1, wherein the generated video for the one or more additional views is generated by the said one or more servers of the data center responsive to said input from a second client device of said second user.

### Claim 4 (depends on 1)

The method of claim 1, wherein the second user is a spectator of the first user or a viewer of the recording.

### Claim 5 (depends on 1)

The method of claim 1, wherein the second user, via a second remote device connected to a server of the data center, is provided with functionality to view, pause, and rewind the recording.

### Claim 6 (depends on 5)

The method of claim 5, wherein said rewind is of the stored recording, and said viewing is of the interactive video generated for the first user or the different camera view.

### Claim 7 (depends on 1)

The method of claim 1, wherein the second user, via a second remote device connected to a server of the data center, is provided with functionality to view the game play of the first user and provide the input for generating video of a view that provides an additional perspective than perspectives in the recording.

### Claim 8 (depends on 1)

The method of claim 1, wherein the additional perspective is provided by the different camera view.

### Claim 9 (depends on 1)

The method of claim 1, wherein the second user, via a second remote device connected to a server of the data center, is provided with functionality to view the game play of the first user and additionally control a camera view of the game play, the camera view being views additional to those that are part of the recording, the camera view is the different camera view.

### Claim 10 (depends on 1)

The method of claim 1, wherein said one or more additional views are fly-through perspectives for a segment of the recording that is generated video responsive to input by the second user.

### Claim 11 (depends on 1)

The method of claim 1, wherein the application state data supports a plurality of replays with changes in camera views from different fly-through perspectives.

### Claim 12 (depends on 1)

The method of claim 1, wherein the recording provides for viewing said additional views with a Digital Video Recorder (DVR) control functionality.

### Claim 13 (depends on 12)

The method of claim 12, wherein the DVR control functionality includes pause, rewind, and fast forward functions.

### Claim 14 (depends on 12)

The method of claim 12, wherein the DVR control functionality includes 3D DVR.

### Claim 15 (depends on 1)

The method of claim 1, wherein said second user is provided with a user interface that enables selection of different views of the recoding of the game play of the first user or other users.

### Claim 16 (depends on 1)

The method of claim 1, further comprising enabling the first user to specify a segment of the recording for sharing.

### Claim 17 (depends on 16)

The method of claim 16, further comprising making the segment available for viewing or play on a website, said website being accessible over the Internet by the first user, the second user or other users.

### Claim 18

A computer-implemented method comprising:
executing a game application on one or more servers of a data center, wherein the game application is for a game and the game is played by a first user of a first client device remote to the data center, the one or more servers interfaced with one or more encoders for compressing interactive video from the game application responsive to input from the first client device, and streaming of the interactive video in a compressed format to the first client device for decompression and rendering to a display of the first client device;
storing, at the data center, a recording of at least part of the game played by the first user using the first client device;
storing, at the data center, state data for at least part of the game played by the first user using the first client device; and
generating a replay of the recording responsive to input from a second user device, the replay being generated with a different camera view from a camera view in the recording;
wherein the replay is executed using as input the state data that is associated with the game played by the first user.

### Claim 19 (depends on 18)

The method of claim 18, wherein the second user device is controlled by a second user that is one of a spectator of the game played by the first user or a viewer of the recording.

### Claim 20 (depends on 18)

The method of claim 18, wherein the recording is accessible from a webpage, the recording being viewable using the camera view or using the different camera view as selected by a second user of the second user device or other users and user devices having access to the webpage.
