# US 2021/0275922 A1 · Surfacing prerecorded gameplay video for in-game player assistance

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0275922 A1
- Document ID: US20210275922A1
- Status: Published application
- Kind: A1
- Application number: 16/811,804
- Filed: 2020-03-06
- Published: 2021-09-09
- Earliest claimed: 2020-03-06
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment Inc.
- Inventors: Michael Starich; Rae Yip
- Web page: https://patentgrep.com/patent/US20210275922A1

## CPC

- A63F 13/335: using Internet
- A63F 13/5375: for graphically or textually suggesting an action, e.g. by displaying an arrow indicating a turn in a driving game
- A63F 13/35: Details of game servers
- A63F 13/497: Partially or entirely replaying previous game actions
- A63F 13/63: by the player, e.g. authoring using a level editor
- A63F 13/86: Watching games played by other players
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

A method, including: receiving, over a network from a plurality of first client devices that execute respective sessions of a video game, videos generated from the respective sessions at the first client devices; for each video, receiving, over the network from one of the first client devices, location metadata that identifies spatial locations in a virtual environment of the video game at which gameplay depicted by the video occurs, the location metadata being correlated to video frames of the video and identifying the spatial location of the gameplay depicted by a given video frame; during a session of the video game executed by a second client device, receiving, over the network, a current spatial location in the virtual environment of gameplay occurring in the session; using the current spatial location to select one or more of the videos; presenting, over the network, the selected videos at the second client device.

## Claims

### Claim 1

A method, comprising:
receiving, over a network from a plurality of first client devices that execute respective sessions of a video game, videos generated from the respective sessions of the video game at the first client devices;
for each video, receiving, over the network from one of the first client devices, location metadata that identifies spatial locations in a virtual environment of the video game at which gameplay depicted by the video occurs, the location metadata being correlated to video frames of the video and identifying the spatial location of the gameplay depicted by a given video frame;
during a session of the video game executed by a second client device, receiving, over the network, a current spatial location in the virtual environment of gameplay occurring in the session;
using the current spatial location to select one or more of the videos;
presenting, over the network, the selected videos at the second client device.

### Claim 2 (depends on 1)

The method of claim 1, wherein receiving the location metadata for a given video occurs substantially simultaneously with the receiving of the given video over the network.

### Claim 3 (depends on 2)

The method of claim 2, wherein the given video and the location metadata for the given video being synchronously streamed over the network from the first client device that generates the given video.

### Claim 4 (depends on 1)

The method of claim 1, wherein the current spatial location in the virtual environment is defined by current spatial coordinates of a virtual character or a virtual object in the virtual environment.

### Claim 5 (depends on 1)

The method of claim 1, wherein the location metadata that identifies spatial locations in the virtual environment is defined by spatial coordinates over time of a virtual character or a virtual object in the virtual environment.

### Claim 6 (depends on 1)

The method of claim 1, wherein the location metadata identifies a chapter, level, or scene of the video game.

### Claim 7 (depends on 1)

The method of claim 1, wherein using the current location to select one or more of the videos includes identifying one or more of the videos having location metadata identifying a spatial location proximate to the current spatial location.

### Claim 8 (depends on 1)

The method of claim 1, wherein presenting the selected videos includes displaying a preview image for each of the selected videos.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
receiving a request for playback of one of the selected videos;
responsive to the request for playback, streaming the one of the selected videos to the second client device.

### Claim 10

A non-transitory computer readable medium having program instructions embodied thereon that, when executed by at least one computing device, cause said at least one computing device to perform a method comprising the following operations:
receiving, over a network from a plurality of first client devices that execute respective sessions of a video game, videos generated from the respective sessions of the video game at the first client devices;
for each video, receiving, over the network from one of the first client devices, location metadata that identifies spatial locations in a virtual environment of the video game at which gameplay depicted by the video occurs, the location metadata being correlated to video frames of the video and identifying the spatial location of the gameplay depicted by a given video frame;
during a session of the video game executed by a second client device, receiving, over the network, a current spatial location in the virtual environment of gameplay occurring in the session;
using the current spatial location to select one or more of the videos;
presenting, over the network, the selected videos at the second client device.

### Claim 11 (depends on 10)

The non-transitory computer readable medium of claim 10, wherein receiving the location metadata for a given video occurs substantially simultaneously with the receiving of the given video over the network.

### Claim 12 (depends on 11)

The non-transitory computer readable medium of claim 11, wherein the given video and the location metadata for the given video being synchronously streamed over the network from the first client device that generates the given video.

### Claim 13 (depends on 10)

The non-transitory computer readable medium of claim 10, wherein the current spatial location in the virtual environment is defined by current spatial coordinates of a virtual character or a virtual object in the virtual environment.

### Claim 14 (depends on 10)

The non-transitory computer readable medium of claim 10, wherein the location metadata that identifies spatial locations in the virtual environment is defined by spatial coordinates over time of a virtual character or a virtual object in the virtual environment.

### Claim 15 (depends on 10)

The non-transitory computer readable medium of claim 10, wherein the location metadata identifies a chapter, level, or scene of the video game.

### Claim 16 (depends on 10)

The non-transitory computer readable medium of claim 10, wherein using the current location to select one or more of the videos includes identifying one or more of the videos having location metadata identifying a spatial location proximate to the current spatial location.

### Claim 17 (depends on 10)

The non-transitory computer readable medium of claim 10, wherein presenting the selected videos includes displaying a preview image for each of the selected videos.

### Claim 18 (depends on 10)

The non-transitory computer readable medium of claim 10, further comprising:
receiving a request for playback of one of the selected videos;
responsive to the request for playback, streaming the one of the selected videos to the second client device.
