# US 2019/0246179 A1 · Identifying relevant gameplay content for a game environment using a vector-space framework

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0246179 A1
- Document ID: US20190246179A1
- Status: Published application
- Kind: A1
- Application number: 15/892,213
- Filed: 2018-02-08
- Published: 2019-08-08
- Earliest claimed: 2018-02-08
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment Inc.
- Inventors: Michael Taylor; Glenn Black
- Web page: https://patentgrep.com/patent/US20190246179A1

## CPC

- A63F 13/537: using indicators, e.g. showing the condition of a game character on screen
- A63F 13/53: involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
- A63F 13/67: adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
- A63F 13/86: Watching games played by other players
- G06F 18/23213: with fixed number of clusters, e.g. K-means clustering
- G06F 18/24133: {Distances to prototypes}
- G06F 18/24147: {Distances to closest patterns, e.g. nearest neighbour classification}
- G06V 10/454: {Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]}
- G06V 10/763: {Non-hierarchical techniques, e.g. based on statistics of modelling distributions}
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/82: using neural networks
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- H04N 21/2393: {involving handling client requests (scheduling or organising the servicing of application requests H04L67/60)}
- H04N 21/4781: {Games}
- H04N 21/482: End-user interface for programme selection
- H04N 21/4828: {for searching programme descriptors (retrieval of video data G06F16/739)}
- H04N 21/8133: {specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video programme}
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A media system employs techniques to identify relevant gameplay content in a game environment using a vector-space framework. These techniques include generating a user query based on feature-values for features associated with a user frame of a user stream, mapping the user query to a user vector in a vector-space, selecting relevant content streams from a plurality of content streams based on a proximity between the user vector and position vectors mapped to the plurality of content streams, and presenting at least a portion of the relevant content streams.

## Claims

### Claim 1

A method of vector-based selection of content streams, the method comprising:
storing information in memory regarding a vector-space that corresponds to a game environment, wherein a plurality of content streams available within the game environment is mapped to different position vectors within the vector-space;
generating a user query based on feature-values for a set of features associated with a user frame of a user stream, that corresponds to current gameplay in the game environment;
mapping the user query to a user vector in the vector-space corresponding to the game environment, wherein the mapped user vector represents each of the features of the user query as a different dimension in the vector-space;
identifying distances between the mapped user vector and the position vectors mapped to the plurality of available content streams;
selecting at least one of the available content streams based on a proximity between the mapped user vector and the position vector mapped to the selected content stream, the proximity indicated by the identified distances between the mapped vector and the position vectors mapped to the plurality of available content streams; and
presenting at least a portion of the selected content stream.

### Claim 2 (depends on 1)

The method of claim 1, wherein the selected content stream comprise frames associated with the set of features, and further comprising:
determining feature-values for the set of features associated with the frames; and
assigning a priority value to the selected content stream based on the determined feature-values, wherein presenting at least the portion of the selected content stream is based on the assigned priority value.

### Claim 3 (depends on 2)

The method of claim 2, wherein the set of features comprises one or more of a gameplay transition time, a gameplay status, a number of votes, a number of points, an inventory, a character selection, a health of a character, a sound, a color palette, a transition time, a level, a position, or a gameplay milestone.

### Claim 4 (depends on 1)

The method of claim 1, wherein the plurality of content streams represents a gameplay transition in the game environment, and further comprising determining a gameplay transition time for each content stream of the plurality of content streams, wherein selecting the content stream is based on the gameplay transition time.

### Claim 5 (depends on 4)

The method of claim 4, wherein the plurality of content streams are associated with the set of features, and further comprising determining the gameplay transition time for each content stream based on the feature-values for the features associated with the plurality of content streams.

### Claim 6 (depends on 1)

The method of claim 1, wherein the plurality of content streams represent gameplay transitions in the game environment, and further comprising:
determining gameplay transition times for the plurality of content streams; and
comparing the gameplay transition times for the plurality of content streams to a threshold transition time, wherein the selected content stream is selected when the gameplay transition times satisfy the threshold transition time.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
monitoring the user stream; and
selecting the user frame from a plurality of user frames that form the user stream.

### Claim 8 (depends on 1)

The method of claim 1, wherein the plurality of content streams are associated with gameplay metrics that indicate popularity; and wherein selecting the content stream further comprises assigning a priority value to the selected content stream based on the gameplay metrics, wherein selecting the selected content stream is based on the assigned priority value.

### Claim 9 (depends on 1)

The method of claim 1,
wherein the plurality of content streams comprise a first content stream that includes first set of frames mapped to a first position vector and a second set of frames mapped to a second position vector,
wherein selecting the selected content stream further comprises selecting one of the first set of frames or the second set of frames based on a proximity between the user vector and the first position vector and a proximity between the user vector and the second position vector; and
wherein presenting at least the portion of the selected content stream further comprises presenting the one of the first set of frames or the second set of frames.

### Claim 10 (depends on 1)

The method of claim 1, wherein the plurality of content streams are associated with the set of features, and further comprising:
determining feature-values for the set of features associated with the plurality of content streams; and
mapping the plurality of content streams to the position vectors in the vector-space based on the feature-values.

### Claim 11 (depends on 1)

The method of claim 1, wherein presenting at least the portion of the selected content stream comprises presenting images that represent at least the portion of the selected content stream.

### Claim 12

A system for a vector-based selection of content streams, the system comprising:
memory that stores information regarding a vector-space that corresponds to a game environment, wherein a plurality of content streams available within the game environment is mapped to different position vectors within the vector-space;
a network interface that communicates over one or more communication networks; and
a processor coupled to the network interface and that executes instructions stored in memory, wherein execution of the instructions by the processor:
generates a user query based on feature-values for a set of features associated with a user frame of a user stream that corresponds to current gameplay in the game environment;
maps the user query to a user vector in the vector-space corresponding to the game environment, wherein the mapped user vector represents each of the features of the user query as a different dimension in the vector-space;
identifies distances between the mapped user vector and the position vectors mapped to the plurality of available content streams;
selects at least one of the available content streams based on a proximity between the mapped user vector and the position vector mapped to the selected content stream, the proximity indicated by the identified distances between the mapped vector and the position vectors mapped to the plurality of available content streams; and
presents at least a portion of the selected content stream.

### Claim 13 (depends on 12)

The system of claim 12, wherein the processor executes further instructions to:
determine feature-values for the set of features associated with frames for the selected content stream; and
assign priority value to the selected content stream based on the feature-values, wherein at least the portion of the selected content stream is presented based on the assigned priority value.

### Claim 14 (depends on 13)

The system of claim 13, wherein the set of features comprises one or more of a gameplay transition time, a gameplay status, a number of votes, a number of points, an inventory, a character selection, a health of a character, a sound, a color palette, a transition time, a level, a position, or a gameplay milestone.

### Claim 15 (depends on 12)

The system of claim 12, wherein the plurality of content streams represent a gameplay transition in the game environment, wherein the processor executes further instructions to determine a gameplay transition time for each content stream of the plurality of content streams, wherein the selected content stream is selected based on the gameplay transition time for each content stream.

### Claim 16 (depends on 15)

The system of claim 15, wherein the plurality of content streams are associated with the set of features, wherein the processor determines the gameplay transition time for each content stream based on feature-values for the set of features associated with the plurality of content streams.

### Claim 17 (depends on 12)

The system of claim 12, wherein the plurality of content streams are associated with a gameplay metric that represents a popularity; and wherein the processor selects the selected content stream by assigning a priority value to the selected content stream based on the gameplay metric, wherein the selected content stream is selected based on the assigned priority value.

### Claim 18

A tangible, non-transitory, computer-readable storage medium, having instructions encoded thereon, the instructions executable by a processor to perform a method of vector-based selection of content streams, the method comprising:
storing information in memory regarding a vector-space that corresponds to a game environment, wherein a plurality of content streams available within the game environment is mapped to different position vectors within the vector-space;
generating a user query based on feature-values for a set of features associated with a user frame of a user stream, that corresponds to current gameplay in the game environment;
mapping the user query to a user vector in the vector-space corresponding to the game environment, wherein the mapped user vector represents each of the features of the user query as a different dimension in the vector-space;
identifying distances between the mapped user vector and the position vectors mapped to the plurality of available content streams;
selecting at least one of the available content streams based on a proximity between the mapped user vector and the position vector mapped to the selected content stream, the proximity indicated by the identified distances between the mapped vector and the position vectors mapped to the plurality of available content streams; and
presenting at least a portion of the selected content stream.

### Claim at position 19

-20. (canceled)

### Claim 21 (depends on 1)

The method of claim 1, wherein generating the user query comprises extracting the feature-values for the set of features from the user frame.

### Claim 22 (depends on 21)

The method of claim 21, further comprising monitoring the user stream for the set of features, wherein each of the feature-values is extracted from the user frame present within the monitored user stream.
