# US 10,765,938 B2 · De-interleaving gameplay data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,765,938 B2
- Document ID: US10765938B2
- Status: Granted
- Kind: B2
- Application number: 15/908,657
- Filed: 2018-02-28
- Published: 2019-08-29
- Granted: 2020-09-08
- Earliest claimed: 2018-02-28
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment LLC
- Inventors: Steven Trombetta; Christopher Thielbar; James Fairbairn; Adil Sherwani
- Web page: https://patentgrep.com/patent/US10765938B2

## CPC

- A63F 13/30: Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F 13/497: Partially or entirely replaying previous game actions
- A63F 13/86: Watching games played by other players
- G06F 16/71: Indexing; Data structures therefor; Storage structures
- G06F 16/739: {in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames}
- G11B 27/322: {used signal is digitally coded}
- A63F 2300/535: for monitoring, e.g. of user parameters, terminal parameters, application parameters, network parameters
- G06Q 30/0201: Market modelling; Market analysis; Collecting market data
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

The subject disclosure relates to the de-interleaving of captured game data for the creation of separate video data and statistical metadata repositories. In some aspects, a process of the disclosed technology includes steps for capturing gameplay data based on live gameplay in a game environment, the gameplay data comprising video data and statistical metadata based on player interactions with the game environment, de-interleaving the video data and the statistical metadata, storing the video data to a first database, and storing the statistical metadata to a second database, the first database being different from the second database. Systems and machine-readable media are also provided.

## Claims

### Claim 1

A system for providing game play channels, the system comprising:
one or more processors;
a network interface coupled to the one or more processors; and
a non-transitory memory coupled to the one or more processors, the memory comprising instructions stored therein, which when executed by the processors, cause the processors to perform operations comprising:
capturing gameplay data based on live gameplay in a game environment, the gameplay data comprising video data and statistical metadata based on player interactions with the game environment;
de-interleaving the video data and the statistical metadata;
storing the video data to a first database;
storing the statistical metadata to a second database, wherein the first database is different from the second database;
repairing statistical metadata corresponding to corrupted gameplay data; and
re-interleaving the video data and the repaired statistical metadata to create a simulation of the live gameplay in the game environment.

### Claim 2 (depends on 1)

The system of claim 1, wherein the processors further perform operations comprising:
receiving the video data from the first database;
receiving the statistical metadata from the second database; and
re-interleaving the video data and the statistical metadata.

### Claim 3 (depends on 1)

The system of claim 1, wherein the processors further perform operations comprising repairing the video data corresponding to the corrupted gameplay data, wherein the repaired video data is re-interleaved with the repaired statistical metadata to create the simulation of the live gameplay in the game environment.

### Claim 4 (depends on 1)

The system of claim 1, wherein the processors further perform operations comprising:
indexing the statistical metadata to produce indexed metadata; and
searching for a specified event based on the indexed metadata.

### Claim 5 (depends on 1)

The system of claim 1, wherein the processors further perform operations comprising:
indexing the video data to produce indexed video data; and
searching for a specified event based on the indexed video data.

### Claim 6 (depends on 1)

The system of claim 1, wherein the processors further perform operations comprising:
processing the statistical metadata to identify two or more gameplay events; and
parsing the statistical metadata based on the two or more gameplay events, wherein the parsed statistical metadata is stored to the second database.

### Claim 7 (depends on 1)

The system of claim 1, wherein the created simulation include a set of event highlight within a current game session or within a tournament associated with the current game session.

### Claim 8 (depends on 1)

The system of claim 1, wherein the processors further perform operations comprising re-rendering at least a part of the de-interleaved video data, wherein the re-rendered video data is re-interleaved with the repaired statistical data.

### Claim 9 (depends on 8)

The system of claim 8, wherein the processors re-render the video data to alter a playback characteristic of the video data.

### Claim 10 (depends on 9)

The system of claim 9, wherein the playback characteristic includes a viewing angle of the game environment.

### Claim 11 (depends on 8)

The system of claim 8, wherein the processors further perform operations comprising selecting the part of the de-interleaved video data for re-rendering.

### Claim 12 (depends on 1)

The system of claim 1, wherein de-interleaving the video data and the statistical metadata comprises disaggregating visual data and auditory data from the gameplay data, wherein the de-interleaved video data includes the disaggregated visual data and auditory data.

### Claim 13 (depends on 1)

The system of claim 1, wherein de-interleaving the video data and the statistical metadata comprises disaggregating game attribute data that is not visual data and not auditory data from the gameplay data, wherein the de-interleaved statistical metadata includes the disaggregated game attribute data.

### Claim 14

A method for managing an online gaming league, the method comprising:
capturing gameplay data based on live gameplay performed in a game environment, the gameplay data comprising video data and statistical metadata based on player interactions with the game environment;
de-interleaving the video data and the statistical metadata;
storing the video data to a first database;
storing the statistical metadata to a second database, wherein the first database is different from the second databases;
repairing the statistical metadata corresponding to corrupted gameplay data; and
re-interleaving the video data and the repaired statistical metadata to create a simulation of the live gameplay in the game environment.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
receiving the video data from the first database;
receiving the statistical metadata from the second database; and
re-interleaving the video data and the statistical metadata.

### Claim 16 (depends on 14)

The method of claim 14, further comprising repairing the video data corresponding to the corrupted gameplay data, wherein the repaired video data is re-interleaved with the statistical metadata to create the simulation of the live gameplay in the game environment.

### Claim 17 (depends on 14)

The method of claim 14, further comprising:
indexing the statistical metadata to produce indexed metadata; and
searching for a specified event based on the indexed metadata.

### Claim 18 (depends on 14)

The method of claim 14, further comprising:
indexing the video data to produce indexed video data; and
searching for a specified event based on the indexed video data.

### Claim 19 (depends on 14)

The method of claim 14, further comprising:
processing the statistical metadata to identify two or more gameplay events; and
parsing the statistical metadata based on the two or more gameplay events wherein the parsed statistical metadata is stored to the second database.

### Claim 20

A non-transitory computer-readable storage medium, having embodied thereon a program executable by a processor to perform operations comprising:
capturing gameplay data based on live gameplay performed in a game environment, the gameplay data comprising video data and statistical metadata based on player interactions with the game environment;
de-interleaving the video data and the statistical metadata;
storing the video data to a first database;
storing the statistical metadata to a second database, wherein the first database is different from the second databases;
repairing statistical metadata corresponding to corrupted gameplay data; and
re-interleaving the video data and the repaired statistical metadata to create a simulation of the live gameplay in the game environment.
