# US 2021/0243487 A1 · Video generation system to render frames on demand using a fleet of gpus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243487 A1
- Document ID: US20210243487A1
- Status: Published application
- Kind: A1
- Application number: 16/777,817
- Filed: 2020-01-30
- Published: 2021-08-05
- Earliest claimed: 2020-01-30
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Bradley Kotsopoulos; Eli Semory; Rahul Bhupendra Sheth
- Web page: https://patentgrep.com/patent/US20210243487A1

## CPC

- H04N 21/226: {Characteristics of the server or} Internal components of the server
- H04N 21/26258: {for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40)}
- G06F 16/2379: {Updates performed during online database operations; commit processing}
- G06F 16/43: Querying
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- H04N 21/234: Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N 21/23412: {for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects}
- H04N 21/235: Processing of additional data, e.g. scrambling of additional data or processing content descriptors
- H04N 21/2393: {involving handling client requests (scheduling or organising the servicing of application requests H04L67/60)}
- H04N 21/25891: {being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- G06T 2200/16: involving adaptation to the client's capabilities
- G06T 2200/24: involving graphical user interfaces [GUIs]
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A content controller system to render frames on demand comprises a rendering server system that includes a plurality of graphics processing units (GPUs). The GPUs in the rendering server system render a set of media content item segments using a media content identification and a main user identification. Rendering the set of media content item segments includes retrieving metadata from a metadata database associated with the media content identification, rendering the set of media content item segments using the metadata, generating a main user avatar based on the main user identification, and incorporating the main user avatar into the set of media content item segments. The rendering server system then uploads the set of media content item segments to a segment database; and updates segment states in a segment state database to indicate that the set of media content item segments are available. Other embodiments are disclosed herein.

## Claims

### Claim 1

A content controller system comprising:
a rendering server system comprising a plurality of graphics processing units (GPUs) to render a set of media content item segments using a media content identification and a main user identification, wherein the set of media content item segments are a plurality of sequential frames of a media content item, wherein rendering the set of media content item segments comprises
retrieving metadata from a metadata database associated with the media content identification,
rendering the set of media content item segments using the metadata,
generating a main user avatar based on the main user identification, and
incorporating the main user avatar into the set of media content item segments;
to upload the set of media content item segments to a segment database; and
to update segment states in a segment state database to indicate that the set of media content item segments are available.

### Claim 2 (depends on 1)

The content controller system of claim 1, further comprising:
a delivery server system to receive a request for the media content item from a client device, the request comprising the media content identification and the main user identification.

### Claim 3 (depends on 2)

The content controller system of claim 2, wherein
the media content item is a video associated with the media content identification.

### Claim 4

(canceled)

### Claim 5 (depends on 2)

The content controller system of claim 2, wherein the main user identification is associated with a user of the client device.

### Claim 6 (depends on 2)

The content controller system of claim 2, wherein
the delivery server system is further
to retrieve the segment states from the segment state database, wherein the segment states indicate availability associated with media content item segments.

### Claim 7 (depends on 6)

The content controller system of claim 6, wherein
the delivery server system is further
to compile and transmit to the client device a playlist including the set of media content item segments.

### Claim 8 (depends on 1)

The content controller system of claim 1, wherein the plurality of GPUs is a fleet of GPUs.

### Claim 9

A content controller system comprising:
a delivery server system
to receive a request for a media content item from a client device, the request comprising a media content identification and a main user identification;
to retrieve segment states from a segment state database, wherein the segment states indicate availability associated with media content item segments;
to compile and transmit to the client device a playlist including a first set of media content item segments, wherein the first set of media content item segments is based on the segment states;
to initialize rendering of a second set of media content item segments; and
a rendering server system comprising a plurality of graphics processing units (GPUs)
to render a second set of media content item segments using the media content identification and the main user identification, wherein rendering the second set of media content item segments comprises
retrieving metadata from a metadata database associated with the media content identification,
rendering the second set of media content item segments using the metadata,
generating a main user avatar based on the main user identification, and
incorporating the main user avatar into the second set of media content item segments;
to upload the second set of media content item segments to a segment database; and
to update the segment states in the segment state database to indicate that the second set of media content item segments are available,
wherein the first set of media content item segments and the second set of media content items are a plurality of sequential frames of the media content item.

### Claim 10 (depends on 9)

The content controller system of claim 9, wherein the delivery server system is further to update the playlist to include the second set of media content item segments.

### Claim 11 (depends on 10)

The content controller system of claim 10, wherein the delivery server system updating the playlist comprises:
compiling the updated playlist to include the second set of media content item segments; and
transmitting the updated playlist to the client device.

### Claim 12 (depends on 9)

The content controller system of claim 9, wherein the client device receives the second set of media content item segments from the segment database.

### Claim 13 (depends on 9)

The content controller system of claim 9, wherein
the media content item is a video associated with the media content identification.

### Claim 14

(canceled)

### Claim 15 (depends on 9)

The content controller system of claim 9, wherein the first set of media content item segments is sequential to the second set of media content item segments.

### Claim 16 (depends on 9)

The content controller system of claim 9, wherein the main user identification is associated with a user of the client device.

### Claim 17 (depends on 9)

The content controller system of claim 9, wherein the plurality of GPUs is a fleet of GPUs.

### Claim 18

A rendering server system comprising:
a plurality of graphics processing units (GPUs); and
a memory component having instructions stored thereon, when executed by at least one of the plurality of GPUs, causes the at least one of the plurality of GPUs to perform operations comprising:
rendering a set of media content item segments using a media content identification and a main user identification, wherein the set of media content item segments is a plurality of sequential frames of the media content item, wherein rendering the set of media content item segments comprises
retrieving metadata from a metadata database associated with the media content identification,
rendering the set of media content item segments using the metadata,
generating a main user avatar based on the main user identification, and
incorporating the main user avatar into the set of media content item segments;
uploading the set of media content item segments to a segment database; and
updating segment states in a segment state database to indicate that the set of media content item segments are available.

### Claim 19 (depends on 18)

The rendering server system of claim 18, wherein
the media content item is a video associated with the media content identification; and
the main user identification is associated with a user of the client device.

### Claim 20 (depends on 19)

The rendering server system of claim 19, wherein
the plurality of GPUs is a fleet of GPUs.
