# US 12,113,838 B2 · Methods, systems, and apparatuses for improved content creation and synchronization

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,113,838 B2
- Document ID: US12113838B2
- Status: Granted
- Kind: B2
- Application number: 17/569,110
- Filed: 2022-01-05
- Published: 2023-07-06
- Granted: 2024-10-08
- Earliest claimed: 2022-01-05
- Assignees: ON24, Inc.
- Applicants: ON24, Inc.
- Inventors: Shishir Pokharel; Jaime Andres Castillo Leon; Cobin Isaiah Smigel Dopkeen; Alejandro Castera Garcia
- Web page: https://patentgrep.com/patent/US12113838B2

## CPC

- H04L 65/4015: {where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference}
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- H04L 65/1089: by adding media; by removing media
- H04N 21/854: Content authoring
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods, systems, and apparatuses for improved content creation and synchronization are described herein. A plurality of users may collaborate via a plurality of user devices to create a media asset, such as a webinar. A first user of a first user device of the plurality of user devices may interact with first content and second content associated with the media assets. An indication of the interaction, such as metadata, may be sent by the first user device to a content server(s) and/or a database. The indication of the interaction may be used to synchronize the first content and the second content within the media asset. In this way, any editing/revision/content generation performed at any one of the plurality of user devices may be synchronized in real-time.

## Claims

### Claim 1

A method comprising:
capturing, at a first user device of a plurality of user devices, first content during output of a first portion of a media asset at the first user device;
sending, to at least one content server in communication with the plurality of user devices, the first content, wherein the at least one content server determines, based on the first content, a first plurality of content elements associated with the first content;
receiving, from the at least one content server, second content associated with the media asset and a second plurality of content elements, wherein the second content is captured at a second user device of the plurality of user devices during output of a second portion of the media asset at the second user device, and wherein the at least one content server determines, based on the second content, the second plurality of content elements;
outputting, by the first user device, a user interface comprising a first object associated with the first content and a second object associated with the second content;
receiving, via the user interface, at least one user interaction associated with the first object or the second object; and
sending, to the at least one content server, an indication of the at least one user interaction, wherein the indication causes the at least one content server to synchronize the first content with the first portion of the media asset, the second content with the second portion of the media asset, and at least one of the first content or the second content with a portion of a supplemental media asset based on the at least one user interaction, the first plurality of content elements, and the second plurality of content elements, and wherein the first content is output with the first portion of the media asset, and the second content is output with the second portion of the media asset, by at least one user device of the plurality of user devices based on the synchronization of the first content with the first portion of the media asset and the second content with the second portion of the media asset.

### Claim 2 (depends on 1)

The method of claim 1, wherein the at least one user interaction associates at least one of the first content or the second content with the portion of the supplemental media asset.

### Claim 3 (depends on 1)

The method of claim 1, wherein the supplemental media asset comprises at least one of: a slideshow, video content, or a poll.

### Claim 4 (depends on 3)

The method of claim 3, wherein the portion of the supplemental media asset comprises at least one of: a slide of the slideshow or a portion of the video content, and wherein at least one of the slide or the portion of the video content are associated with a beginning timestamp and an ending timestamp.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first plurality of content elements comprises at least one of:
a first identifier;
a first beginning timestamp;
a first ending timestamp;
an identifier for the media asset;
a first identifier for the first content; or
a session identifier associated with the plurality of user devices; and
wherein the second plurality of content elements comprises at least one of:
a second identifier;
a second beginning timestamp;
a second ending timestamp;
the identifier for the media asset;
a second identifier for the second content; or
the session identifier associated with the plurality of user devices.

### Claim 6 (depends on 1)

The method of claim 1, wherein the user interface further comprises a timeline associated with the media asset, and wherein the at least one user interaction comprises:
a movement of the first object or the second object along the timeline;
a cutting command associated with the first object or the second object;
a pasting command associated with the first object or the second object;
a re-recording marker associated with the first object or the second object;
a fade-in effect applied to the first object or the second object;
a fade-out effect applied to the first object or the second object;
a filter applied to the first object or the second object; or
an adjustment of a level of gain associated with the first object or the second object.

### Claim 7 (depends on 1)

The method claim 1, wherein the first content and the second content each comprise at least one of: video content or audio content.

### Claim 8

A method comprising:
receiving, by at least one content server in communication with a plurality of user devices, first content and second content, wherein the first content is captured at a first user device of the plurality of user devices during output of a first portion of a media asset at the first user device, and wherein the second content is captured at a second user device of the plurality of user devices during output of a second portion of the media asset at the second user device;
determining, based on the first content and the second content, a first plurality of content elements and a second plurality of content elements;
sending the second content, the first plurality of content elements, and the second plurality of content elements to the first user device, wherein the first user device outputs a user interface comprising a first object associated with the first content and a second object associated with the second content;
receiving, from the first user device, an indication of at least one user interaction associated with the user interface and at least one of the first object or the second object; and
based on receiving the indication, synchronizing the first content with the first portion of the media asset, the second content with the second portion of the media asset, and at least one of the first content or the second content with a portion of a supplemental media asset based on the at least one user interaction, the first plurality of content elements, and the second plurality of content elements, and wherein the first content is output with the first portion of the media asset, and the second content is output with the second portion of the media asset, by at least one user device of the plurality of user devices based on the synchronization of the first content with the first portion of the media asset and the second content with the second portion of the media asset.

### Claim 9 (depends on 8)

The method of claim 8, wherein the at least one user interaction associates at least one of the first content or the second content with the portion of the supplemental media asset.

### Claim 10 (depends on 8)

The method of claim 8, wherein the supplemental media asset comprises at least one of: a slideshow, video content, or a poll.

### Claim 11 (depends on 10)

The method of claim 10, wherein the portion of the supplemental media asset comprises at least one of: a slide of the slideshow or a portion of the video content, and wherein at least one of the slide or the portion of the video content are associated with a beginning timestamp and an ending timestamp.

### Claim 12 (depends on 8)

The method of claim 8, wherein the first plurality of content elements comprises at least one of:
a first identifier;
a first beginning timestamp;
a first ending timestamp;
an identifier for the media asset;
a first identifier for the first content; or
a session identifier associated with the plurality of user devices; and
wherein the second plurality of content elements comprises at least one of:
a second identifier;
a second beginning timestamp;
a second ending timestamp;
the identifier for the media asset;
a second identifier for the second content; or
the session identifier associated with the plurality of user devices.

### Claim 13 (depends on 8)

The method of claim 8, wherein the user interface further comprises a timeline associated with the media asset, and wherein the at least one user interaction comprises:
a movement of the first object or the second object along the timeline;
a cutting command associated with the first object or the second object;
a pasting command associated with the first object or the second object;
a re-recording marker associated with the first object or the second object;
a fade-in effect applied to the first object or the second object;
a fade-out effect applied to the first object or the second object;
a filter applied to the first object or the second object; or
an adjustment of a level of gain associated with the first object or the second object.

### Claim 14 (depends on 8)

The method claim 8, wherein the first content and the second content each comprise at least one of: video content or audio content.

### Claim 15

An apparatus comprising:
one or more processors and;
processor-executable instructions that, when executed by the one or more processors, cause the apparatus to:
capture first content during output of a media asset at the apparatus;
send, to at least one content server in communication with a plurality of user devices, the first content, wherein the at least one content server determines, based on the first content, a first plurality of content elements associated with the first content;
receive, from the at least one content server, second content associated with the media asset and a second plurality of content elements, wherein the second content is captured at a second user device of the plurality of user devices during output of a second portion of the media asset at the second user device, and wherein the at least one content server determines, based on the second content, the second plurality of content elements;
output a user interface comprising a first object associated with the first content and a second object associated with the second content;
receive, via the user interface, at least one user interaction associated with the first object or the second object; and
send, to the at least one content server, an indication of the at least one user interaction, wherein the indication causes the at least one content server to synchronize the first content with the first portion of the media asset, and the second content with the second portion of the media asset, and at least one of the first content or the second content with a portion of a supplemental media asset based on the at least one user interaction, the first plurality of content elements, and the second plurality of content elements, and wherein the first content is output with the first portion of the media asset, and the second content is output with the second portion of the media asset, by at least one user device of the plurality of user devices based on the synchronization of the first content with the first portion of the media asset and the second content with the second portion of the media asset.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the at least one user interaction associates at least one of the first content or the second content with the portion of the supplemental media asset.

### Claim 17 (depends on 15)

The apparatus of claim 15, wherein the supplemental media asset comprises at least one of: a slideshow, video content, or a poll.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein the portion of the supplemental media asset comprises at least one of: a slide of the slideshow or a portion of the video content, and wherein at least one of the slide or the portion of the video content are associated with a beginning timestamp and an ending timestamp.

### Claim 19 (depends on 15)

The apparatus of claim 15, wherein the first content and the second content each comprise at least one of: video content or audio content.

### Claim 20 (depends on 15)

The apparatus of claim 15, wherein the first plurality of content elements comprises at least one of:
a first identifier;
a first beginning timestamp;
a first ending timestamp;
an identifier for the media asset;
a first identifier for the first content; or
a session identifier associated with the plurality of user devices; and
wherein the second plurality of content elements comprises at least one of:
a second identifier;
a second beginning timestamp;
a second ending timestamp;
the identifier for the media asset;
a second identifier for the second content; or
the session identifier associated with the plurality of user devices.
