# US 2012/0254454 A1 · Image-based synchronization system and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254454 A1
- Document ID: US20120254454A1
- Status: Published application
- Kind: A1
- Application number: 13/074,251
- Filed: 2011-03-29
- Published: 2012-10-04
- Earliest claimed: 2011-03-29
- Assignees: ON24, Inc.
- Inventors: Matthias Margush; Jayesh Sahasi
- Web page: https://patentgrep.com/patent/US20120254454A1

## CPC

- H04N 7/15: Conference systems
- H04L 12/1827: {Network arrangements for conference optimisation or adaptation}
- H04N 21/43072: {of multiple content streams on the same device}
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A real-time image-manipulation based synchronization system and method for live or pre-recorded media content, such as an MP4, WebM, Flash, Real, or Windows Media stream, are provided in which the media content is synchronized with a series of interactive elements that are part of a rich media presentation. The media content may be any combination of audio and video data, including webcam output and screen capture output, and the synchronization commands are embedded by modifying the video image (frame) or audio data itself, without the need for a separate (often proprietary) metadata channel, allowing a broad distribution in any video format, including H.264/HTML5.

## Claims

### Claim 1

An apparatus for encoding a synchronization code into a plurality of digital media streams so that the plurality of digital media streams can be synchronized, the apparatus comprising:
an encoder that receives a digital media stream;
a presentation manager tool that generates one or more synchronization commands for the digital media stream; and
the encoder embeds the one or more synchronization commands into the digital media stream and then encodes the embedded one or more synchronization commands and the digital media stream into an encoded digital media stream that is streamable to a user, whereby the encoded digital media stream is synchronizable with a plurality of digital media streams without a separate metadata channel.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein each digital media stream is one of a video stream, an audio stream and a digital data stream.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein each synchronization command is one of a launch survey command, a flip to next presentation slide command, a refresh browser command, a close browser command, a block a particular user command and a launch a different URL command.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the encoder encrypts the one or more synchronization commands directly into the digital media stream by manipulating the digital media stream without the need for a separate metadata channel.

### Claim 5

A method for encoding a synchronization code into a plurality of digital media streams so that the plurality of digital media streams can be synchronized, the method comprising:
receiving a digital media stream;
generating one or more synchronization commands for the digital media stream;
embedding, using an encoder, the one or more synchronization commands into the digital media stream; and encoding, using the encoder, the embedded one or more synchronization commands and the digital media stream into an encoded digital media stream that is streamable to a user, whereby the encoded digital media stream is synchronizable with a plurality of digital media streams without a separate metadata channel.

### Claim 6 (depends on 5)

The method of claim 5, wherein each digital media stream is one of a video stream, an audio stream and a digital data stream.

### Claim 7 (depends on 5)

The method of claim 5, wherein each synchronization command is one of a launch survey command, a flip to next presentation slide command, a refresh browser command, a close browser command, a block a particular user command and a launch a different URL command.

### Claim 8 (depends on 5)

The method of claim 5, wherein embedding the one or more synchronization commands further comprises encrypting, using the encoder, the one or more synchronization commands into the digital media stream.

### Claim 9

An apparatus for synchronizing a plurality of digital media streams so that the plurality of digital media streams are synchronized for an audience event console, the apparatus comprising:
an audience event console on a computer that is capable of displaying an event presentation with the plurality of digital media streams;
an event system, coupleable to the computer with the audience event console, that has an encoder that encodes each digital media stream to generate an encoded digital media stream for each digital media stream and a media streamer that streams a plurality of encoded media streams to the audience event console;
wherein each encoded digital media stream further comprises one or more synchronization commands that are embedded into the digital media stream and digital media stream;
wherein the audience event console receives each encoded digital media stream and extracts the one or more synchronization commands from each encoded digital media stream so that the audience event console synchronizes the plurality of digital media streams based on the extracted one or more synchronization commands in each encoded digital media stream.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein each digital media stream is one of a video stream, an audio stream and a digital data stream.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein each synchronization command is one of a launch survey command, a flip to next presentation slide command, a refresh browser command, a close browser command, a block a particular user command and a launch a different URL command.

### Claim 12 (depends on 9)

The apparatus of claim 9, wherein the encoder encrypts the one or more synchronization commands into the digital media stream.

### Claim 13 (depends on 9)

The apparatus of claim 9, wherein the audience event console further comprises a piece of software being executed by the computer.

### Claim 14 (depends on 9)

The apparatus of claim 9, wherein the audience event console further comprises a piece of code being executed within a browser on the computer.

### Claim 15

A method for synchronizing a plurality of digital media streams so that the plurality of digital media streams are synchronized for an audience event console, the method comprising:
encoding, using an encoder in an event system, each digital media stream to generate an encoded digital media stream for each digital media stream, wherein each encoded digital media stream further comprises one or more synchronization commands that are embedded into the digital media stream and digital media stream;
streaming, using a media streamer of the event system, a plurality of encoded media streams to an audience event console on a remote computer;
receiving, at the audience event console on the remote computer, each encoded digital media stream;
extracting, using the audience event console on the remote computer, the one or more synchronization commands from each encoded digital media stream; and
synchronizing, on the audience event console on the remote computer, the plurality of digital media streams based on the extracted one or more synchronization commands in each encoded digital media stream.

### Claim 16 (depends on 15)

The method of claim 15, wherein each digital media stream is one of a video stream, an audio stream and a digital data stream.

### Claim 17 (depends on 15)

The method of claim 15, wherein each synchronization command is one of a launch survey command, a flip to next presentation slide command, a refresh browser command, a close browser command, a block a particular user command and a launch a different URL command.

### Claim 18

The method 15, wherein encoding each digital media stream further comprises encrypting, using the encoder, the one or more synchronization commands into the digital media stream.
