# US 2012/0254649 A1 · Method and system for precise synchronization of audio and video streams during a distributed communication session with multiple participants

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254649 A1
- Document ID: US20120254649A1
- Status: Published application
- Kind: A1
- Application number: 13/523,708
- Filed: 2012-06-14
- Published: 2012-10-04
- Earliest claimed: 2007-01-31
- Assignees: Net Power and Light, Inc.
- Inventors: Stanislav Vonog; Nikolay Surin; Timur Iskhodzhanov; Vadim Shtayura
- Web page: https://patentgrep.com/patent/US20120254649A1

## CPC

- H04N 5/0736: {using digital storage buffer techniques}
- G06F 1/14: Time supervision arrangements, e.g. real time clock
- H04N 7/15: Conference systems
- H04J 3/0632: {Synchronisation of packets and cells, e.g. transmission of voice via a packet network, circuit emulation service [CES] (queuing arrangements in packet switching elements H04L49/90; synchronising systems for the synchronous transmission of a pulse code modulated video signal with one or more other pulse code modulated signals H04N7/56)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04J: MULTIPLEX COMMUNICATION (transmission in general H04B; peculiar to transmission of digital information H04L5/00; systems for the simultaneous or sequential transmission of more than one television signal H04N7/08; in exchanges H04Q11/00; stereophonic systems H04S)

## Abstract

Described are the architecture of such a system, algorithms for time synchronization during a multiway conferencing session, methods to fight with network imperfections such as jitter to improve synchronization, methods of introducing buffering delays to create handicaps for players with faster connections, methods which help players with synchronization (such as a synchronized metronome during a music conferencing session), methods for synchronized recording and live delivery of synchronized data to the audience watching the distributed interaction live over the Internet.

## Claims

### Claim 1

A computer implemented method for addressing jitter in an audio signal transmitted across a specific network, the method comprising:
receiving the audio signal;
storing data from the audio signal in a jitter buffer;
dynamically adjusting the size of the jitter buffer in order to address jitter in the specific network, the dynamically adjusting including:
analyzing latency spikes of the audio signal in the specific network;
determining that a given latency spike is beginning;
predicting characteristics of the given latency spike; and
changing the size of the jitter buffer according to the predicted characteristics of the given latency spike.

### Claim 2 (depends on 1)

A computer implemented method as recited in claim 1, further including synthesizing sound to play when the jitter buffer cannot provide playable audio signal.

### Claim 3 (depends on 1)

A computer implemented method as recited in claim 1, wherein latency statistics are analyzed for periods of about 1 minute to 5 minutes to determine the nature of spikes and calculate average jitter characteristics.

### Claim 4 (depends on 1)

A computer implemented method as recited in claim 1, wherein latency statistics are analyzed for one or more various periods, and spikes are classified into specific categories useful for predicting spike characteristics.

### Claim 5

A computer system addressing jitter in an audio signal received via a specific network, the computer system comprising:
means for receiving the audio signal;
means for storing data from the audio signal in a jitter buffer;
means for dynamically adjusting the size of the jitter buffer in order to address jitter in the specific network, the means for dynamically adjusting including:
means for analyzing latency spikes of the audio signal in the specific network;
means for determining that a given latency spike is beginning;
means for predicting characteristics of the given latency spike; and
means for changing the size of the jitter buffer according to the predicted characteristics of the given latency spike.

### Claim 6 (depends on 5)

A computer system as recited in claim 5, further including means for synthesizing sound to play when the jitter buffer cannot provide playable audio signal.

### Claim 7 (depends on 5)

A computer system as recited in claim 5, wherein latency statistics are analyzed for periods of about 1 minute to 5 minutes to determine the nature of spikes and calculate average jitter characteristics.

### Claim 8 (depends on 6)

A system as recited in claim 6, wherein latency statistics are analyzed for one or more various periods, and spikes are classified into specific categories useful for predicting spike characteristics.

### Claim 9

A computer system for addressing jitter in a specific signal transmitted across a specific network, the computer system comprising:
means for receiving a media signal;
means for storing data from the media signal in a jitter buffer; and
means for dynamically adjusting the jitter buffer in order to address jitter or jitter like effects in the specific network, said means for dynamically adjusting the jitter buffer including:
means for analyzing one or more characteristics of the media signal in the specific network; and
means for adjusting the jitter buffer according to analysis of the one or more characteristics of the media signal in the specific network.

### Claim 10

A computer implemented method for providing a distributed communication session involving synchronization of media signals transmitted across a network by devices coupled to the network, the method comprising:
receiving a given media signal, the given media signal transmitted by a given device associated with a given participant of a given distributed communication session, the given distributed communication session supported by a given network;
processing the given media signal;
storing data from the given media signal;
analyzing the given network;
predicting one or more characteristics of the specific network;
dynamically adjusting how data from the media signal is processed and/or stored; and
generating a localized media signal reflective of the given media signal.

### Claim 11 (depends on 10)

A computer implemented method as recited in claim 10, wherein the given media signal is an audio signal.

### Claim 12 (depends on 11)

A computer implemented method as recited in claim 11,
wherein storing data from the given media signal includes storing data from the audio signal in a jitter buffer; and
wherein dynamically adjusting how data from the given media signal is processed and/or stored includes dynamically adjusting the size of the jitter buffer in order to address jitter in the given network

### Claim 13 (depends on 12)

A computer implemented method as recited in claim 12, wherein dynamically adjusting the size of the jitter buffer in order to address jitter in the given network includes:
analyzing latency spikes of the audio signal in the given network;
determining that a given latency spike is beginning;
predicting characteristics of the given latency spike; and
changing the size of the jitter buffer according to the predicted characteristics of the given latency spike.

### Claim 14 (depends on 10)

A computer implemented method as recited in claim 10, wherein the media signal is a video signal.

### Claim 15 (depends on 10)

A computer implemented method as recited in claim 10, further including synthesizing sound to play when a playable audio signal isn't otherwise available.

### Claim 16 (depends on 10)

A computer, implemented method as recited in claim 10, wherein latency statistics are analyzed for periods of about 1 minute to 5 minutes to determine the nature of spikes and calculate average jitter characteristics.

### Claim 17 (depends on 10)

A computer implemented method as recited in claim 10, wherein latency statistics are analyzed for one or more various periods, and spikes are classified into specific categories useful for predicting spike characteristics.
