# US 2020/0403893 A1 · Method to determine a propagation delay of a multimedia stream of a video conference communication system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0403893 A1
- Document ID: US20200403893A1
- Status: Published application
- Kind: A1
- Application number: 16/450,451
- Filed: 2019-06-24
- Published: 2020-12-24
- Earliest claimed: 2019-06-24
- Assignees: Topica Holding Pte. Ltd
- Applicants: Topica Holding Pte. Ltd
- Inventors: Tran Minh SON; Luu Quoc TUAN; Bui Thank KHIET
- Web page: https://patentgrep.com/patent/US20200403893A1

## CPC

- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- H04L 43/028: by filtering
- H04L 43/0852: Delays
- H04L 43/0858: {One way delays}
- H04L 43/106: using time related information in packets, e.g. by adding timestamps
- H04L 65/1083: In-session procedures
- H04L 65/765: {intermediate}
- H04L 65/80: Responding to QoS
- H04N 7/141: {between two video terminals, e.g. videophone (telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085)}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 21/23892: {involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level}
- H04N 21/242: Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N 21/8547: involving timestamps for synchronizing content
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video conference method and system to determine a propagation delay of a multimedia stream of a video conference communication system, the multimedia stream having a first format, the method including: obtaining an emission time, converting the emission time into a multimedia component, inserting the multimedia component into the multimedia stream at the emission side while keeping the same first format, detecting the inserted multimedia component at the reception side, retrieving from the multimedia component the emission time, obtaining a current reception time, and calculating the propagation delay by the time difference between the emission time and the current reception time.

## Claims

### Claim 1

A method to determine a propagation delay of a multimedia stream of a video conference communication system, said multimedia stream having a first format, said method comprising:
obtaining an emission time;
converting the emission time into a multimedia component;
inserting the multimedia component into the multimedia stream at the emission side while keeping a same first format;
detecting the inserted multimedia component at the reception side;
retrieving from the multimedia component the emission time;
obtaining a current reception time; and
calculating the propagation delay by determining the time difference between the emission time and the current reception time.

### Claim 2 (depends on 1)

The method of claim 1, wherein the said multimedia stream comprises an audio and video stream, said multimedia component being embedded into the said video stream;
said detecting step comprising analyzing the video stream in order to detect the presence of the multimedia component in at least one of the images;
said retrieving step comprising analyzing all or part of the multimedia component to retrieve the emission time.

### Claim 3 (depends on 2)

The method of claim 2 further comprising:
updating the multimedia component with an updated emission time, said updated emission time being in advance compared with the emission time previously inserted into the multimedia stream;
inserting the updated multimedia component into the multimedia stream; and
at the reception side, calculating a second propagation time based on the updated multimedia component.

### Claim 4 (depends on 3)

The method of claim 3, wherein the multimedia component is inserted into the video stream as a text exhibiting the emission time, said text being updated to follow the emission time.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
determining a first processing delay between the time of obtaining the emission time and the time of inserting the multimedia component; and
removing from the calculated propagation delay the first processing delay.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
determining a second processing delay corresponding to the time to detect and retrieve the emission time from the multimedia stream; and
removing from the calculated propagation delay the second processing delay.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
determining a third processing delay corresponding to the time to obtain the current reception time; and
removing from the calculated propagation delay the third processing delay.

### Claim 8 (depends on 2)

The method of claim 2, wherein the multimedia component is a visible or invisible watermark embedded into all or some video frame in the video stream, the watermark comprising the emission time.

### Claim 9 (depends on 1)

The method of claim 1, wherein the multimedia component is a QR code inserted into the video stream, the QR code comprising the emission time.

### Claim 10 (depends on 1)

The method of claim 1, wherein the multimedia component is an audio pattern embedded into the audio stream, the audio pattern comprising the emission time.

### Claim 11 (depends on 1)

The method of claim 1, wherein the multimedia component is an imperceptible audio watermark embedded into the audio stream, the audio watermark comprising the emission time.

### Claim 12 (depends on 1)

The method of claim 1, wherein the multimedia stream is a synchronized metadata stream carrying information for the video conference, said multimedia component is a special metadata unit of said synchronized metadata stream, said special metadata unit being mapped identically to the emission time; and
said obtaining step comprising inverse mapping the special metadata unit back to the emission time.

### Claim 13 (depends on 1)

The method of claim 1, wherein said synchronized metadata stream carries the spatial position of mouse clicks on a whiteboard shared during the video conference, said special metadata unit being a series of spatial positions corresponding to Morse coded symbols representing the emission time; and
said obtaining operation being the Morse decoding process to read the emission time.

### Claim 14 (depends on 1)

The method of claim 1, wherein when the propagation delay exceeds a predefined threshold, triggering an alarm via any online or offline information transmitting system.

### Claim 15 (depends on 14)

The method of claim 14, wherein said online information transmitting system is the FACEBOOK™ messenger system.

### Claim 16 (depends on 14)

The method of claim 14, wherein said offline information transmitting system is an e-mail system.

### Claim 17

A receiving device configured to receive a video conferencing stream comprising at least an audio and a video stream, said audio or video stream comprising a multimedia component exhibiting the time of the emission in at least a portion of said stream, said receiving device comprising an analyzer to extract the multimedia component from the portion of the stream and to recover the emission time, the receiving device further comprising a reference time seeker to fetch the current time and calculator to determine a propagation time of the stream by subtracting the current time from the emission time.

### Claim 18 (depends on 17)

The receiving device of claim 17, wherein the multimedia component is part of the audio stream, said analyzer being configured to extract the audio component from the audio stream to recover the emission time from the audio component.

### Claim 19 (depends on 17)

The receiving device of claim 17, wherein the multimedia component is part of the video stream, said analyzer being configured to extract the video component and convert the video component into the emission time.

### Claim 20 (depends on 19)

The receiving device of claim 19, wherein the video component is a QR code or a barcode, said QR code or barcode embedding the emission time, said analyzer being configured to convert the QR code or barcode into plain data representing the emission time.
