Method, apparatus and system of synchronizing audio with video
AssigneeTencent Technology (Shenzhen) Company Limited
InventorJiawen Huang
Life of this patent
Estimating the term…
Abstract
The present disclosure provides a method, apparatus and a system of synchronizing audio with video. A receiving device receives a video signal embedded with a video sync signal and an audio signal embedded with an audio sync signal provided by a sending device; searches for the video sync signal in the video signal, searches for the audio sync signal in the audio signal; and processes the video signal and the audio signal according to a time when the video sync signal occurs in the video signal and a time when the audio sync signal occurs in the audio signal to make the processed audio signal synchronized with the processed video signal during playback.
Claims20
A method of synchronizing audio with video, comprising:
- receiving, by a receiving device, a video signal embedded with a video sync signal and an audio signal embedded with an audio sync signal provided by a sending device, the video sync signal is embedded in the video signal by setting a value of a pixel at a pre-determined position in a video frame of the video signal to be a value corresponding to a value of the video sync signal or setting a pixel with a pre-determined value to be at a position corresponding to a value of the video sync signal in a video frame of the video signal;
- extracting the video sync signal from the video signal by mapping one of the following to a value of the video sync signal:
- a value of a pixel at the pre-determined position of a video frame, or
- a relation between positions of at least two pixels each having a pre-determined value in a video frame, or
- a relation between positions of a pixel having a pre-determined value in at least two video frames;
- extracting the audio sync signal from the audio signal;
- obtaining a time difference by comparing the video sync signal with the audio sync signal;
- and
- processing the video signal and the audio signal according to the time difference to have the processed audio signal synchronized with the processed video signal during playback.
An apparatus of synchronizing audio with video, comprising a processor and a memory storing computer-executable instructions that, when executed by the processor, cause the processor to:
- receive a video signal embedded with a video sync signal and an audio signal embedded with an audio sync signal provided by a sending device, the video sync signal is embedded in the video signal by setting a value of a pixel at a pre-determined position in a video frame of the video signal to be a value corresponding to a value of the video sync signal or by setting a pixel with a pre-determined value to be at a position corresponding to a value of the video sync signal in a video frame of the video signal;
- extract the video sync signal from the video signal by mapping one of the following to a value of the video sync signal:
- a value of a pixel at the pre-determined position of a video frame, or
- a relation between positions of at least two pixels each having a pre-determined value in a video frame, or
- a relation between positions of a pixel having a pre-determined value in at least two video frames;
- extract the audio sync signal from the audio signal;
- obtain a time difference by comparing the video sync signal with the audio sync signal;
- and
- process the video signal and the audio signal according to the time difference.
A non-transitory computer-readable storage medium, storing instructions executable by at least one processor to:
- receive a video signal embedded with a video sync signal and an audio signal embedded with an audio sync signal provided by a sending device, the video sync signal is embedded in the video signal by setting a value of a pixel at a pre-determined position in a video frame of the video signal to be a value corresponding to a value of the video sync signal or by setting a pixel with a pre-determined value to be at a position corresponding to a value of the video sync signal in a video frame of the video signal;
- extract the video sync signal from the video signal by mapping one of the following to a value of the video sync signal:
- a value of a pixel at the pre-determined position of a video frame, or
- a relation between positions of at least two pixels each having a pre-determined value in a video frame, or
- a relation between positions of a pixel having a pre-determined value in at least two video frames;
- extract the audio sync signal from the audio signal;
- obtain a time difference by comparing the video sync signal with the audio sync signal;
- and
- process the video signal and the audio signal according to the time difference.
Dependencies are inferred from the claim text.