Playback system for synchronizing audiovisual works
AssigneeJammit, Inc.
InventorScott Humphrey
Life of this patent
Estimating the term…
Abstract
A playback system is provided for altering the frame rate of streaming digital movie data for synchronizing with audio data recording to create a synchronized audiovisual work. The system can have a video that is synchronized with the variations in the tempo of the audio data through a variable timing reference track designed and provided for a user, wherein the designing of the variable timing reference track includes creating a tempo map having variable tempos, rhythms, and beats using notes from the audio data.
Claims18
A playback system for altering the frame rate of streaming digital movie data for synchronizing with an audio data recording to create a synchronized audiovisual work, the system comprising:
- a processor;
- a memory on a non-transitory computer readable medium that includes
- a video display module on a non-transitory computer readable medium operable for displaying digital video at a variable rate;
- an output module on a non-transitory computer readable medium operable for transmitting audio data to an output device;
- a timing error module on a non-transitory computer readable medium operable for (i) determining a timing error between a time stamp and a next time stamp, (ii) adjusting the video presentation rate, and (iii) assessing the timing error periodically and adjusting the presentation rate so that the actual timing error is minimal and unnoticeable;
- the playback system operable for creating and displaying the synchronized audiovisual work that includes
- the audio data recording of an isolated audio track having (i) a plurality of audio tracks, the audio data recording having variable tempos, rhythms, and beats;
- the audio data recording having an array of audio time samples that include (ii) an audio synchronization start time;
- (iii) an audio synchronization stop time;
- and, (iv) an audio duration in the array of audio time samples;
- a custom tempo map that is configured (i) to correspond with the variable tempos, rhythms, and beats of the audio data recording, and (ii) to include a mapping of the space between musical notes in the isolated audio track to determine the beats per minute of each bar of music in the isolated audio track for the preselected piece of music;
- and,
- a digital movie data recording synchronized to the audio data recording;
- the digital movie data recording having array of video time samples that include (ii) a video synchronization start time;
- (iii) a video synchronization stop time;
- and, (iv) an audio duration in the array of audio time samples;
- the video synchronization start time coincident in time with the audio synchronization start time, the video synchronization stop time coincident in time with the audio synchronization stop time, and the array of video time samples synchronized with the array of audio time samples for the duration of each using the custom tempo map to configure the synchronized audiovisual work;
- wherein,
- the audio data recording, the digital movie data recording, and the custom tempo map are each stored on a non-transitory computer readable medium;
- the audio data recording is synchronized to the digital movie data recording by the processor with instructions for aligning the array of audio time samples with the array of video time samples, the synchronizing including
- assessing the synchronization of a video time sample in the array of video time samples to a corresponding audio time sample in the array of audio time samples to determine the timing error between the video time sample and the audio time sample using the custom tempo map;
- and,
- adjusting a video presentation rate measured between the video time sample and the next video time sample in the array of video time samples, such that the timing error is unnoticeable.
Dependencies are inferred from the claim text.