Automatic synchronization of media clips
AssigneeApple Inc.
InventorsAaron M. Eppolito, Iroro F. Orife
Life of this patent
Estimating the term…
Abstract
For media clips captured by several media recording devices, a novel method for organizing the captured media clips is presented. The method arranges the media clips into sequences according to content data associated with the media clips. The method further analyzes content data of the media clips in each sequence to identify a best candidate media clip from each sequence. The method performs one or more algorithms to determine whether the candidate media clips are related. The algorithms are also used to determine a time offset between the candidate clips. The method then synchronizes the sequences based on the time offset determined by the algorithms.
Claims31
A method of organizing media clips captured by two media recording devices, the method comprising:
- arranging a plurality of media clip files into a first sequence of media clip files and a second sequence of media clip files, wherein media clip files are sorted into the first sequence based on recording device identifying data in the media clip files identifying a first recording device used to capture the media clip files of the first sequence during a first plurality of recording sessions, wherein media clip files are sorted into the second sequence based on recording device identifying data in the media clip files identifying a second recording device used to capture the media clip files of the second sequence during a second plurality of recording sessions, and wherein the media clip files in each sequence are spaced apart from each other by respective non-zero actual elapsed time between a stoppage of one recording session and a start of a next recording session;
- performing pre-processing operations on the media clip files, the pre-processing operations comprising one of filtering out noise, applying equalization to target specific frequencies, normalizing balance levels, and applying dynamics processing to balance levels;
- analyzing content data of the media clip files in the first sequence and the second sequence to identify a pair of candidate media clip files in the sequences that temporally overlap;
- analyzing the candidate media clip files to determine a time offset between the candidate media clip files;
- and
- applying the time offset to shift all of the media clip files in the first sequence in relation to the media clip files in the second sequence.
A method of organizing media clips, the method comprising:
- importing a plurality of media clip files captured by a plurality of media recording devices during a particular timeframe;
- and
- performing an automated process comprising:
- arranging the plurality of media clip files into a first sequence of media clip files and a second sequence of media clip files, wherein media clip files are sorted into the first sequence based on recording device identifying data in the media clip files identifying a first media recording device used to capture the media clip files of the first sequence during a first plurality of recording sessions during the particular timeframe, wherein media clip files are sorted into the second sequence based on recording device identifying data in the media clip files identifying a second media recording device used to capture the media clip files of the second sequence during a second plurality of recording sessions during the particular timeframe, and wherein the media clip files in each sequence are spaced apart from each other by respective non-zero actual elapsed time between a stoppage of one recording session and a start of a next recording;
- performing pre-processing operations on the media clip files, the pre-processing operations comprising one of filtering out noise, applying equalization to target specific frequencies, normalizing balance levels, and applying dynamics processing to balance levels;
- analyzing content data of the media clip files to group media clip files that temporally overlap, wherein each media clip file in a group is from a different sequence;
- and
- placing the groups of media clip files in an order based on instances in time during the particular timeframe at which the media clip files were captured.
A method of organizing media clip files captured by a recording device, the method comprising:
- arranging a plurality of media clip files into a first sequence of media clip files and a second sequence of media clip files, wherein media clip files are sorted into the first sequence based on recording device identifying data in the media clip files identifying a first media recording device used to capture the media clip files of the first sequence during a first plurality of recording sessions during the particular timeframe, wherein media clip files are sorted into the second sequence based on recording device identifying data in the media clip files identifying a second media recording device used to capture the media clip files of the second sequence during a second plurality of recording sessions during the particular timeframe, and wherein the media clip files in each sequence are spaced apart from each other by respective non-zero actual elapsed time between a stoppage of one recording session and a start of a next recording session;
- performing pre-processing operations on the media clip files, the pre-processing operations comprising one of filtering out noise, applying equalization to target specific frequencies, normalizing balance levels, and applying dynamics processing to balance levels;
- determining a time offset between the first sequence and the second sequence by comparing audio content of a first media clip file from the first sequence to audio content of a plurality of media clip files from the second sequence;
- applying the time offset to shift all of the media clip files in the first sequence in relation to the media clip files in the second sequence;
- and
- merging media clip files from the first and second sequences determined to be temporally overlapping.
A non-transitory computer readable medium storing a computer program which when executed by at least one processor organizes media clip files captured by a plurality of media recording devices, the computer program comprising sets of instructions for:
- arranging a plurality of media clip files into a first sequence of media clip files and a second sequence of media clip files, wherein media clip files are sorted into the first sequence based on recording device identifying data in the media clip files identifying a first recording device used to capture the media clip files of the first sequence during a first plurality of recording sessions, wherein media clip files are sorted into the second sequence based on recording device identifying data in the media clip files identifying a second recording device used to capture the media clip files of the second sequence during a second plurality of recording sessions, and wherein the media clip files in each sequence are spaced apart from each other by respective non-zero actual elapsed time between a stoppage of one recording session and a start of a next recording session;
- performing pre-processing operations on the media clip files, the pre-processing operations comprising one of filtering out noise, applying equalization to target specific frequencies, normalizing balance levels, and applying dynamics processing to balance levels;
- analyzing content date of the media clip files in the first sequence and the second sequence to identify a pair of candidate media clip file in the sequences that temporally overlap;
- analyzing the candidate media clip files to determine a time offset between the candidate clip files;
- and
- applying the time offset to shift all of the media clip files in the first sequence in relation to the media clip files in the second.
A non-transitory computer readable medium storing a computer program which when executed by at least one processor organizes media clip files, the computer program comprising sets of instructions for:
- arranging a plurality of media clip files into a first sequence of media clip files and a second sequence of media clip files, wherein media clip files are sorted into the first sequence based on recording device identifying data in the media clip files identifying a first recording device used to capture the media clip files of the first sequence during a first plurality of recording sessions, wherein media clip files are sorted into the second sequence based on recording device identifying data in the media clip files identifying a second recording device used to capture the media clip files of the second sequence during a second plurality of recording sessions, and wherein the media clip files in each sequence are spaced apart from each other by respective non-zero actual elapsed time between a stoppage of one recording session and a start of a next recording session;
- performing pre-processing operations on the media clip files, the pre-processing operations comprising one of filtering out noise, applying equalization to target specific frequencies, normalizing balance levels, and applying dynamics processing to balance levels;
- determining a time offset between the first sequence and the second sequence by comparing audio content of a first media clip file from the first sequence to audio content of a plurality of media clip files from the second sequence;
- applying the time offset to shift all of the media clip files in the first sequence in relation to the media clip files in the second sequence;
- and
- merging media clip files from the first and second sequences determined to be temporally overlapping.
Dependencies are inferred from the claim text.