Analyzing camera captured video for key frames

A method of analyzing a digital video clip captured by a camera to determine key frames, comprising:

• a. providing a camera motion sensor, including an accelerometer or a lens motor sensor, in the camera so that information is provided during image capture regarding camera motion including translation of the scene or camera, or scaling of the scene;
• b. forming a plurality of video segments based on the camera motion information and labeling each segment in accordance with a predetermined series of camera motion classes;
• and
• c. extracting key frame candidates from the labeled segments and computing a confidence score for each candidate by using rules corresponding to each camera motion class and a rule corresponding to object motion.
• d. selecting key frames from the candidate frames based on the confidence score of each candidate.