Accelerometer / gyro-facilitated video stabilization
AssigneeApple Inc.
InventorsYuxin LIU, Xiaojin SHI, James Oliver NORMILE, Hsi-Jung WU
Life of this patent
Estimating the term…
Abstract
Embodiments of the present invention provide a control system for video processes that selectively control the operation of motion stabilization processes. According to the present invention, motion sensor data indicative of motion of a mobile device may be received and processed. A determination may be made by comparing processed motion sensor data to a threshold. Based on the determination, motion stabilization may be suspended on select portions of a captured video sequence.
Claims20
A video processing method, comprising:
- capturing video via a camera to generate a captured video sequence,
- aggregating motion sample data from a motion detection device over the period of each frame in the captured video sequence,
- comparing the aggregated motion data to a threshold, and
- identifying, based on the comparison, portions of the captured video sequence that represent a scene change, and
- performing video stabilization on portions of the captured video sequence that are outside the scene change.
A video processing method, comprising:
- estimating motion of a camera device based on motion sample data from a camera motion detector,
- comparing the estimated motion to a threshold, and
- for each frame in a captured video sequence, performing video stabilization on the video sequence if the motion comparisons are below the threshold both for the respective frame and for a predetermined number of frames prior to the respective frame.
A video processing method, comprising:
- estimating motion of a camera device based on motion sample data from a camera motion detector,
- comparing the estimated motion to a threshold, and
- when the estimated motion crosses the threshold, determining if the estimated motion remains on a crossed side of the threshold for a predetermined number of frames, and
- if so, changing operational state of a video stabilization process respectively between an enabled state and a disabled state.
Control apparatus for a video stabilization processor comprising:
- a motion detector processor to generate estimated motion of a camera based on motion sample data received from a motion sensor,
- a scene change detector to compare the estimated camera motion to a threshold and to identify scene changes within portions of a captured video sequence based on the comparison, and
- a video stabilization unit selectively enabled or disabled based on the identification from the scene change detector.
Computer readable medium storing program instructions that, when executed by a processor, cause the processor to:
- estimate motion of a camera device based on motion sample data from a camera motion detector,
- compare the estimated motion to a threshold, and
- for each frame in a captured video sequence, perform a video stabilization process on the video sequence if the motion comparisons are below the threshold both for the respective frame and for a predetermined number of frames prior to the respective frame.
Dependencies are inferred from the claim text.