Back to results
US 8,284,266 B2Granted
Method and apparatus providing motion smoothing in a video stabilization system
AssigneeAptina Imaging Corporation
InventorYining Deng
Life of this patent
Estimating the term…
Abstract
A method and apparatus for smoothing an image in a plurality of video frames consisting of a current frame and at least one previous frame. The position of at least one pixel in each of the plurality of frames is determined to provide respective determined positions. An adjusted position of the at least one pixel in the current frame is calculated based on the determined positions.
Claims24
A method comprising:
- determining, with an image processor, a position of at least one pixel in each of a first plurality of video frames that includes a current frame and at least one previous frame to provide respective determined positions;
- and
- calculating, with the image processor, an adjusted position of the at least one pixel in the current frame based on the determined positions, wherein the step of calculating the adjusted position includes calculating the adjusted position of the at least one pixel in the current frame having buffer pixels along edges of the current frame to accommodate a difference between the determined position in the current frame and the adjusted position.
A method comprising:
- determining, with an image processor, a position of at least one pixel in each of a first plurality of video frames that includes a current frame and at least one previous frame to provide respective determined positions;
- and
- calculating, with the image processor, an adjusted position of the at least one pixel in the current frame based on the determined positions, wherein the step of calculating the adjusted position includes:
- averaging, with the image processor, the determined positions to provide an average position of the at least one pixel;
- calculating, with the image processor, a first compensation value based on a difference between a first determined position of the at least one pixel in the current frame and the average position;
- and
- combining, with the image processor, the first determined position with the first compensation value to provide the adjusted position.
4 more elements
A method comprising:
- determining, with an image processor, a position of at least one pixel in each of a first plurality of video frames that includes a current frame and at least one previous frame to provide respective determined positions;
- calculating, with the image processor, an adjusted position of the at least one pixel in the current frame based on the determined positions, wherein the step of calculating the adjusted position includes representing the determined positions using respective polynomials, estimating coefficients of the polynomials based on the determined positions, and calculating the adjusted position based on the estimated coefficients;
- and
- smoothing motion between the current frame and the at least one previous frame for video stabilization by adjusting the position of the at least one pixel to the adjusted position.
1 more element
An image processing apparatus comprising:
- an image sensor for detecting an image and outputting image signals corresponding to the detected image;
- and
- an image processor for processing the image signals outputted from the image sensor, the image processor configured to perform a plurality of operations including:
- determining a position of at least one pixel in each of a first plurality of video frames that includes a current frame and at least one previous frame to provide respective determined positions;
- calculating an adjusted position of the at least one pixel in the current frame based on the determined positions;
- averaging the determined positions to provide an average position of the at least one pixel;
- calculating a first compensation value based on a difference between a first determined position of the at least one pixel in the current frame and the average position;
- and
- combining the first determined position with the first compensation value to provide the adjusted position.
6 more elements
An image processing apparatus comprising:
- an image sensor for detecting an image and outputting image signals corresponding to the detected image;
- and
- an image processor for processing the image signals outputted from the image sensor, the image processor configured to perform a plurality of operations including:
- determining a position of at least one pixel in each of a first plurality of video frames that includes a current frame and at least one previous frame to provide respective determined positions;
- calculating an adjusted position of the at least one pixel in the current frame based on the determined positions;
- representing the determined positions using respective polynomials;
- estimating coefficients of the polynomials based on the determined positions;
- calculating the adjusted position based on the estimated coefficients;
- and
- smoothing motion between the current frame and the at least one previous frame for video stabilization by adjusting the position of the at least one pixel to the adjusted position.
7 more elements
An image processing apparatus comprising:
- an image sensor for detecting an image and outputting image signals corresponding to the detected image;
- and
- an image processor for processing the image signals outputted from the image sensor, the image processor configured to perform a plurality of operations including:
- determining a position of at least one pixel in each of a first plurality of video frames that includes a current frame and at least one previous frame to provide respective determined positions;
- and
- calculating an adjusted position of the at least one pixel in the current frame based on the determined positions, wherein the image processing apparatus is part of a video camera.
3 more elements
A processing system, comprising:
- a processor for receiving and processing frames of image data, said processor being configured to perform a plurality of operations including:
- determine a position of at least one pixel in each of a first plurality of video frames that consists of a current frame and at least one previous frame to provide respective determined positions,
- calculate an adjusted position of the at least one pixel in the current frame based on the determined positions,
- average the determined positions to provide an average position of the at least one pixel,
- calculate a first compensation value based on a difference between a first determined position of the at least one pixel in the current frame and the average position, and
- combine the first determined position with the first compensation value to provide the adjusted position.
3 more elements
A processing system, comprising:
- a processor for receiving and processing frames of image data, said processor being configured to perform a plurality of operations including:
- determine a position of at least one pixel in each of a first plurality of video frames that consists of a current frame and at least one previous frame to provide respective determined positions;
- calculate an adjusted position of the at least one pixel in the current frame based on the determined positions;
- represent the determined positions using respective polynomials;
- estimate coefficients of the polynomials based on the determined positions;
- and
- calculate the adjusted position based on the estimated coefficients;
- and
- smooth motion between the current frame and the at least one previous frame for video stabilization by adjusting the position of the at least one pixel to the adjusted position.
6 more elements
Dependencies are inferred from the claim text.