# US 2014/0211028 A1 · Video Stabilization

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0211028 A1
- Document ID: US20140211028A1
- Status: Published application
- Kind: A1
- Application number: 14/242,512
- Filed: 2014-04-01
- Published: 2014-07-31
- Earliest claimed: 2011-05-31
- Assignees: Microsoft Corporation
- Applicants: Microsoft Corporation
- Inventors: Andrei Jefremov; David Yuheng Zhao; Pontus Carlsson
- Web page: https://patentgrep.com/patent/US20140211028A1

## CPC

- H04N 23/682: {Vibration or motion blur correction}
- H04N 23/6812: {based on additional sensors, e.g. acceleration sensors}
- H04N 23/683: {performed by a processor, e.g. controlling the readout of an image memory}
- H04N 25/443: by reading pixels from selected two-dimensional [2D] regions of the array, e.g. for windowing or digital zooming
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Method, device and computer program product for stabilizing a video signal. A plurality of frames of the video signal are captured using a camera. A motion sensor associated with the camera is used to generate a plurality of samples representing motion of the camera. The samples are used to determine a displacement of the camera between a first time and a second time, wherein the first time corresponds to an exposure time midpoint of a first frame of the video signal and the second time corresponds to an exposure time midpoint of a second frame of the video signal. The determined displacement is used to compensate for motion in the video signal between the first and second frames caused by the motion of the camera, to thereby stabilize the video signal.

## Claims

### Claim 1

A method of stabilizing a video signal, the method comprising:
capturing a plurality of frames of the video signal using a camera;
determining a pixel displacement representing motion in the video signal between first and second frames of the video signal caused by motion of the camera; and
shifting an image of at least one of the first and second frames in accordance with the pixel displacement to thereby stabilize the video signal, wherein the image comprises a stride value indicating memory space of the image, a plurality of pixel values, a pointer indicating the position of a first pixel of the image, and a width value indicating the width of the image, wherein said shifting of the image comprises adjusting the pointer and the width value without adjusting the stride value.

### Claim 2 (depends on 1)

The method of claim 1 wherein the image comprises a plurality of image planes which are each represented by a respective plurality of pixel values, a respective pointer indicating the position of a first pixel of the image plane, and a respective width value indicating the width of the image plane, wherein the image planes are shifted together by adjusting their respective pointers and width values without adjusting the stride value.

### Claim 3 (depends on 1)

The method of claim 1 further comprising rounding the determined pixel displacement to an integer-pixel displacement.

### Claim 4 (depends on 1)

The method of claim 1 further comprising:
using a motion sensor associated with the camera to generate a plurality of samples representing motion of the camera; and
using the samples to determine a displacement of the camera between a first frame of the video signal and a second frame of the video signal, wherein the determined displacement is used to determine said pixel displacement.

### Claim 5 (depends on 1)

The method of claim 1 further comprising filtering the pixel displacement.

### Claim 6 (depends on 1)

The method of claim 1 wherein the motion of the camera is rotational motion.

### Claim 7

A device configured to stabilize a video signal, the device comprising:
a camera configured to capture a plurality of frames of the video signal;
a pixel displacement determining block configured to determine a pixel displacement representing motion in the video signal between first and second frames of the video signal caused by motion of the camera; and
an image shifting block configured to shift an image of at least one of the first and second frames in accordance with the pixel displacement to thereby stabilize the video signal, wherein the image comprises a stride value indicating memory space of the image, a plurality of pixel values, a pointer indicating the position of a first pixel of the image, and a width value indicating the width of the image, wherein the image shifting block is configured to shift the image by adjusting the pointer and the width value without adjusting the stride value.

### Claim 8

A computer program product for stabilizing a video signal, the computer program product being embodied on a computer-readable medium and configured so as when executed on a processor of a device to perform the operations comprising:
capturing a plurality of frames of the video signal using a camera;
determining a pixel displacement representing motion in the video signal between first and second frames of the video signal caused by motion of the camera; and
shifting an image of at least one of the first and second frames in accordance with the pixel displacement to thereby stabilize the video signal, wherein the image comprises a stride value indicating memory space of the image, a plurality of pixel values, a pointer indicating the position of a first pixel of the image, and a width value indicating the width of the image, wherein said shifting of the image comprises adjusting the pointer and the width value without adjusting the stride value.

### Claim 9

A method of stabilizing a video signal, the method comprising:
capturing a plurality of frames of the video signal using a camera;
determining a portion of motion of the camera occurring whilst a shutter of the camera is closed and not whilst the shutter of the camera is open;
determining a pixel displacement representing motion in the video signal between first and second frames of the video signal caused by, and corresponding to, the portion of motion of the camera; and
shifting an image of at least one of the first and second frames in accordance with the pixel displacement to thereby stabilize the video signal.

### Claim 10 (depends on 9)

The method of claim 9 further comprising:
using a motion sensor associated with the camera to generate a plurality of samples representing the portion of motion of the camera; and
using the samples to determine a displacement of the camera between the first frame of the video signal and the second frame of the video signal, wherein the determined displacement is used to determine said pixel displacement.

### Claim 11 (depends on 10)

The method of claim 10 wherein the motion of the camera is rotational motion, the motion sensor is a rotational motion sensor and the displacement of the camera is an angular displacement of the camera.

### Claim 12 (depends on 9)

The method of claim 9 further comprising filtering the determined pixel displacement.

### Claim 13

A computer program product for stabilizing a video signal, the computer program product being embodied on a computer-readable medium and configured so as when executed on a processor of a device to perform the operations comprising:
capturing a plurality of frames of the video signal using a camera;
determining a portion of motion of the camera occurring whilst a shutter of the camera is closed and not whilst the shutter of the camera is open;
determining a pixel displacement representing motion in the video signal between first and second frames of the video signal caused by, and corresponding to, the portion of motion of the camera; and
shifting an image of at least one of the first and second frames in accordance with the pixel displacement to thereby stabilize the video signal.

### Claim 14 (depends on 13)

The computer program product of claim 13 further comprising:
using a motion sensor associated with the camera to generate a plurality of samples representing the portion of motion of the camera; and
using the samples to determine a displacement of the camera between the first frame of the video signal and the second frame of the video signal, wherein the determined displacement is used to determine said pixel displacement.

### Claim 15 (depends on 14)

The computer program product of claim 14 wherein the motion of the camera is rotational motion, the motion sensor is a rotational motion sensor and the displacement of the camera is an angular displacement of the camera.

### Claim 16 (depends on 13)

The computer program product of claim 13 further comprising filtering the determined pixel displacement.

### Claim 17

A device configured to stabilize a video signal, the device comprising:
a camera configured to capture a plurality of frames of the video signal;
a motion determining block configured to determine a portion of motion of the camera occurring whilst a shutter of the camera is closed and not whilst the shutter of the camera is open;
a pixel displacement determining block configured to determine a pixel displacement representing motion in the video signal between first and second frames of the video signal caused by, and corresponding to, the portion of motion of the camera; and
an image shifting block configured to shift an image of at least one of the first and second frames in accordance with the pixel displacement to thereby stabilize the video signal.

### Claim 18 (depends on 17)

The device of claim 17 further comprising:
a motion sensor associated with the camera to generate a plurality of samples representing the portion of motion of the camera; and
the device being configured to determine a displacement of the camera between the first frame of the video signal and the second frame of the video signal, wherein the determined displacement is used to determine said pixel displacement.

### Claim 19 (depends on 18)

The device of claim 18 wherein the motion of the camera is rotational motion, the motion sensor is a rotational motion sensor and the displacement of the camera is an angular displacement of the camera.

### Claim 20 (depends on 17)

The device of claim 17 further comprising a filter to filter the determined pixel displacement.
