# US 2013/0155264 A1 · Motion sensor based virtual tripod method for video stabilization

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0155264 A1
- Document ID: US20130155264A1
- Status: Published application
- Kind: A1
- Application number: 13/327,487
- Filed: 2011-12-15
- Published: 2013-06-20
- Earliest claimed: 2011-12-15
- Assignees: Apple Inc.
- Inventors: Jianping Zhou
- Web page: https://patentgrep.com/patent/US20130155264A1

## CPC

- H04N 23/6812: {based on additional sensors, e.g. acceleration sensors}
- H04N 23/683: {performed by a processor, e.g. controlling the readout of an image memory}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An apparatus, method, and computer-readable medium for motion sensor-based video stabilization. A motion sensor may capture motion data of a video sequence. A controller may compute average motion data of the camera used to capture the video sequence based on motion data from the motion sensor. The controller may then determine the difference between the actual camera motion and the average camera motion to set a video stabilization strength parameter for the frames in the video sequence. A video stabilization unit may utilize the strength parameter to stabilize the frames in the video sequence.

## Claims

### Claim 1

A video stabilization method, comprising, for a frame within a video sequence:
responsive to motion sensor data associated with the video sequence:
computing average motion of a camera, during a capture period about the frame;
determining a difference between actual camera motion for the frame and the average camera motion;
setting a video stabilization strength parameter for the frame based on the difference value of the respective frame; and
performing video stabilization on the frame according to the frame's strength parameter.

### Claim 2 (depends on 1)

The method of claim 1, wherein the video stabilization strength parameter is set to:
a high strength value when the difference value of the respective frame is below a first threshold,
a low strength value when the difference value of the respective frame is above a second threshold, and
an intermediate value between the high and low strength value when the difference value of the respective frame is above the first threshold and below the second threshold.

### Claim 3 (depends on 1)

The method of claim 1, wherein the motion sensor data is derived from gyroscopic sensor data.

### Claim 4 (depends on 1)

The method of claim 1, wherein the motion sensor data is derived from accelerometer sensor data.

### Claim 5 (depends on 1)

The method of claim 1, wherein the motion sensor data is rotational data.

### Claim 6 (depends on 1)

The method of claim 1, wherein computing the average motion includes filtering the motion sensor data.

### Claim 7 (depends on 1)

The method of claim 1, wherein the camera is a portable electronic device.

### Claim 8 (depends on 2)

The method of claim 2, wherein the intermediate value is based on a function of the difference value for the frame.

### Claim 9

A physical computer-readable medium embodied with computer-executable instructions for causing a computer to execute instructions, the computer instructions comprising:
computing average motion of a camera from motion sensor data associated with a video sequence, wherein the average motion is computed during a capture period about a frame in the video sequence;
determining a difference between actual camera motion for the frame and the average camera motion;
setting a video stabilization strength parameter for the frame based on the difference value of the respective frame; and
performing video stabilization on the frame according to the frame's strength parameter.

### Claim 10 (depends on 9)

The physical computer-readable medium of claim 9, wherein the video stabilization strength parameter is set to:
a high strength value when the difference value of the respective frame is below a first threshold,
a low strength value when the difference value of the respective frame is above a second threshold, and
an intermediate value between the high and low strength value when the difference value of the respective frame is above the first threshold and below the second threshold.

### Claim 11 (depends on 9)

The physical computer-readable medium of claim 9, wherein the motion sensor data is derived from gyroscopic sensor data.

### Claim 12 (depends on 9)

The physical computer-readable medium of claim 9, wherein the motion sensor data is derived from accelerometer sensor data.

### Claim 13 (depends on 9)

The physical computer-readable medium of claim 9, wherein the motion sensor data is rotational data.

### Claim 14 (depends on 9)

The physical computer-readable medium of claim 9, wherein computing the average motion includes filtering the motion sensor data.

### Claim 15 (depends on 9)

The physical computer-readable medium of claim 9, wherein the camera is a portable electronic device.

### Claim 16 (depends on 10)

The physical computer-readable medium of claim 10, wherein the intermediate value is based on a function of the difference value for the frame.

### Claim 17

An apparatus comprising:
a processor for executing computer instructions, the computer instructions causing the processor to:
responsive to motion sensor data associated with a video sequence:
compute average motion of a camera, during a capture period about a frame within the video sequence;
determine a difference between actual camera motion for the frame and the average camera motion;
set a video stabilization strength parameter for the frame based on the difference value of the respective frame; and
perform video stabilization on the frame according to the frame's strength parameter.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein the video stabilization strength parameter is set to:
a high strength value when the difference value of the respective frame is below a first threshold,
a low strength value when the difference value of the respective frame is above a second threshold, and
an intermediate value between the high and low strength value when the difference value of the respective frame is above the first threshold and below the second threshold.

### Claim 19 (depends on 17)

The apparatus of claim 17, wherein the motion sensor data is derived from gyroscopic sensor data.

### Claim 20 (depends on 17)

The apparatus of claim 17, wherein the motion sensor data is derived from accelerometer sensor data.

### Claim 21 (depends on 17)

The apparatus of claim 17, wherein the motion sensor data is rotational data.

### Claim 22 (depends on 17)

The apparatus of claim 17, wherein computing the average motion includes filtering the motion sensor data.

### Claim 23 (depends on 17)

The apparatus of claim 17, wherein the camera is a portable electronic device.

### Claim 24 (depends on 18)

The apparatus of claim 18, wherein the intermediate value is based on a function of the difference value for the frame.

### Claim 25

An apparatus comprising:
a camera to capture a video sequence;
a motion sensor to capture motion data associated with the video sequence;
a controller to:
compute average motion of the camera, during a capture period about a frame within the video sequence,
determine a difference between actual camera motion for the frame and the average camera motion, and
set a video stabilization strength parameter for the frame based on the difference value of the respective frame; and
a video stabilization unit to perform video stabilization on the frame according to the frame's strength parameter.

### Claim 26 (depends on 25)

The apparatus of claim 25, wherein the video stabilization strength parameter is set to:
a high strength value when the difference value of the respective frame is below a first threshold,
a low strength value when the difference value of the respective frame is above a second threshold, and
an intermediate value between the high and low strength value when the difference value of the respective frame is above the first threshold and below the second threshold.

### Claim 27 (depends on 26)

The apparatus of claim 26, wherein the intermediate value is based on a function of the difference value for the frame.

### Claim 28

A physical storage medium storing video data generated according to a process comprising:
capturing video data with a camera,
capturing motion sensor data with a motion sensor,
processing the video data with a processor by:
computing, from the motion sensor data, average motion of a camera during a capture period about a frame from the video data;
determining a difference between actual camera motion for the frame and the average camera motion;
setting a video stabilization strength parameter for the frame based on the difference value of the respective frame;
performing video stabilization on the frame according to the frame's strength parameter; and
storing the stabilized video data on the storage medium.
