# US 2026/0181252 A1 · Methods and apparatus for re-stabilizing video in post-processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0181252 A1
- Document ID: US20260181252A1
- Status: Published application
- Kind: A1
- Application number: 19/388,052
- Filed: 2025-11-13
- Published: 2026-06-25
- Earliest claimed: 2021-10-01
- Assignees: GoPro, Inc.
- Applicants: GoPro, Inc.
- Inventors: Daryl Stimm; Andrew Russell; Robert McIntosh
- Web page: https://patentgrep.com/patent/US20260181252A1

## CPC

- H04N 23/683: {performed by a processor, e.g. controlling the readout of an image memory}
- H04N 7/0137: {dependent on presence/absence of motion, e.g. of motion zones (H04N7/014 takes precedence; movement detection in television signals H04N5/144)}
- H04N 23/6811: {based on the image signal}
- H04N 23/6812: {based on additional sensors, e.g. acceleration sensors}
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.). In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

## Claims

### Claim 1

(canceled)

### Claim 2

A method for post-processing video, comprising:
receiving a video file comprising a video track comprising video data and a margin data track comprising margin data associated with the video data;
reconstructing a set of previously stabilized images from the video data and the margin data; and
re-stabilizing the set of previously stabilized images creating re-stabilized video.

### Claim 3 (depends on 2)

The method of claim 2, further comprising receiving a designation of a frame of the video data as a keyframe, where re-stabilizing the set of previously stabilized images is based on the designation of the frame as the keyframe.

### Claim 4 (depends on 3)

The method of claim 3, where the designation of the frame of the video data is based on a user selection.

### Claim 5 (depends on 3)

The method of claim 3, where the keyframe indicates a fixed reference for inclusion during the re-stabilizing the previously stabilized images.

### Claim 6 (depends on 3)

The method of claim 3, further comprising receiving a second designation of a second frame of the video data as a second keyframe, where re-stabilizing the set of previously stabilized images is further based on the second designation of the second frame as the second keyframe.

### Claim 7 (depends on 2)

The method of claim 2, encoding the re-stabilized video creating encoded re-stabilized video, where re-stabilizing the set of previously stabilized images comprises incorporating at least a portion of the margin data in the re-stabilized video.

### Claim 8 (depends on 2)

The method of claim 2, where the video file further comprises a metadata track comprising orientation metadata associated with the video data.

### Claim 9 (depends on 8)

The method of claim 8, further comprising updating the metadata track based on determining at least one of an image orientation, a camera orientation, a gravity vector, an accelerometer value, and a gyroscope value.

### Claim 10 (depends on 8)

The method of claim 8, further comprising:
obtaining a captured trajectory of a camera from the metadata track; and
obtaining a designated trajectory of the video track from the metadata track.

### Claim 11 (depends on 10)

The method of claim 10, where re-stabilizing the set of previously stabilized images is based on a keyframe, the method further comprising updating the designated trajectory based on the keyframe.

### Claim 12

A camera apparatus, comprising:
a camera;
an orientation sensor;
a processor; and
a non-transitory computer-readable medium that stores instructions when executed by the processor, causes the camera apparatus to:
capture a video comprising a series of frames;
determine a plurality of camera orientations based on the orientation sensor for the series of frames;
crop the series of frames based on the plurality of camera orientations to create a cropped video having a designated view;
encode the cropped video within a video track of a video file; and
encode the plurality of camera orientations within an orientation metadata track of the video file.

### Claim 13 (depends on 12)

The camera apparatus of claim 12, where the instructions when executed by the processor, further causes the camera apparatus to determine a plurality of corresponding frame orientations to counteract the plurality of camera orientations for the series of frames.

### Claim 14 (depends on 12)

The camera apparatus of claim 12, where the instructions when executed by the processor, further causes the camera apparatus to receive a resolution selection for the designated view.

### Claim 15 (depends on 12)

The camera apparatus of claim 12, where the instructions when executed by the processor, further causes the camera apparatus to determine whether to encode the video file optimized for viewing on the camera apparatus or a separate display device.

### Claim 16 (depends on 15)

The camera apparatus of claim 15, where the instructions when executed by the processor, further causes the camera apparatus to:
determine to encode the video file optimized for viewing on the separate display device; and
send the video file to the separate display device for display.

### Claim 17 (depends on 15)

The camera apparatus of claim 15, where the instructions when executed by the processor, further causes the camera apparatus to:
determine to encode the video file optimized for viewing on the separate display device; and
send the video track to the separate display device for display.

### Claim 18

A camera-aware post-processing apparatus, comprising:
a processor; and
a non-transitory computer-readable medium that stores instructions which when executed by the processor, causes the camera-aware post-processing apparatus to:
obtain a video file comprising video data, margin data, and orientation metadata, the video data characterized by a first resolution;
reconstruct a set of previously stabilized frames from the video data and the margin data based on the orientation metadata; and
generate a re-stabilized video from the set of previously stabilized frames with a second resolution, the second resolution larger than the first resolution in at least one dimension.

### Claim 19 (depends on 18)

The camera-aware post-processing apparatus of claim 18, further comprising a codec configured to decode video files, where:
the instructions, when executed by the processor, cause the camera-aware post-processing apparatus to decode the video data from a video track of a multi-track video data structure, the margin data from a margin track of the multi-track video data structure, and the orientation metadata from an orientation track of the multi-track video data structure.

### Claim 20 (depends on 18)

The camera-aware post-processing apparatus of claim 18, where:
the orientation metadata comprises capture orientation metadata and stabilization orientation metadata, and
reconstructing the set of previously stabilized frames comprises manipulating the video data based on differences between the stabilization orientation metadata and the capture orientation metadata.

### Claim 21 (depends on 18)

The camera-aware post-processing apparatus of claim 18, where the instructions, when executed by the processor, cause the camera-aware post-processing apparatus to:
estimate motion between at least two frames of the set of previously stabilized frames using an optical flow technique, and
re-stabilize the set of previously stabilized frames based on the motion.
