Back to results
US 10,432,864 B1Granted
Systems and methods for stabilizing videos
AssigneeGoPro, Inc.
InventorsCesar Douady, Thomas Derbanne, Maxim Karpushin
Life of this patent
Estimating the term…
Abstract
Visual content is captured by an image capture device during a capture duration. The image capture devices experiences change in position during the capture duration. The trajectory of the image capture device is smoothed based on a look ahead of the trajectory. A punchout of the visual content is determined based on the smoothed trajectory. The punchout of the visual content is used to generate stabilized visual content.
Claims20
An image capture system that stabilizes videos, the image capture system comprising:
- a housing;
- an optical element carried by the housing and configured to guide light within a field of view to an image sensor;
- the image sensor carried by the housing and configured to generate a visual output signal conveying visual information based on light that becomes incident thereon during a capture duration, the visual information defining visual content having the field of view;
- a position sensor carried by the housing and configured to generate a position output signal based on positions of the housing during the capture duration, the position output signal conveying position information that characterizes rotational positions of the housing at different moments within the capture duration;
- and
- one or more physical processors configured by machine-readable instructions to:
- determine a trajectory of the housing during the capture duration based on the position information, the trajectory reflecting the rotational positions of the housing at the different moments within the capture duration, the trajectory including a first portion corresponding to a first moment within the capture duration and a second portion corresponding to a second moment subsequent to the first moment within the capture duration;
- determine a smoothed trajectory of the housing based on a subsequent portion of the trajectory such that a portion of the smoothed trajectory corresponding to the first portion of the trajectory is determined based on the second portion of the trajectory, the smoothed trajectory having smoother changes in the rotational positions of the housing than the trajectory;
- determine a viewing window for the visual content based on the smoothed trajectory of the housing, the viewing window defining one or more extents of the visual content;
- and
- generate stabilized visual content of a video based on the viewing window, the stabilized visual content including a punchout of the one or more extents of the visual content within the viewing window.
8 more elements
A method for stabling videos, the method performed by an image capture system including one or more processors, an optical element, an image sensor, and a position sensor, the optical element carried by an image capture device and configured to guide light within a field of view to the image sensor, the method comprising:
- generating, by the image sensor, a visual output signal conveying visual information based on light that becomes incident thereon during a capture duration, the visual information defining visual content having the field of view;
- generating, by the position sensor, a position output signal based on positions of the image capture device during the capture duration, the position output signal conveying position information that characterizes rotational positions of the image capture device at different moments within the capture duration;
- determining, by the one or more processors, a trajectory of the image capture device during the capture duration based on the position information, the trajectory reflecting the rotational positions of the image capture device at the different moments within the capture duration, the trajectory including a first portion corresponding to a first moment within the capture duration and a second portion corresponding to a second moment subsequent to the first moment within the capture duration;
- determining, by the one or more processors, a smoothed trajectory of the image capture device based on a subsequent portion of the trajectory such that a portion of the smoothed trajectory corresponding to the first portion of the trajectory is determined based on the second portion of the trajectory, the smoothed trajectory having smoother changes in the rotational positions of the image capture device than the trajectory;
- determining, by the one or more processors, a viewing window for the visual content based on the smoothed trajectory of the image capture device, the viewing window defining one or more extents of the visual content;
- and
- generating, by the one or more processors, stabilized visual content of a video based on the viewing window, the stabilized visual content including a punchout of the one or more extents of the visual content within the viewing window.
4 more elements
Dependencies are inferred from the claim text.