Back to results
US 11,889,189 B1Granted
Stabilization of video with object detection
AssigneeGoPro, Inc.
InventorsSéraphin Cyrille Philippe Bonnaffé, Nicolas Rahmouni
Life of this patent
Estimating the term…
Abstract
An image capture device may capture a video. A part of the video may include depiction of an object of interest, and another part of the video may not include depiction of the object of interest. Stabilization of the video may switch between object stabilization and movement stabilization based on whether or not the video depicts the object of interest. The part of the video depicting the object of interest may be stabilized using object stabilization. The part of the video not depicting the object of interest may be stabilized using movement stabilization.
Claims20
A system for stabilizing videos, the system comprising:
- one or more physical processors configured by machine-readable instructions to:
- obtain visual information defining visual content of a video, the visual content of the video captured by an image capture device;
- and
- switch between movement stabilization and object stabilization to stabilize the visual content of the video, wherein the movement stabilization is used to stabilize the visual content in a first part of the video in which the visual content does not depict an object of interest and the object stabilization is used to stabilize the visual content in a second part of the video in which the visual content depicts the object of interest, wherein switching between the movement stabilization and the object stabilization to stabilize the visual content of the video includes:
- determination of whether the object of interest is depicted within the visual content in a given part of the video;
- responsive to determination that the visual content in the given part of the video does not depict the object of interest, stabilization of the visual content in the given part of the video based on the movement stabilization, the movement stabilization including stabilization of the visual content based on movement of the image capture device during capture of the given part of the video, the movement stabilization of the visual content including use of a first viewing window to provide a first punchout of the visual content to stabilized the visual content, wherein the movement stabilization does not take into account depiction of things within the visual content and stabilizes the visual content without regards as to relationship between where the first viewing window is placed within the visual content and where things are depicted within the visual content in the given part of the video;
- and
- responsive to determination that the visual content in the given part of the video depicts the object of interest, stabilization of the visual content in the given part of the video based on the object stabilization, the object stabilization including use of placement of the object of interest within the visual content to determine placement of a second viewing window to provide a second punchout of the visual content that keeps the object of interest within a center portion of the stabilized visual content, wherein the object stabilization does not take into account movement of the image capture device during capture of the given part of the video, the second viewing window smaller than the first viewing window.
5 more elements
A system for stabilizing videos, the system comprising:
- one or more physical processors configured by machine-readable instructions to:
- obtain visual information defining visual content of a video, the visual content of the video captured by an image capture device;
- and
- switch between movement stabilization and object stabilization to stabilize the visual content of the video, wherein the movement stabilization is used to stabilize the visual content in a first part of the video in which the visual content does not depict an object of interest and the object stabilization is used to stabilize the visual content in a second part of the video in which the visual content depicts the object of interest, wherein switch between the movement stabilization and the object stabilization to stabilize the visual content of the video includes:
- determination of whether the object of interest is depicted within the visual content in a given part of the video;
- responsive to determination that the visual content in the given part of the video does not depict the object of interest, stabilization of the visual content in the given part of the video based on the movement stabilization, the movement stabilization including stabilization of the visual content based on movement of the image capture device during capture of the visual content;
- given part of the video, wherein the movement stabilization does not take into account depiction of things within the visual content and stabilizes the visual content without regards as to relationship between where a viewing window for stabilization is placed within the visual content and where things are depicted within the visual content in the given part of the video;
- and
- responsive to determination that the visual content in the given part of the video depicts the object of interest, stabilization of the visual content in the given part of the video based on the object stabilization, the object stabilization including use of placement of the object of interest within the visual content to determine where the viewing window for stabilization is placed within the visual content, wherein the object stabilization does not take into account movement of the image capture device during capture of the given part of the video.
6 more elements
A method for stabilizing videos, the method performed by a computing system including one or more processors, the method comprising:
- obtaining, by the computing system, visual information defining visual content of a video, the visual content of the video captured by an image capture device;
- and
- switching, by the computing system, between movement stabilization and object stabilization to stabilize the visual content of the video, wherein the movement stabilization is used to stabilize the visual content in a first part of the video in which the visual content does not depict an object of interest and the object stabilization is used to stabilize the visual content in a second part of the video in which the visual content depicts the object of interest, wherein switching between the movement stabilization and the object stabilization to stabilize the visual content of the video includes:
- determining, by the computing system, whether the object of interest is depicted within the visual content in a given part of the video;
- responsive to determining that the visual content in the given part of the video does not depict the object of interest, stabilizing, by the computing system, the visual content in the given part of the video based on the movement stabilization, the movement stabilization including stabilization of the visual content based on movement of the image capture device during capture of the given part of the video, wherein the movement stabilization does not take into account depiction of things within the visual content and stabilizes the visual content without regards as to relationship between where a viewing window for stabilization is placed within the visual content and where things are depicted within the visual content in the given part of the video;
- and
- responsive to determining that the visual content in the given part of the video depicts the object of interest, stabilizing, by the computing system, the visual content in the given part of the video based on the object stabilization, the object stabilization including use of placement of the object of interest within the visual content to determine where the viewing window for stabilization is placed within the visual content, wherein the object stabilization does not take into account movement of the image capture device during capture of the given part of the video.
4 more elements
Dependencies are inferred from the claim text.