US 10,432,855 B1Granted

Systems and methods for determining key frame moments to construct spherical images

AssigneeGoPro, Inc.

InventorsAlexandre Jenny, Renan Coudray, Antoine Méler, Thomas Vuillermet

Life of this patent

Estimating the term…

Loading patent…

Abstract

Multiple video segments, including multiple frames, may be obtained. The video segments may be time synchronized for at least portions of the video segments captured during a synchronized time period. A first key frame moment may be set with the synchronized time period. A first set of construction parameter values may be determined for the frames captured during the first key frame moment. A first set of spherical images may be constructed using the first set of construction parameter values. A change may be detected in the construction parameter values at a moment in time subsequent to the first key frame moment, which may be identified as a second key frame moment. A second set of construction parameter values may be determined for the frames captured during the second key frame moment. The second set of spherical images may be constructed using the second set of construction parameter values.

Claims20

Dependent claims

A system for determining key frame moments to construct spherical images, the system comprising:

one or more physical computer processors configured by computer readable instructions to:
obtain multiple video segments, individual video segments including multiple frames, wherein the individual video segments are time synchronized for at least portions of the individual video segments captured during a synchronized time period;
set a first key frame moment within the synchronized time period;
determine a first set of stitching parameter values for the frames of the individual video segments captured during the first key frame moment, the first set of stitching parameter values including values of one or more of an image capture device parameter, a color parameter, a stabilization parameter, and/or an exposure parameter;
construct, using the first set of stitching parameter values, a first set of spherical images, the first set of spherical images including a first spherical image constructed from the frames of the individual video segments captured during the first key frame moment and at least one other spherical image from the frames of the individual video segments captured at a moment adjacent or near the first key frame moment;
detect a change in the stitching parameter values of the individual video segments relative to the first set of stitching parameter values at a moment in time subsequent to the first key frame moment;
identify, based on the detected change in the stitching parameter values of the individual video segments relative to the first set of stitching parameter values not being within a predefined threshold, the moment in time subsequent to the first key frame moment as a second key frame moment;
determine a second set of stitching parameter values for the frames of the individual video segments captured during the second key frame moment;
and
construct, using the second set of stitching parameter values, a second set of spherical images, the second set of spherical images including a second spherical image constructed from the frames of the individual video segments captured during the second key frame moment and at least one other spherical image constructed from the frames of the individual video segments captured at a moment adjacent or near the second key frame moment and preceding the second key moment such that the second set of stitching parameter values are used to construct the at least one other spherical image from the frames of the individual video segments captured at a moment in time between the first key frame moment and the second key frame moment.

7 more elements

A method for determining key frame moments to construct spherical images, the method comprising:

obtaining multiple video segments, individual video segments including multiple frames, wherein the individual video segments are time synchronized for at least portions of the individual video segments captured during a synchronized time period;
setting a first key frame moment within the synchronized time period;
determining a first set of stitching parameter values for the frames of the individual video segments captured during the first key frame moment, the first set of stitching parameter values including values of one or more of an image capture device parameter, a color parameter, a stabilization parameter, and/or an exposure parameter;
constructing, using the first set of stitching parameter values, a first set of spherical images, the first set of spherical images including a first spherical image constructed from the frames of the individual video segments captured during the first key frame moment and at least one other spherical image from the frames of the individual video segments captured at a moment adjacent or near the first key frame moment;
detecting a change in the stitching parameter values of the individual video segments relative to the first set of stitching parameter values at a moment in time subsequent to the first key frame moment;
identifying, based on the detected change in the stitching parameter values of the individual video segments relative to the first set of stitching parameter values not being within a predefined threshold, the moment in time subsequent to the first key frame moment as a second key frame moment;
determining a second set of stitching parameter values for the frames of the individual video segments captured during the second key frame moment;
and
constructing, using the second set of stitching parameter values, a second set of spherical images, the second set of spherical images including a second spherical image constructed from the frames of the individual video segments captured during the second key frame moment and at least one other spherical image constructed from the frames of the individual video segments captured at a moment adjacent or near the second key frame moment and preceding the second key moment such that the second set of stitching parameter values are used to construct the at least one other spherical image from the frames of the individual video segments captured at a moment in time between the first key frame moment and the second key frame moment.

6 more elements

Dependencies are inferred from the claim text.