Back to results
US 11,237,690 B2Granted
Systems and methods for smoothing views of videos
AssigneeGoPro, Inc.
InventorsDaryl Stimm, William Edward MacDonald
Life of this patent
Estimating the term…
Abstract
A viewing window for a spherical video may define which extents of the spherical video are viewable. Abrupt changes in the extents defined by the viewing window may result in non-smooth views of the spherical video, such as stagger, jitter, and/or other jerky motions being included in the views of the spherical video. Changes in the extents defined by the viewing window may be smoothed to provide smoother views of the spherical video.
Claims20
A system for smoothing views of videos, the system comprising:
- one or more physical processors configured by machine-readable instructions to:
- obtain video information defining video content, the video content having a progress length and including video frames that define visual content as a function of progress through the progress length;
- obtain viewing window information for the video content, the viewing window information characterizing a viewing window for the video content, the viewing window defining a first set of extents of the visual content as the function of progress through the progress length, wherein the viewing window is defined based on engagement of a user with a touchscreen display, further wherein a jerk in the engagement of the user with the touchscreen display results in a jerk in changes in the first set of extents and a jerk in a path of viewing directions for the viewing window;
- obtain margin information, the margin information defining a margin constraint that limits differences between the first set of extents of the visual content defined by the viewing window and a second set of extents of the visual content defined by a smoothed viewing window, the margin constraint including independent constraints for yaw and pitch of the viewing window such that the margin constraint includes a yaw axis constraint and a pitch axis constraint, the yaw axis constraint independently limiting differences in yaw viewing directions for the viewing window and the smoothed viewing window and the pitch axis constraint independently limiting differences in pitch viewing directions for the viewing window and the smoothed viewing window;
- determine smoothed viewing window information based on the viewing window information and the margin information, the smoothed viewing window information characterizing the smoothed viewing window to be used in place of the viewing widow in a presentation of the video content, the smoothed viewing window defining the second set of extents of the visual content as the function of progress through the progress length, wherein the jerk in the changes in the first set of extents is smoothed in changes in the second set of extents such that the a smoothed path of viewing directions for the viewing window is determined to be used in place of the path of viewing directions in the presentation of the video content, the smoothed path of viewing directions determined by smoothing the jerk in the path of viewing directions;
- and
- present the video content on a display based on the smoothed viewing window information.
4 more elements
A method for smoothing views of videos, the method performed by a computing system including one or more processors, the method comprising:
- obtaining, by the computing system, video information defining video content, the video content having a progress length and including video frames that define visual content as a function of progress through the progress length;
- obtaining, by the computing system, viewing window information for the video content, the viewing window information characterizing a viewing window for the video content, the viewing window defining a first set of extents of the visual content as the function of progress through the progress length, wherein the viewing window is defined based on engagement of a user with a touchscreen display, further wherein a jerk in the engagement of the user with the touchscreen display results in a jerk in changes in the first set of extents and a jerk in a path of viewing directions for the viewing window;
- obtaining, by the computing system, margin information, the margin information defining a margin constraint that limits differences between the first set of extents of the visual content defined by the viewing window and a second set of extents of the visual content defined by a smoothed viewing window, the margin constraint including independent constraints for yaw and pitch of the viewing window such that the margin constraint includes a yaw axis constraint and a pitch axis constraint, the yaw axis constraint independently limiting differences in yaw viewing directions for the viewing window and the smoothed viewing window and the pitch axis constraint independently limiting differences in pitch viewing directions for the viewing window and the smoothed viewing window;
- determining, by the computing system, smoothed viewing window information based on the viewing window information and the margin information, the smoothed viewing window information characterizing the smoothed viewing window to be used in place of the viewing widow in a presentation of the video content, the smoothed viewing window defining the second set of extents of the visual content as the function of progress through the progress length, wherein the jerk in the changes in the first set of extents is smoothed in changes in the second set of extents such that the a smoothed path of viewing directions for the viewing window is determined to be used in place of the path of viewing directions in the presentation of the video content, the smoothed path of viewing directions determined by smoothing the jerk in the path of viewing directions;
- and
- presenting, by the computing system, the video content on a display based on the smoothed viewing window information.
3 more elements
Dependencies are inferred from the claim text.