Back to results
US 11,238,901 B1Granted
Generation of audio-synchronized visual content
AssigneeGoPro, Inc.
InventorsAlexis Lefebvre, Guillaume Oulès, Anandhakumar Chinnaiyan, Maxime Renaudet, Anaïs Oulès
Life of this patent
Estimating the term…
Abstract
An image capture device may provide playback of audio content during capture of visual content. Moments within the audio content may be associated with cue markers. The visual content may be synchronized with the audio content provided during capture, and a video edit may be automatically generated based on the moments associated with the cue markers.
Claims12
An image capture device for generating audio-synchronized visual content, the image capture device comprising:
- a housing;
- an image sensor carried by the housing and configured to generate a visual output signal conveying visual information based on light that becomes incident thereon, the visual information defining visual content;
- an optical element carried by the housing and configured to guide light within a field of view to the image sensor;
- a speaker carried by the housing and configured to provide playback of audio content for capture of the visual content;
- one or more physical processors configured by machine-readable instructions to:
- obtain audio information defining the audio content, the audio content including music, the audio content having an audio progress length, wherein moments within the audio progress length are associated with cue markers;
- effectuate the playback of at least a portion of the audio progress length of the audio content through the speaker for the capture of the visual content, wherein at least a first duration of the music is played through the speaker for the capture of the visual content;
- capture the visual content during a capture duration with the playback of the at least the portion of the audio progress length of audio content, the visual content having a visual progress length based on the capture duration, wherein the image capture device internally tracks timing of the audio content playback during the capture of the visual content, wherein the internally tracked timing of the audio content playback is matched to timing of when the visual content is captured by the image capture device;
- and
- synchronize the visual content captured during the capture duration with the at least the portion of the progress length of the audio content based on the matching of the internally tracked timing of the audio content playback to the timing of when the visual content is captured by the image capture device, one or more moments within the visual progress length of the visual content associated with one or more of the cue markers of the audio content, wherein the first duration of the music is synchronized to a second duration of the visual content that was captured during the audio content playback of the first duration of the music;
- wherein a video edit is generated based on the cue markers, at least a portion of the visual content captured during the capture duration included within the video edit based on the association of the one or more moments within the visual progress length of the visual content with the one or more of the cue markers of the audio content;
- wherein the audio content further includes verbal direction to direct one or more users of the image capture device to perform an action during the capture duration, the verbal direction including a countdown to the action to be performed by the one or more users;
- wherein the first duration of the music that is played through the speaker for the capture of the visual content is copied from an original music file for the music to an audio track for the visual content stored in a video file;
- and
- wherein speed of the audio content playback by the image capture device during the capture of the visual content is decreased based on time-lapse capture of the visual content and is increased based on slow-motion capture of the visual content.
12 more elements
A method for generating audio-synchronized visual content, the method performed by an image capture device including one or more processors, an image sensor, an optical element, and a speaker, the image sensor configured to generate a visual output signal conveying visual information based on light that becomes incident thereon, the visual information defining visual content, the optical element configured to guide light within a field of view to the image sensor, the speaker configured to provide playback of audio content for capture of the visual content, the method comprising:
- obtaining audio information defining the audio content, the audio content including music, the audio content having an audio progress length, wherein moments within the audio progress length are associated with cue markers;
- effectuating the playback of at least a portion of the audio progress length of the audio content through the speaker for the capture of the visual content, wherein at least a first duration of the music is played through the speaker for the capture of the visual content;
- capturing the visual content during a capture duration with the playback of the at least the portion of the audio progress length of audio content, the visual content having a visual progress length based on the capture duration, wherein the image capture device internally tracks timing of the audio content playback during the capture of the visual content, wherein the internally tracked timing of the audio content playback is matched to timing of when the visual content is captured by the image capture device;
- and
- synchronizing the visual content captured during the capture duration with the at least the portion of the progress length of the audio content based on the matching of the internally tracked timing of the audio content playback to the timing of when the visual content is captured by the image capture device, one or more moments within the visual progress length of the visual content associated with one or more of the cue markers of the audio content, wherein the first duration of the music is synchronized to a second duration of the visual content that was captured during the audio content playback of the first duration of the music;
- wherein a video edit is generated based on the cue markers, at least a portion of the visual content captured during the capture duration included within the video edit based on the association of the one or more moments within the visual progress length of the visual content with the one or more of the cue markers of the audio content;
- wherein the audio content further includes verbal direction to direct one or more users of the image capture device to perform an action during the capture duration, the verbal direction including a countdown to the action to be performed by the one or more users;
- wherein the first duration of the music that is played through the speaker for the capture of the visual content is copied from an original music file for the music to an audio track for the visual content stored in a video file;
- and
- wherein speed of the audio content playback by the image capture device during the capture of the visual content is decreased based on time-lapse capture of the visual content and is increased based on slow-motion capture of the visual content.
7 more elements
Dependencies are inferred from the claim text.