Object animation with user-provided audio supplementation
OwnerJeremy Hardt Rudo, Tovi Jordan Newman +1inventors
InventorsJeremy Hardt Rudo, Tovi Jordan Newman, Patrick Wallace Brooks
Life of this patent
Estimating the term…
Abstract
Systems, methods, and techniques to generate a video based, at least in part, on an image and an audio track. In one example, a system obtains an image depicting an object and an audio track, and generates a video depicting one or more features of the object animated based on the audio track.
Claims20
A computer-implemented method, comprising:
- obtaining an image depicting an object;
- obtaining an audio track comprising one or more musical notes;
- segmenting an audio clip into a first set of one or more audio segments;
- modulating the first set of one or more audio segments by adjusting the first set of one or more audio segments to match the one or more musical notes of the audio track;
- generating a second set of one or more audio segments based, at least in part, on the modulation;
- generating a second audio track by combining the second set of the one or more audio segments and the audio track;
- and
- generating a video comprising one or more animations of the object and associating the second audio track with the one or more animations.
A system, comprising:
- one or more processors;
- and
- memory with instructions that, as a result of being executed by the one or more processors, cause the system to:
- obtain an image depicting an object;
- obtain an audio track and an audio clip;
- modulate a first set of audio segments of the audio clip based, at least in part, on a set of musical notes of the audio track to generate a second set of audio segments;
- generate a second audio track based, at least in part, on the audio track and the second set of audio segments;
- and
- generate a video comprising the second audio track and depicting one or more animations of the object.
A non-transitory computer-readable storage medium comprising executable instructions that, as a result of being executed by one or more processors of a computer system, cause the computer system to at least:
- obtain an image depicting an object with one or more features;
- obtain an audio clip and an audio track comprising one or more musical notes;
- modulate one or more audio segments of the audio clip to match the one or more musical notes of the audio track;
- generate one or more modulated audio segments based, at least in part, on the modulation;
- generate a second audio track based, at least in part, on the one or more modulated audio segments and the audio track;
- and
- generate a video associating the second audio track with one or more animations of the object.
Dependencies are inferred from the claim text.